John Bryan - Sarah Ferguson's ex-lover - made the stunning claim in his first-ever tell-all interview