Justin Timberlake 'doesn't want to get in the way' of Britney Spears

Justin Timberlake is trying to keep himself away from all the spotlight that has been cast upon him after Britney Spears' striking revelation about her abortion and his infidelity.

Spears, 41, and Timberlake, 42, dated back in 1999 until 2002, however, it remains unclear when exactly the singer became pregnant.

According to Daily Mail the insider revealed, “Justin thought that the decision that they made was a decision made together and he intended to never talk about it and for it to be kept their secret forever."

The source pointed out that why Timberlake is being silent, noting the secret is no longer hidden and it will “live forever” in the pages of the memoir, hence, “Justin is going to try not to say anything about it because he knows whatever he says from this point will likely be thrown back right at him.”

It's Gonna Be Me singer, who has previously expressed support for a woman's right to choose, is reportedly ready for his prior remarks regarding Britney to resurface.

The source added, “He is also very well aware that past statements he has made about Britney will and have come back to haunt him. Justin doesn't want to get in the way of her story, and he looks to avoid it at all costs.”

Spears' memoir, The Woman In Me is set to release on October 24, however, before its official launch, PEOPLE obtained an excerpt of the upcoming memoir in which the singer penned her “agonizing” life experience.

“It was a surprise, but for me, it wasn't a tragedy. I loved Justin so much. I always expected us to have a family together one day. This would just be much earlier than I'd anticipated,” Spears wrote.

She continued, “He said we weren't ready to have a baby in our lives, that we were way too young. I'm sure people will hate me for this, but I agreed not to have the baby.”