The 25-year-old dancer spoke of her eagerness to wed Scott-Lee in the compound on Monday, saying that she would marry him "tomorrow".
Speaking to Metro, the former popstar claimed that he would never consider a Big Brother wedding, saying: "They've not approached me to go into the house, but to be honest the only thing I would do would be to go in and have a meal or something.
"But there's no way we'd get married in there. I wouldn't want to meet the rest of the housemates and I don't think it would be fair on Lydia, to be honest. I'm not super famous, and she knows I'm not super famous, I walked away from the industry years ago."
Scott-Lee, 32, added that he has been taken aback by the levels of both abuse and support he has received since joining Twitter in an attempt to drum up support for Lydia.
"Some of the abuse [on Twitter] has been unbelievable really, but I'm there purely for Lydia and that's it. I'm certainly not using it to get back into the limelight," he said.
"But the flip side is that there are some really nice people out there."
Scott-Lee occasionally performs but now works primarily in the property industry. He was previously a member of the boyband 3SL and reached the finals of the second series of Pop Idol in 2003.
Watch the video for Scott-Lee's 2008 single 'Unforgettable' below: