Brown made the statement to TODAY during the first interview he has given since his ex-wife passed away in February.
Interviewer Matt Lauer said to the singer: "If I heard it once, I heard it a hundred times, and I know you heard it too. Fans, people who say they were close to Whitney, say her life went downhill when she met Bobby Brown. How does it make you feel when you hear it?"
Brown replied: "It makes me feel terrible. But you know, I know differently.
"I think if anyone ever knew us, if anybody ever spent time around us instead of time lookin' through the bubble, they would know how we felt about each other. They would know how happy we were together."
When asked about the popular perception that he got Houston hooked on drugs, Brown said: "Not true. I didn't get high [on narcotics] before I met Whitney. I smoked weed, I drank the beer, but no, I wasn't the one that got Whitney on drugs at all."
Commenting that drugs were a part of the singer's life "way before" they became involved, he added: "It's just... it's just unexplainable how one could, you know, [say that I] got her addicted to drugs. I'm not the reason she's gone."
Earlier this week Brown was spared a jail sentence for an offence of driving under the influence.