The Fox drama is currently shooting an instalment which features eight songs from the late musician, E! Online reports.
A source claimed that the episode will "not be a typical tribute" and added that it will focus on the graduating characters struggling to deal with the changes in their lives.
"It's using Whitney's music as a way to say goodbye," the insider said. "A way to respectfully say thank you for her music."
Lea Michele, who plays Rachel in Glee, recently posted on Twitter that the cast were paying tribute to a star, saying: "Starting a new episode today. A very special tribute to one of the worlds most amazing singers. Very excited about this one."
She later added that she was "singing a really great version of one of [her] favourite songs" with Amber Riley, Naya Rivera and Chris Colfer and teased: "Filming something right now that's going to be really special.. Can't wait for you all to see it..."
Following Houston's death earlier this year, Riley sang 'I Will Always Love You' on Glee. The performance had always been planned but the show paid tribute to Houston by adding a title card in her memory at the end of the episode.
Glee is currently on hiatus and will return on April 10 on Fox in the US, though it is not yet clear when the tribute episode will air. The show continues on Thursdays at 9pm on Sky1 in the UK.