Ok, my bet is that the White Rabbit is Joey Fatone from NSync, the Peacock sounds very much like Donny Osmond, the Bee absolutely is Tina Turner, no guess on the Monster, and the Lion is a white country music singer whose name I cannot remember, but whose face I can see clearly. There was no question at all as to who the Pineapple guy was.
I was sure that the Alien was Paula Abdul, but it turned out to be LaToya Jackson.
The suspense is killing me.
(You can catch their performances on YouTube if you can't stream Fox.)