As far as these things go, this video of the Muppets singing So What'cha Want by the Beastie Boys is pretty near perfect.
See also The Muppets singing Kanye West's Monster and the Sesame Street gang doing the Beastie Boys' Sure Shot. Oh, and the classic Bert & Ernie Ante Up rap video:
(via subtraction)