Prague Castle Band
I am not sure if these guys are an official paid band or just buskers, but they were there all three times I was in the Prague Castle area. They are really good and sell their CD’s as well. I bet that if you visit the castle they were be there playing their tunes.
Update: here is a photo that my friend Hugh took of them in 2002, seems like they have been there for a while.