Why then this prejudice?

There have always been, of course, slow pace dances, just as there are nowadays. "When a man loves a woman" is slow, but does that mean you don't enjoy dancing to it?
Still, most people seem to think that our forefathers just crept about in the ballroom.