The pad won't rotate if you have too much pressure on the pad, the pad is gummed up, the pad isn't completely flat on the surface, the speed isn't fast enough, etc. I'm not too familiar with speed 5, I do most, if not all of my work on 6 and I have a hard time to get the pad to stop spinning. On lower speeds, it can / will stop...
There isn't anything wrong with taking a lot of time.... a heck of a lot easier to take the time and do it via PC vs. by hand

, the results are worth it too I bet, but yes, you'll speed up with time as you get more comfortable.