I had a similar issue. What solved it for me, was to add the Init SDCard block and increase the frequency. So I'm guessing that reading from the sd card was just to slow to be able to play the music smoothly