(first post on this forum ^.^), there's another thread about the music messing up but this one's more recent so...
i have the same problem, and i recorded the sound output using camStudio+Free Studio Manager's mp3 video rip, but anyway
i re-installed cave story, twice, tried updating my sound...