I figured it out! I just copied the data and sounds folder, and the config file, and everything else from the original cave story folder to the one with my new program.
As for your insult, my problem-solving skills are perfectly fine, but it's always good to get help from the people who know...