I don't exactly see what could go wrong with your saves, we weeded out all the save-corruptions during the beta testing.
It seems I can back up my saves by simply right-clicking Cave Story+, then selecting back-up game files. This is also how you can back up most other games.