Are you sure it's Cave Editor that's the problem?
No one's ever had it corrupt the EXE before, ever. {Usually Sue's Workshop sorta does that, when you use both editors on the same EXE}
Have you tried downloading a virgin copy of Cave Story and then trying CE?
Doesn't hurt to make sure you've got the latest version, either.