Yep, siding with the doctor is a nice scenario. But who would oppose this overpowered alliance of the Doctor, Misery, The Core and Quote? Even the Rabbit Mimiga would be helping them.
On the other side we just have Curly and that's about it regarding capable fighters. :O