My biggest "faction" is made up of those black and dark red Vladek soldier dudes from KK2, I have 5 of them. And 1 Vladek. I have no crownies, skeletons, trolls or dwarves, but I do have some (15-20?) of the 80's castle themes' soldiers somewhere in my unsorted childhood LEGO.
Remember, it's not the size of the army, but how you use it!