Actually, might is strength.
Take notice of scripted interactions and that race with huge might bonus is also biggest one, while "weakest" race is also smallest one.
Later perhaps could be explained by amount of soul they can reside in their bodies.
But i don't mind such discrepancy since it allows me to build amazing wizard that can deal damage both with magic and weapon.