You couldn't buy a horse? That sounds very stupid.
Depending on the cultural background of the character I would give them a horse, either a light warhorse or a normal riding horse. One of my players made a character who spend all his feats he got dealing with his horse. He took pretty much all the feats dealing with being mounted on a horse: Mounted Archery, Mount Combat, Ride By Attack, etc...