Yeah, the keep's a nice idea but poorly implemented. In the beginning, I assumed those rest bonuses would be cumulative and you'd have all of them, so was pretty surprised when I found it was far better to rest in inns. I'd enjoy it much more if there was some life around there too, with people wandering around, not just big empty spaces.