I like the stronghold quests and the building fb game, but I agree with the OP, four loading screens to go sleep is too much. When you exausted the dialog options with your companions there is no real reason to go there ( in fact, there is no real reason to go anywhere in the stronghold except the salon and your bed)
Maybe you can rest outside, or in the first floor?. It would be nice if you can take your taxes and stuff outside too, because you have another two loadscreens to go...
Maybe it is my pc, but my loading time is a little slow, so its kind of annoying.