Sigh... we meet again, loading times. They say history repeats itself.
The way I view it, this issue has two parts:
1. Game design: instead of loading everything upon entering an area, each instance seems to be loaded individually. This means that all the houses in a town are loaded upon entry, and as you exit them, the town area is loaded. The sheer amount of loading screens is problematic in itself.
2. The length of said loading times. For me, they're about ~15-20 seconds. For some, they're even longer. Then for others, they're not so bad at all. What causes some people to have longer loading times than others is still something of a mystery.
It would be interesting to see how Obsidian developers react to this issue. Right now, there's a lot of frustrated players, and as far as I know, this issue has been given little attention. Course, while they're working hard on other stuff, they just might not be aware of the seriousness of this issue. With how good the game is, it drives me crazy to think that it's just not playable for a lot of people.