I know a lot of people are suffering from long loading times, and even on a good system this can be annoying.
Most of the time you spend a lot of time on a map, so it's not a big thing, but after playing the White March and running around in Stalwart this actually became really annoying. With all the running in and out of buildings, you spent more time watching the load screen than actually playing the game.
I don't know if it's technically feasable, but my suggestion would be that in areas like Stalwart, Defiance Bay and similar the full map including it's buildings are loaded, so transitions in and out of buildings are done without a loading screen.
This might make the load times for the initial entry slightly longer, but you would skip the following transitions which I'd prefer any day of the week.
Love the game, and can't wait for the part of the White March!