I had the same issue on a 32bit OS, I got around it by forcing the game to run in openGL mode just for that town. I thought I would have the same issue loading the main cities too, but so far I've completed almost? all of Defiance Bay and all the surrounding areas, and haven't had another crash.