I'm experiencing exactly the same thing, and it's driving me crazy. I get similar problems in the area map, I regularly see "points of interest" from a different location overload all across the actual map of the location I'm in. I've enjoyed PoE so far, but this is making the game very difficult to play, to the point where I'm close to stopping trying.
The only "solution" I've found is to completely quit the game (back to the desktop) and then relaunch. The initial area will then be ok, but after a short time the problem re-occurs. It's a very time-consuming fix when this needs to be used repeatedly.
In case it's relevant, I'm playing this via the Xbox Game Pass for Windows 10 service.
