After much experimentation, I've narrowed down a potential cause for this bug to an external program: EVGA Precision X
Closing Precision X seems to resolve the freezing issue, and I was able to play for more than an hour or so without any problems.
I have no idea why it could be causing a conflict with PoE, but hopefully this info will help someone out.