The frame rate limiter is set to max, that's not the issue. When I look in task manager the CPU usage fluctuates from 16% to 30% for the game. Memory is around 1,300MB. My computer seems to run slower doing everything when the game is running. What is another popular Unity game, I haven't had issues with any other games, but I am unsure if I have any other Unity games. Thanks for responding!
EDIT: Just checked. I have played The Forest, The Long Dark, Hearthstone, Jotun, and Rust, which are all listed as Unity games. So it is just PoE that is the issue. People have suggested that SLI might be an issue or GeForce experience, but I have tried without both. No fixes.