I agree in principle, but not in practice. I started on PotD, because real men put the slider to the right. Enjoyed the difficulty for the first few hours, but when I found myself reloading for 90min just to kill a bunch of boars I realized the RNG was in control and I wasn't having fun anymore. Restarted in Hard.
I think PotD is a great feature and I'll be sliding all the way to the right for my second play through. For now I want to role-play and enjoy the (so-far awesome) story.
I stopped at that same point. You really have to master your knowledge of the core mechanics to pull of PoTD and min/max like crazy. The hardest part of PoTD wasn't the number of enemies or the limited supplies, it was the fact that you miss every one of your attacks. So if you're strategy is to CC a certain enemy...nope, it misses half the time.