UltraJohn

Seems to be related to attacking non-hostile creatures. Natural explorer will get disabled when you hit them, but not reactivate after killing them. I suspect it's due to these creatures not triggering combat mode, and Natural explorer probably reactivates when combat ends, but there was no combat to begin with. Attacking a hostile creature and killing them causes NE to reactivate again.