You're not the only one at all who thought so. But I do not agree. There always are enough possibilities to get your spirit energy high enough, I never had problems even though my character was a caster (druid). Granted, I almost never devoured anything, so the hunger shrunk to a minimum in time. To me, it just added quite a bit to the need to get rid of this damn curse and a motivation for certain reactions by my character. Only tying the way of satisfying the hunger to the alignment was a bit sub-optimal, but removing it (it is removed now, isn't it it?) makes the consequences less noticable.