I voted yes, but not so much for super broken weapons.
Voted yes to the idea of very unique weapons that would add to gameplay value.
You said Crom Feyr, well, Crom Feyr was the solution for me to build my little halfling partner (forgot her name) into a ranger throwing hammers.
Since Crom was a +4 weapon and not pierce but crush, she would perform, for my taste, better than any bow/crossbow guys.
I remember there were other items that you would just fell in love with, like in Fallout 2, the unique energy weapon which didn't use cells, but instead would use solar energy: the perfect solution to dispatch junkies and radscorpions alike.
In Arcanum there was an helmet which would diminish you alignment by 20 (non reversible) but also add +20% to your magic affinity, I would use this helmet on every of my character to get a top-notch magical affinity.
I say yes to items that gives special feat, I say no to nukes.