I don't know about being a legend. Seems a bit bigheaded of us.
I was thinking merc group, extinct wizard order, or fantasy version of ninja- like, the real ninja, spies and assassins that blended in with the common people, not guys in black suits with smoke bombs.