Isn't all fantasy kind of dumb? It's fantasy, so it just needs to be internally consistent. The "souls" provide a lore mechanic for this setting, and a hook for the main protagonist. Your character is deeply intertwined with the nature of "souls" in this setting, providing its own unique motivation for your story. In that sense it isn't dumb; it's just a uniqueness of the setting.