That's what I thought when I first did the castle then I ended up doing stuff like spending 5,000 on freeing the slaves and 6,000 on that amulet quest with the prostitute.
Nice to know that I can compensate by going on the Endless Paths. I'm just waiting for the right level to do it from beginning to end. My character is good aligned and helped the Crucible Knights so I won't be doing any assassinating on them.