Exact same for me. I read the part with them saying "if you do this for us, they wont work with you"
And i was thinking, well, sure i'll take the quest, but probably not do it. Utterly stuck in this questline aswell, as i truly dont like the Dozens, does not fit well with my char at all.