I also have a somewhat similar problem. I said i would talk with the captain, which I did, and took him as a prisoner for my castle. I went back south to talk to fangs guy as per journal and they have all gone.
I would upload my save but its 8 times the limit it allows me.