I have also run into this same issue and it's preventing me from completing a number of quest. I'm trying to wait the 3 days but as I'm not sure of how long this takes, real world time, I am not sure if this is just broken or if I have not waited long enough.