Same issue for me. Tried different things like imitating combat with my main (who is a Paladin, doh!) standing far away. Sometimes I can do half the battle before the guards aggro and sometimes the aggro at combat start.
I also run in turn based mode.
This is a serious bug and should be addressed by developers.