yeah, the flaw says specifically, "when they're attacking your party you are not as effective as you should be". obviously that doesn't refer to sam. i never would have took this flaw if i knew it would be active with sam in the party, who clearly is not attacking the party.
