My thinking is they restrict it to force you to use 'food' etc for pre-buffing. I'm inclined to agree the majority here and say let everything be usable out of combat. Personally, I wouldn't use anything combat related out of combat but atleast that would be my choice.