Update: Re-specing my character brought back the racial bonus, tested to see if double clicking would remove the racial bonus, it did not. Reasonably certain that it's because of playtime, or the character being knocked out. Wouldn't call this a fix, as it's a pain in the arse to respec my character every time I notice the racial bonus missing. That's like 1500 pand, man.