Having a similar problem myself, made a Swashbuckler with the black jacket fighter variant, and while weapon switching works as expected, reloading doesn't, even reloading from stealth still lasts the same amount of time as it does when reloading without stealth. I was able to get pistol reload down to .6 seconds when stealthed and it was the same speed as it was without stealth, and the reload modal.