Modal Proficiencies remain Even with no correct weapon - seems to happen if you change weapon set right after you activate it

[Romaniac01]

I have right now 3 Modal Proficiencies active, but i dont use any of those weapons.

 

I am double wielding pistols now, but the medium shield Block proficiency is staying. Very confusing, it is as if it gives me a bonus even if i don't have it.

It seems to happen if you switch load out when activating and then it can never get deactivated.

 

Can you please force the current effect to get removed when you don't have the correct item in hand?