Hmm, so since everything swarms the casters perhaps this can be turned into a benefit. What if you equip a caster with whatever speed increasing items are in the game, have that character begin to cast which will trigger the bumrush, and then use that character to kite everything around the room Benny Hill style while the rest of your party casually picks off the enemy?