They should already have ditched the modifier system after Morrowind. In Morrowind having high stats was critical, because it was possible to fail at casting a spell and miss during melee combat. Hence, the necessary scrounging for x5 modifiers.
In Oblivion, you cannot fail at anything. Combined with absolute level scaling, it means that it is best to just remain at level 1 and keep increasing all your skills instead.