I believe Fraps has since been updated and uses a newer version of the AVI container, and therefore supports larger files. However, Fraps still creates very large files since it uses a lossless codec.
I'd like to recommend Bandicam as a good alternative. It has no limits on filesize! It also gives the user the choice of codec, so you can select whatever compression / quality ratio you need.