AA is the first thing I always turn off when I play my PC games, despite having a quite powerful rig.
Jaggies are something I never noticed. Just don't look so hard, enjoy the game instead.
Jaggies are only a problem you're going to truly notice when you're rendering below the native resolution of the display.
Because most games are rendered at 720p for example, when you put that on a 1080p system with no AA you will notice the jaggies, and it will look exceptionally ugly.
That said I do agree with what you're saying, it can be an ugly game, but if you're having fun it doesn't matter.