The supposed objection is that it is being forced on people by the government, and some Americans don't like that. It certainly comes across as selfish. I have no problem wearing one.
The irony is that the population loss would be completely replaced in about 50 years. Where's the logic in that? It would have been better to slow the reproduction rate of intelligent species.