Yes, of course. I'm not saying that isn't true. But that doesn't mean that languages are all equally hard to learn. It's just that, for example, a Portuguese native speaker learns a lot about speaking Spanish while learning how to speak Portuguese, even if he isn't aware of it at first.
As an example of what I'm trying to say, Portuguese is grammatically much more complex than English. Furthermore, Portuguese has a much larger vocabulary than English.