If anything, the calendar on the freighter in latest episode established that time moves exactly the same on the island. The plane crashed September 22nd, 2004. The calendar said December 24th, 2004, which corresponds to the 3 months they've spent on the island.
So, being on the island has no effect whatsoever on how time passes. However, passing the barrier surrounding the island seems to distort time.