I'm having the same problems too, as the host I have no problems but other player see things teleporting and sometimes can't interact with objects. These kind of issues have been happening since early access and make the game unplayable, I consider it a major issue for the game right now. Even though we are on the same table playing this still happens often. Couldn't find any fix, but I hope they also add a LAN option to multiplayer in the future.