I'm going to break the Intel/Nvidia party.
I've got the same problem, but I'm on an AMD setup. Avatars load really slowly, inventory screen takes a while to load and sound is delayed. My RAM usage also seems to be capped at 1GB. My specs are as follows:
FX-6300 3.5GHz
16GB Ram
Radeon R9 270
Other than that the game runs perfectly fine and I have not encountered any crashes.