Yeah, I must back track what I previously said. I definitely notice the problem now, when using fairly complex models. I didn't notice it before when I was just testing it.
The solution is to frequently close S3D and reload the factory file. Obviously not an ideal solution, but a workaround nonetheless.