I noticed it happen when I was going back and forth with it trying to create a short story that was pretty easy to maintain the plot if it's referring to the "project" that was being built, but I got careless and it eventually scrambled into nonsense – areas completely rewritten, characters forgotten, references lost etc.
I've played with a few iterations of this idea of persistent memory so far, each one has some cool properties and I think I've reached a decent solution using certain checks to "backup" certain events and compile an archive that can be re-fed to fresh GPTs so it maintains cohesion no matter if you're logged in or not and continue where you left off.
I'm curious if anybody else has approached this problem and has some any information that might help me?