By skyforbes - When working out of the same chat for a while, and asking to write code again ChatGPT can fail by saying that Python is broken, so I spent full day waiting for Python to be fixed. Meanwhile I asked if Python was working in 2nd chat, and it said it was working, but in first chat where all the data was located with memory of things said it was broken. Taking some losses, I copied the code and pasted it in new chat that gracefully compiled the code in Python, because now it was "working". So, you are hitting memory limitations per chat and then met with a warning that "Python is broken"
- Next I had to rewrite code over 10 times, because ChatGPT would forget all the details I gave it, and say that new script doesn't have them
- While 2 generated scripts before they were in the script, and I only found out because I am paranoid and re-ran the code in second chat to make sure it is correct.
- Second chat found all those issues, and thankfully I had everything saved, before second let me know that towards the end of my scripting the ChatGPT forgot all my details, and gave basically nearly empty canvas.
- I found some strange way ChatGPT creates the code in general, it loves to give placeholders, but doesn't write the code in there, it will say all files are ready, and when you look into the Python files, it will literally say it's a placeholder for an actual code, LOL! So, I nearly lost all my work from 3 days of doing the code. Until I used the phrase "create REAL files", then it finally added all the scripts that I requested. This is why you should periodically paste files into a 2nd chate.
- The reason you are forced to move to a 2nd chat is because first one gets so laggy, it's impossible to use it.
What I learned from this is that I must save often, and I must save revisions of same files or accidentally realize that ChatGPT forgot ALL of my details in some strange memory reset on the server.
Another thing that I noticed is that if you give ChatGPT all the control in terms of questioning, it has a tendency to forget what you asked for in the beginning, it's like its' questions eventually overwrite your logic if you are not careful, but I do believe it is based on duration of your work in same chat.
Amount of messages in the same chat play a huge role in what it forgets too.
Sometimes ChatGPT completely wings the process and then tells you that the code is incorrect. So, I wrote a code, asked ChatGPT to make it for certain version of the program, it wrote it. Then I went and just in case asked ChatGPT to make sure it is correct.
ChatGPT then spits out that the code was written for the old version of the program, although I gave it instructions for the latest one.
Essentially, it bypassed my directions, then wrote what it wanted, then told me the code is incorrect upon checking, and oddly enough has data to know it's incorrect.
But, it wrote the code.
Also, it kept happening in different chats, no matter how many times I told the version of my program, it just kept looping back to its' "honed" knowledge of that certain old version.
I probably rewrote the code 10 times, because upon random revisions added, it would alter the code back to old version, then tell me that there is a mistake in my code, lol.
This is not to bash the tool, but also it's very strange how it knows how the code should be during analytics, but has no idea how to write code correctly, until you point it out.
If you are a code writer, please be very careful, save often, check files through ChatGPT and reiterate what you want.
As a code writer do not assume that the data will be remembered in chat, as even an hour can alter what has been purged out of memory
Ask ChatGPT often what is done to the file so far, and what is included, as it will refresh the memory, but it will also show you if anything is missing.
It's tough when the code gets very long, but trust me
It's important