2 years ago: why CAN'T chatGPT-4 create multiple choice tests with properly shuffled correct answers? : r/ChatGPT
This problem still persists in ChatGPT 5.1. I asked it specifically to randomize the answers- three times already, to no avail.
It swears it did randomize the answers this time; it even prints out "(Answer positions randomized.)" in every new question, yet all the correct answers are A (80%) or B (20%), never C or D.
I just find it interesting.