Can we please get access to a temperature setting?

For those of you who don’t know, “temperature” refers to how “creative” or “random” an LLM’s output is. Low temperature creates more deterministic and consistent output, high temperature creates more unpredictable or imaginative answers. Low temp is good for facts and research, high temp is good for creative writing or brainstorming.

They could, theoretically, even make it so that 0 temperature IS deterministic and if you give the model the exact same prompt twice with 0 temperature you get the exact same output twice.

Pretty please give temperature setting it would allow people who know what they’re doing to better tune the model to their needs thx <3

Leave a Reply