What is temperature?
Short answer
A setting that controls how predictable or varied an AI model's answers are. Lower is more consistent.
Definition
Temperature is a dial that controls randomness in an AI model's output. At a low setting the model sticks to its most likely wording and gives similar answers each time. At a higher setting it takes more chances, which can be useful for brainstorming and worse for accuracy.
Chat apps usually set it for you. It's exposed mainly in APIs and some business tools.
Why it matters for advisors
For compliance-sensitive tasks (summaries, data extraction, rule explanations) consistency is what you want. If your firm builds a workflow through an API, a low temperature is a simple way to reduce variation.
It also explains why the same prompt can give different answers on different days. That's normal, and it's another reason to review output rather than assume it's stable.
Low temperature doesn't mean accurate. A model can repeat the same wrong answer consistently. Temperature controls variety, not truth, so it's no substitute for checking figures and facts against the source.
Example
A firm's developer sets a low temperature on an internal tool that pulls figures from statements into a template, and a higher one on a tool that suggests blog topics.
Watch out for
Low temperature doesn't stop hallucinations. It only makes the model's answers more repeatable.
Related terms
- HallucinationWhen an AI tool states something false or made up as if it were fact, such as a wrong figure, rule or citation.
- Large language modelThe type of AI model behind chat assistants: trained on huge amounts of text to predict and generate language.
- Prompt engineeringWriting and testing prompts so an AI tool gives consistent, useful output for a specific task.
Learn more
Last updated .