Why AI "hallucinates" (and how to avoid it)
AI assistants sometimes invent facts with confidence. Understanding why, and adopting the right reflexes so you don't take them at their word.
Updated on
You ask an AI assistant for a reference. It cites a book, an author, a precise page. It all looks credible. Except none of it exists. Welcome to the world of hallucinations — one of the 10 key words of generative AI to know.
What “hallucinating” means
A hallucination is a false answer stated with the same confidence as a correct one. The model does not lie in the human sense: it is not aware of being wrong. It produces what most resembles a good answer.
Why it happens
A language model does not consult a database of truths. It predicts, word after word, the most plausible continuation of a text, from learned regularities. This is the very way a model works, which we break down in what an LLM is, explained simply. Most of the time, plausible and true coincide. Sometimes not: the model “fills the gaps” with something believable but inaccurate.
Hallucinations are therefore more frequent when:
- the question concerns a precise, rare or recent fact;
- you ask for a source, a figure, an exact quotation;
- the topic is niche and poorly represented in the training data.
The reflexes that protect you
You cannot eliminate hallucinations, but you can greatly reduce the risk of being caught out.
Ask for sources, then check them. Do not settle for their apparent existence: open the link. An invented source does not survive a click.
Give the context instead of asking for it. If you provide the document, the model relies on it rather than on its memory. “Summarise this text” is safer than “what does the law say about…”.
Allow doubt. Add “if you’re not sure, say so.” A model allowed to answer “I don’t know” invents less.
Cross-check what matters. For a figure, a date, a legal or medical reference, a second human source remains indispensable.
The right stance
Treat the assistant like a brilliant intern who is sometimes too sure of themselves: excellent for a first pass, never for validating alone what carries real stakes. Used this way, it saves real time. Taken at its word, it exposes you to costly mistakes.
Sources
Frequently asked questions
What is an AI hallucination?
It is a false answer stated with the same confidence as a correct one. The model does not lie in the human sense: it simply produces what most resembles a good answer.
Can you completely stop an AI from hallucinating?
No. You cannot remove hallucinations, but you sharply reduce the risk of being fooled by asking for sources, providing context, allowing doubt and cross-checking what matters.
When is the risk of hallucination highest?
When the question concerns a precise, rare or recent fact, when you ask for a source, a figure or an exact quotation, and when the topic is niche and poorly represented in the training data.
How can you reduce the risk in practice?
Ask for sources and open the links, provide the document rather than relying on the model's memory, add an instruction like 'if you are not sure, say so', and cross-check any sensitive figure, date or reference with a second human source.