FLUENT Portal · When AI Misbehaves

AI can lie to you.
Here’s what to do about it.

Hallucinations are real, they happen often, and they’re not going away. But they’re also predictable, detectable, and preventable — once you know what to look for.

AI makes confident errors regularly Most users can’t tell when it’s happening There are 5 reliable warning signals
What you’re dealing with

What is an AI hallucination?

The term is borrowed from psychology, and it fits: AI produces confident, fluent output that describes things that don’t exist.

What’s actually happening

AI language models don’t “know” things the way a human does. They generate statistically likely sequences of words based on patterns in training data. When asked about something outside its confident knowledge, the model produces text that sounds right — because sounding right is what it’s optimized to do.

Why it’s a problem

The issue isn’t that AI is wrong. It’s that AI is confidently wrong. Hallucinated information is delivered in the same fluent, professional tone as accurate information. If you’re not watching for it, you’ll copy it into your document, your email, your presentation — and not realize until it’s too late.

“AI is like an extremely confident intern who hasn’t admitted they don’t know something since their first day. They’ll give you a very specific answer. Always verify the specifics.

The rule of thumb: use AI for structure, strategy, and drafting. Verify every specific fact independently.
Know the enemy

The 6 most common hallucination types

Each type has different tells. Learn to recognize them and you’ll catch most errors before they matter.

01

Fake citations

AI fabricates books, papers, articles, and URLs that look real but don’t exist. Often includes plausible author names and publication dates.

Ask Claude to cite sources and it may produce a perfectly formatted APA citation for a study that was never conducted.
02

Wrong statistics

Real statistics, wrong numbers. AI knows a statistic exists but misremembers the value — often presenting it with precise decimal points that add false authority.

“According to Gallup, 74.3% of employees…” The percentage may be completely invented, even if the Gallup study is real.
03

Confabulated details

Real person or company, invented details. AI mixes accurate information with plausible-sounding specifics that were never true.

Asking about a real company’s founding story may produce the correct founder’s name with a completely invented founding year and location.
04

Outdated as current

Information that was accurate at training cutoff, presented as if it’s still true today. Pricing, leadership, policies, and regulations are especially prone.

“The current CEO of [company] is [name]” — accurate as of 2023, wrong today.
05

Wrong attributions

Real quote, wrong person. Or real person, invented quote. AI assigns famous sayings to the wrong speaker, or invents quotes and attributes them to real people.

“As Einstein said, 'The definition of insanity is doing the same thing over and over…’” — he never said it.
06

Plausible nonsense

Answers to questions AI doesn’t know the answer to, delivered as if it does. Most common with niche topics, recent events, or very specific technical questions.

Ask about a specific local law or your industry’s niche regulation and AI may produce confident, detailed, completely invented guidance.
Know your risk level

The hallucination risk meter

Not all tasks carry the same risk. The safest uses of AI are where you already know the domain and can spot errors. The riskiest are where you’re depending on AI for specific facts you can’t easily verify.

Hallucination risk by task type

Green = safe to use AI output directly. Red = always verify before using.

Test yourself

Spot the hallucination.

Four AI responses. Some are accurate. Some contain hallucinations. Can you tell the difference?

Is this real or hallucinated?

Question 1 of 4
The detection signals

5 signals that something might be wrong.

You can’t verify everything. But you can train yourself to notice when the alarm bells should ring.

1
Very specific numbers, dates, or namesThe more precise the claim, the more it needs to be verified. “73.6%” is a red flag. “Founded in April 2018 in Austin, Texas” is a red flag. Precision is often where hallucinations hide.
2
Citations and source referencesAlways check that a cited source actually exists before including it anywhere. Google the title, check the journal, verify the URL. Fabricated citations are one of the most common hallucinations.
3
Information about recent events or current stateAI has a knowledge cutoff. Anything about “current” pricing, leadership, laws, regulations, or events after the training cutoff should be verified through a current source.
4
Surprising claims you’d love to be trueIf AI tells you something surprisingly helpful — a statistic that perfectly supports your argument, a regulation that conveniently doesn’t apply to you — be especially skeptical. Confirmation bias makes us less likely to verify things we want to be true.
5
Topics at the edge of AI’s knowledgeNiche regulations, local laws, specialized technical standards, small companies, obscure historical events — anywhere AI’s training data was thin, hallucinations are more likely. The more specific and niche your question, the more carefully you verify.
The fix

The 4-step verification system.

You don’t need to verify everything. You need to verify the right things. These four habits catch 90% of consequential hallucinations.

1

Ask AI to flag its own uncertainty

Most AI tools will tell you when they’re less confident — if you ask. Adding this to your prompts surfaces uncertainty you’d otherwise miss.

Add to any prompt: “Where are you uncertain? Flag any claims I should independently verify before using this.”
2

Ground AI with your own documents

The best way to prevent hallucinations is to give AI the source material directly. When AI works from documents you provide, it can’t invent facts that aren’t in the source.

“Based only on this document: [paste]. Do not use any information not contained in it.”
3

Use a two-source rule for specifics

Any specific fact that matters — a statistic, a date, a person’s role, a law — should be confirmed in at least one non-AI source before you use it. This doesn’t have to be slow; it usually takes 30 seconds.

Quick check: paste the specific claim into Google News or Scholar. If the claim can’t be found independently, it may not be real.
4

Ask AI to challenge its own output

After AI produces content, ask it to critique what it just wrote. This doesn’t catch everything, but it often surfaces obvious errors that didn’t appear in the first pass.

“You just wrote this: [paste]. What in this output are you least confident about? What should I verify?”
The golden rule of AI output:
Trust the structure. Verify the specifics.

AI is excellent at giving you the right shape of a thing — the right sections, the right tone, the right structure. The specific facts, statistics, names, and dates inside that structure need to come from you, or be verified by you.

Safe to use directly
Structure · Tone · Flow
Frameworks · Templates
Editing · Brainstorming
Summarizing your own docs
Always verify
Statistics · Citations · Dates
Prices · Laws · Regulations
People’s roles · Quotes
Current events · Specific facts
Your Portal

Keep exploring. Keep building.

Course progress
Loading…