Concept dictionary
Confidence vs. Correctness
Confidence is the strength or certainty expressed with an answer. Correctness is whether the answer is supported by the relevant evidence and matches the facts or requirements. One does not establish the other.
- Review state
- Reviewed in POC
- Freshness
- Current
- Version
- 1
Also called
- confidence-vs-correctness
Remember it this wayCertainty is a signal, not a verdict.
In plain language
An answer can sound certain and be wrong. It can also be cautious and correct. Confidence is a signal to examine, while correctness is a conclusion that requires evidence.
Why it matters
Fluent AI responses can make confidence easy to mistake for knowledge. Separating the two helps people verify important claims, resist persuasive wording, and decide when uncertainty should change how they act.
Example
An assistant confidently states that a company policy permits a particular data use. The policy document says otherwise. The answer's tone was confident; its content was incorrect.
Common misconception
Low confidence does not prove an answer is wrong, and high confidence does not prove it is right. Calibration is a related measurement concept: it asks whether confidence levels match correctness rates across many comparable cases.
Related terms
Sources
- Chuan Guo and colleagues, “On Calibration of Modern Neural Networks”empirical confidence and accuracy are related but distinct properties.
- NIST, “AI RMF Core: Measure”uncertainty, benchmarks, testing, and documented evaluation as parts of reliable AI assessment.