Cognitive biases and judgment · 4/6

Overconfidence: make certainty checkable

Record confidence and acceptance criteria before checking outcomes.

About 15–20 minutes. The following cases are fictional.

Record your first judgment

After watching a coding explanation, you feel 90% confident you can solve a similar task independently, but have not tried with the tutorial closed.

My initial judgment, confidence and reasons

Understand the judgment process

Familiarity with an explanation is not independent performance. Overconfidence can involve overestimating performance, relative standing or precision; these are different measures.

One confident failure does not diagnose a person. Calibration requires enough comparable judgments: do outcomes assigned about 80% eventually succeed about four times in five?

Forecasting research has studied training and feedback, but task-specific findings do not guarantee transfer everywhere. Start with inspectable records.

Checks you can perform

Define the prediction, deadline and success criteria.
Record probability or a range with reasons before seeing the outcome.
Attempt independently and preserve outcomes without rewriting earlier confidence.
Collect comparable records, inspect high and low confidence and task differences, then adjust.

Guided practice

You assign 80% success to ten similar small tasks; five meet predefined criteria. What provisional conclusion is justified?

My analysis and checking plan

Explore the explanation

Observed success is 50%, below the assigned 80%. Investigate overestimation and task comparability, but ten trials are limited. They neither precisely measure a stable personal bias nor make the next task exactly 50% likely. Keep records and examine failures.

Apply it in a new context

You feel sure about a presentation. How can you test readiness instead of repeatedly reading the slides?

My independent response

Compare after attempting

Set criteria such as explaining the central argument without notes, finishing on time and answering two key questions. Rehearse without a script, record gaps and practice. Sounding fluent alone does not satisfy all criteria.

Preserve a revision record

What changed your judgment? What still supports it? When will you review?

Underconfidence can also be miscalibrated. Match confidence to evidence rather than always reducing it.

Check whether you supplied inspectable evidence, a feasible next step and revision conditions. Revealing an answer is not mastery.

Source and scope

Mellers et al. (2016), Developing expert political judgment

The source provides conceptual or methodological background. Cases, steps and exercises are authored here; they are not the original experiment or evidence of this course’s effectiveness.

I have completed this section; uncheck to undo

Completion is a personal record, not proof of mastery or certification.