JUDGEMENT
Judgement in the AI Age
Judgement shows in how a leader arrives at a decision. How much they ask before they commit. How they read a situation. How close their conviction sits to what the evidence supports. Whether anyone still pushes back. All of this is visible in the process of deciding, long before any outcome is in.
Measure the quality of your judgement only by the outcome of decisions and you learn too late whether it carried far enough. By then the course is long set. Observe the behaviour instead, and it can be read earlier, while corrections can still change something. AI sharpens this challenge. It answers in seconds, in a tone that admits no doubt, and the window for asking narrows. Most of the time it also acts on what we ask of it straight away, with no critical questions and no feedback. What is missing is the exchange between equals, in which someone also questions critically or shares observations and feedback.
Judgement shows in how a leader arrives at a decision. How much they ask before they commit. How they read a situation. How close their conviction sits to what the evidence supports. Whether anyone still pushes back. All of this is visible in the process of deciding, long before any outcome is in.
Measure the quality of your judgement only by the outcome of decisions and you learn too late whether it carried far enough. By then the course is long set. Observe the behaviour instead, and it can be read earlier, while corrections can still change something. AI sharpens this challenge. It answers in seconds, in a tone that admits no doubt, and the window for asking narrows. Most of the time it also acts on what we ask of it straight away, with no critical questions and no feedback. What is missing is the exchange between equals, in which someone also questions critically or shares observations and feedback.
Judgement shows in how a leader arrives at a decision. How much they ask before they commit. How they read a situation. How close their conviction sits to what the evidence supports. Whether anyone still pushes back. All of this is visible in the process of deciding, long before any outcome is in.
Measure the quality of your judgement only by the outcome of decisions and you learn too late whether it carried far enough. By then the course is long set. Observe the behaviour instead, and it can be read earlier, while corrections can still change something. AI sharpens this challenge. It answers in seconds, in a tone that admits no doubt, and the window for asking narrows. Most of the time it also acts on what we ask of it straight away, with no critical questions and no feedback. What is missing is the exchange between equals, in which someone also questions critically or shares observations and feedback.
Die Qualität einer Entscheidung entscheidet sich, bevor ihr Ergebnis feststeht.
Warum Entscheidungsqualität heute zählt
Experience is no safeguard against overconfidence
With the years, confidence in one's judgement grows; accuracy does not keep pace. In the Duke CFO series by Ben-David, Graham and Harvey, executives' 80% confidence intervals held in only about 36% of cases. Confidence was high, accuracy markedly lower, and from the inside the gap was impossible to feel.
The bias does not work the same in every direction. Overconfidence drives the exploration of the new and at the same time undermines the steady investment; its damage can be contained by internal control and external oversight.
The data come from large US corporations and their financial context. Whether they carry over to Swiss SMEs and family firms is plausible but not established, and that limit stays visible here, much as the manufacturing limit of the Census study does next door.
The finding has been around for a long time; what is new is only what AI does with it. It delivers self-assured recommendations in seconds and leaves barely any time to test or to stop them, precisely where the most depends on it.
With the years, confidence in one's judgement grows; accuracy does not keep pace. In the Duke CFO series by Ben-David, Graham and Harvey, executives' 80% confidence intervals held in only about 36% of cases. Confidence was high, accuracy markedly lower, and from the inside the gap was impossible to feel.
The bias does not work the same in every direction. Overconfidence drives the exploration of the new and at the same time undermines the steady investment; its damage can be contained by internal control and external oversight.
The data come from large US corporations and their financial context. Whether they carry over to Swiss SMEs and family firms is plausible but not established, and that limit stays visible here, much as the manufacturing limit of the Census study does next door.
The finding has been around for a long time; what is new is only what AI does with it. It delivers self-assured recommendations in seconds and leaves barely any time to test or to stop them, precisely where the most depends on it.
With the years, confidence in one's judgement grows; accuracy does not keep pace. In the Duke CFO series by Ben-David, Graham and Harvey, executives' 80% confidence intervals held in only about 36% of cases. Confidence was high, accuracy markedly lower, and from the inside the gap was impossible to feel.
The bias does not work the same in every direction. Overconfidence drives the exploration of the new and at the same time undermines the steady investment; its damage can be contained by internal control and external oversight.
The data come from large US corporations and their financial context. Whether they carry over to Swiss SMEs and family firms is plausible but not established, and that limit stays visible here, much as the manufacturing limit of the Census study does next door.
The finding has been around for a long time; what is new is only what AI does with it. It delivers self-assured recommendations in seconds and leaves barely any time to test or to stop them, precisely where the most depends on it.
.png)
Erwartete gegen gemessene Streuung im Urteil. Zwei Underwriter wichen für denselben Fall im Median um rund 55 Prozent voneinander ab, fünfmal so viel wie die erwarteten 10 Prozent. Quelle: Kahneman, Sibony, Sunstein, Noise (2021).
EVIDENCE
What research shows about forming judgement
More can be said about effective judgement than its public treatment suggests. Three studies, each of a different weight, fit together.
More can be said about effective judgement than its public treatment suggests. Three studies, each of a different weight, fit together.
More can be said about effective judgement than its public treatment suggests. Three studies, each of a different weight, fit together.
What improves decisions is justification-bound counter-argument from outside. Time delay and pure reflection remain without measurable effect in pre-registered experiments, while a duty to justify and adversarial questioning work.
.png)
Erwartete gegen gemessene Streuung im Urteil. Zwei Underwriter wichen für denselben Fall im Median um rund 55 Prozent voneinander ab, fünfmal so viel wie die erwarteten 10 Prozent. Quelle: Kahneman, Sibony, Sunstein, Noise (2021).
THE LISTENING GRID
Judgement quality, before the outcome confirms it
Judgement shows in behaviour. So it has to be readable in conversation, while the decision is still forming. That is what the listening grid is for: four traces along which an external instance hears the quality of judgement, without the leader having to examine themselves.
Möglichkeitsraum
Vor der Entscheidung
Bevor eine strategische Weiche gestellt wird, trennen wir die Optionen, die über alle plausiblen Zukünfte tragen, von den Wetten, die nur in einem bestimmten Szenario aufgehen. Das Führungsteam sieht, welche Züge robust sind und welche an Bedingungen hängen, die erst noch eintreten müssen. So fällt die Entscheidung mit offenem Blick auf ihre Abhängigkeiten, nicht auf ein einzelnes erhofftes Szenario.
Urteilsraum
Im Urteil selbst
Wer im eigenen Kopf abwägt, findet immer nur die eigenen Ideen und meist nur die eigene Bestätigung oder die eigenen Zweifel. Ein Gremium, ein Team oder ein unabhängiges Gegenüber, das zuverlässig widerspricht, verändern das. Sparring setzt hier an, im konkreten Moment vor einer Sitzung, einer Zusage, einer Kommunikation. Wo eine Führungssituation über Monate Entwicklung verlangt, trägt Executive Coaching die Urteilsbildung der Person, die entscheidet.
Beurteilungsraum
Nach der Entscheidung
Eine Entscheidung fällt zu einem Zeitpunkt, die Welt bewegt sich weiter. Deshalb binden wir eine strategische Wette an eine beobachtbare Frühwarngrösse mit vorab festgelegter Schwelle und vorab beschlossener Reaktion. Aus der Einmalentscheidung wird ein überwachter Pfad: Das Führungsteam erkennt früh genug, dass eine Annahme zu kippen beginnt, um noch zu handeln.
Die drei Momente sind die Ordnung, in der transformind Entscheidungsqualität liest. Die zugrunde liegenden Disziplinen sind etabliert; ihre Verbindung zu einer durchgehenden Sicht auf den Entscheidungsprozess ist die Perspektive von transformind. Wie reif ein Führungssystem in diesen drei Momenten ist, liest der Ambiflow Diagnose- und Steuerungsrahmen als eigene Dimension, die Führungssystem-Reife.
THE METHODOLOGICAL GROUNDING
The scientific foundation of the listening grid
The four traces are not chosen at random. They rest on three traditions of thought that interlock: from how judgement deceives itself, through how it is corrected, to why the correction has to come from outside.
Entscheidungsanalyse · Der Massstab vor dem Ergebnis
The four traces are not chosen at random. They rest on three traditions of thought that interlock: from how judgement deceives itself, through how it is corrected, to why the correction has to come from outside.
Debiasing · Streuung und Gegenrede
The four traces are not chosen at random. They rest on three traditions of thought that interlock: from how judgement deceives itself, through how it is corrected, to why the correction has to come from outside.
Systemtheorie der Entscheidung · Die Organisation als Entscheidungssystem
The four traces are not chosen at random. They rest on three traditions of thought that interlock: from how judgement deceives itself, through how it is corrected, to why the correction has to come from outside.
ANWENDUNG IN DER FÜHRUNGSPRAXIS
Behavioural Decision Research · Calibration
From Kahneman and Tversky to Ben-David, Graham and Harvey, the evidence shows that confidence and accuracy diverge systematically, and that the gap stays invisible from within. This is the trace of calibration.
From Kahneman and Tversky to Ben-David, Graham and Harvey, the evidence shows that confidence and accuracy diverge systematically, and that the gap stays invisible from within. This is the trace of calibration.
From Kahneman and Tversky to Ben-David, Graham and Harvey, the evidence shows that confidence and accuracy diverge systematically, and that the gap stays invisible from within. This is the trace of calibration.
From Kahneman and Tversky to Ben-David, Graham and Harvey, the evidence shows that confidence and accuracy diverge systematically, and that the gap stays invisible from within. This is the trace of calibration.
From Kahneman and Tversky to Ben-David, Graham and Harvey, the evidence shows that confidence and accuracy diverge systematically, and that the gap stays invisible from within. This is the trace of calibration.