Before You Commit: 10 Conversations About Better Decisions, Uncertainty and Testing What You Think You Know

Why C.I.S. selected it

Annie Duke separates the quality of a decision from the outcome it happens to produce. Luck can reward weak reasoning and punish strong reasoning, which means an idea cannot be evaluated responsibly by asking only whether something worked. This conversation establishes the collection’s central discipline: examine the process, the assumptions and the information available at the time.

Listen for

• the difference between decision quality and outcome quality
• how uncertainty changes the meaning of being right or wrong
• why constructive challenge improves judgement
• when quitting can be an intelligent decision rather than a failure of commitment

C.I.S. reflection

Which decision are you judging only by its outcome—and what would change if you examined the quality of the thinking instead?

Why C.I.S. selected it

Gary Klein studies how people make consequential decisions in real environments rather than idealised laboratory conditions. The conversation examines skilled intuition, mental simulation, tacit knowledge and the risk of outsourcing judgement to AI before people have developed the experience required to recognise when an answer does not fit the situation.

Listen for

• the difference between information and expertise
• when intuition is useful and when it should be questioned
• how pattern recognition develops through experience
• what may be lost when decision-making is delegated too early to AI

C.I.S. reflection

Where are you asking technology to replace judgement that the organisation has not yet learned how to exercise?

Why C.I.S. selected it

Tricia Wang explains why quantitative information can miss the human context that gives behaviour meaning. Her idea of thick data is especially relevant when an organisation possesses dashboards, forecasts or survey results but has not spent enough time with customers, non-customers and the situations in which the problem is actually experienced.

Listen for

• what qualitative evidence can reveal that numbers cannot
• how quantification bias narrows organisational attention
• why data teams need contact with customers and lived reality
• how outliers can expose a change the dominant pattern conceals

C.I.S. reflection

Whose experience is absent from the evidence currently supporting the idea?

Why C.I.S. selected it

Stefan Thomke shows how disciplined experiments can replace confident speculation with evidence. The value is not confined to companies with enormous volumes of digital data. Smaller organisations can also design proportionate tests that reveal whether an assumption deserves further investment.

Listen for

• the difference between experimentation and informal trial and error
• how to create a test that can genuinely change a decision
• why leaders often prefer intuition even when experiments are possible
• how an experimental culture turns evidence into strategy

C.I.S. reflection

What is the smallest credible experiment that could change what you decide to do next?

Why C.I.S. selected it

Amy Edmondson resists the idea that every failure deserves celebration. She distinguishes intelligent failure in new territory from preventable failure caused by inattention, poor practice or weak preparation. That distinction matters when organisations use experimentation language to excuse avoidable harm or careless execution.

Listen for

• the difference between intelligent, basic and complex failure
• why useful experiments should be as small as possible
• how psychological safety supports honest learning
• which failures should be prevented rather than romanticised

C.I.S. reflection

If the next test fails, will it produce valuable knowledge—or merely reveal that the test was poorly designed?

Why C.I.S. selected it

Philip Tetlock explores forecasting as a learnable discipline rather than a talent possessed by a small group of confident experts. The conversation offers practical ways to begin with wider evidence, express uncertainty as probability and update a judgement when new information arrives.

Listen for

• the habits associated with more accurate forecasting
• starting with the outside view before moving inward
• how open-mindedness improves predictions
• why forecasts should be updated rather than defended

C.I.S. reflection

Which prediction is carrying the idea forward as though it were a fact—and what probability would you honestly assign to it?

Why C.I.S. selected it

Michael Luca and Amy Edmondson explain why possessing data is not the same as using it intelligently. Leaders can treat analysis as infallible or dismiss it because the organisation feels exceptional. Better decisions require understanding where the data came from, what question it can answer and how its limitations should shape the conversation.

Listen for

• how internal and external evidence answer different questions
• the danger of both over-reliance and under-reliance on data
• why interpretation is an organisational and cultural practice
• how to connect a finding to the actual decision at hand

C.I.S. reflection

Does the evidence answer the question you need to decide—or only a nearby question that is easier to measure?

Why C.I.S. selected it

Klein examines the difference between accumulating experience and developing expertise. The conversation covers mental models, anomalies, cognitive flexibility, storytelling, team decisions and PreMortems—tools that help people notice when the familiar pattern no longer explains the situation in front of them.

Listen for

• why years of experience do not automatically produce expertise
• how anomalies can trigger useful insight
• the role of stories and mental models in judgement
• how cognitive flexibility keeps routines from becoming traps

C.I.S. reflection

What evidence would have to appear tomorrow for you to change your mind about this idea?

Why C.I.S. selected it

This conversation applies probabilistic thinking to organisational innovation. It considers forecasting, backcasting, consensus, transparency, regret and PreMortems while making an important point: refusing to decide also creates a set of possible futures. Delay is not neutral.

Listen for

• how teams can communicate uncertainty without appearing indecisive
• why consensus can conceal important disagreement
• the value of forecasting and backcasting
• the risks created by action and by inaction

C.I.S. reflection

What are you risking by proceeding—and what might you also be risking by waiting?

Why C.I.S. selected it

The collection ends with a practical method for surfacing risks before commitment. Klein explains how imagining that a plan has already failed can make threats discussable, particularly when optimism, status or group dynamics would otherwise suppress them. The exercise reverses the usual question from ‘How do we make this succeed?’ to ‘It failed. Why?’

Listen for

• how to run a PreMortem before implementation
• the difference between prediction and structured imagination
• why permission to name failure changes team conversations
• how anticipated threats can become decisions, safeguards and tests

C.I.S. reflection

What becomes easier to say once everyone has permission to imagine that the idea failed?