Tribute to Daniel Kahneman: Insights and Memories from Superforecasters

Tribute to Daniel Kahneman: Insights and Memories from Superforecasters

 



“Superforecasters are better than others at finding relevant information—possibly because they are smarter, more motivated, and more experienced at making these kinds of forecasts… Superforecasters are less noisy than…even trained teams.”

—Kahneman, Sibony, & Sunstein, in Noise: A Flaw in Human Judgment

“For as long as I have been running forecasting tournaments, I have been talking with Daniel Kahneman about my work. For that, I have been supremely fortunate. … Talking to Kahneman can be a Socratic experience: energizing as long as you don’t hunker down into a defensive crouch. So in the summer of 2014, when it was clear that superforecasters were not merely superlucky, Kahneman cut to the chase: ‘Do you see them as different kinds of people, or as people who do different kinds of things?’ My answer was, ‘A bit of both.’”

—Phil Tetlock in Superforecasting: The Art and Science of Prediction


 

Daniel Kahneman, Nobel Prize winner and a friend of Good Judgment, died aged 90 on 27 March 2024. He was a true pioneer in the realms of judgment, decision-making, and the psychological underpinnings that affect our forecasting work. Beyond his monumental contributions to psychology and economics, Kahneman took a keen interest in the art and science of Superforecasting, discussing Superforecasters in his last published book Noise and gracing us with his presence at a Good Judgment workshop. In this tribute to Daniel Kahneman, Superforecasters share insights and memories on how his work influenced and enriched them.

Superforecaster Dan Mayland:

The best tribute I can give is to share a photo of my copy of Thinking, Fast and Slow, which I read around the same time I started forecasting. I have this (slightly!) obsessive habit of affixing small Post-It notes to book passages that I think are particularly insightful and don’t want to lose track of once I turn the page. (Even though, the mind being what it is, I do.) It’s my version of taking pictures of sunsets in an attempt to preserve the memory. The photo below speaks to the level of insight I thought Kahneman had to offer.

 

Co-founder and CEO Emeritus of Good Judgment Inc, Terry Murray:

In the early days of Good Judgment Inc, I had the privilege of being in an extended conversation that included our co-founders Phil Tetlock and Barb Mellers along with Danny Kahneman and a couple of his colleagues. I expected Danny to have great questions and insights on the substantive side of our forecasting work because of his own research interests and his past interest in the Good Judgment Project itself. What surprised me most at the time was that Danny’s questions about the business side of our fledgling company were among the best questions anyone had ever posed to me.

Looking back now, I shouldn’t have been surprised. The handful of opportunities I had to interact directly with Danny all confirmed what his writings on judgment and decision-making tell us: Danny was a master at cutting to the chase. Whatever the topic under discussion, he would quickly filter out the noise and hone in on the signal. If I could create the ideal AI personal assistant, it would be one that would pose Danny-like questions to challenge me until I too filtered out the noise and focused on what is most important. I’d like to think that Danny would approve.

Superforecaster and CEO of Good Judgment Inc, Warren Hatch:

A while back, we ran a “Noise Challenge” on Good Judgment Open that was inspired by the launch of the book Daniel Kahneman co-wrote. He generously agreed to sign copies that we could present to the top performers at the end of the competition. So I went by his house to meet him in the lobby. I figured it would take five minutes of his time tops. Instead, we sat down and spent the better part of an hour going over some of the questions then posed to the Superforecasters. It was a masterclass.

Superforecaster Giovanni Ciriani:

I read Thinking, Fast and Slow in early 2013; on 21 March 2013, David Brooks wrote the NY Times column “Forecasting Fox,” which was centered on Tetlock and the Good Judgment Project. It credited Kahneman’s Thinking, Fast and Slow as training material. I read the column uniquely because the book was mentioned. On 22 March 2013, I signed up for the GJP. Of course, one could play counterfactuals, to see which factor was more important in my joining, but I see Kahneman’s as the sine qua non, the condition without which it would not have happened.

Superforecaster and GJ Director Ryan Adler:

I will ashamedly confess that my knowledge of Danny Kahneman’s work was limited before I found myself in the Good Judgment Project, but immersing myself in it was and is an absolute pleasure. To borrow some phrasing from Robert Heinlein, Kahneman and Tversky studied what man is, not what they wanted him to be, and it is saddening to know that there will be less of that kind of thinking with his passing.

Superforecaster Vijay Karthik:

I have learnt a lot by reading articles regarding him and through his book. Life has become a lot more enriched trying to put his recommendations into action, to the best extent possible.

Superforecaster David Fisher:

I remember listening to him on a podcast. He was pessimistic that information alone could change opinions about global warming. He said only if someone identified with the person giving the information were they likely to consider it. I have read Thinking, Fast and Slow and most of Noise and have nothing but respect. Decisions only made because of someone’s economic interests? He disproved that. Deserved the Nobel.

Superforecaster Dwight Smith:

His influence on my life has been tremendous. It was through his work that I became a far better forecaster. And that has led to a multitude of adventures and good works. To be so profoundly influenced by such a great mind even once in a lifetime is quite a gift.

Looking Back at 2023: Good Judgment’s Year of Impact and Innovation

Looking Back at 2023: Good Judgment’s Year of Impact and Innovation

As we start another year at Good Judgment, it’s time to reflect on our achievements in 2023 and the journey ahead for 2024. The past year was a testament to our continued commitment to excellence in forecasting.

Superforecasters’ Track Record and Updates to FutureFirst™

In finance, our Superforecasters outperformed the CME FedWatch Tool by a staggering 66%. They also anticipated the June inflection point in US Federal Reserve policy notably earlier than the futures markets. This success was reported by the New York Times and Financial Times.

Our FutureFirst service expanded in 2023, offering direct subscriptions and specialized forecast channels, including “Superforecasting the Middle East” and “Superforecasting Ukraine.” With daily updates, API access, and dozens of Superforecasts on top-of-mind questions, it’s a comprehensive tool for the future-conscious decision-maker.

Forecasting Services and GJ Open Challenges

We actively engaged with our clients, enabling them to pose 79 new questions to the Superforecasters in 2023. We also launched exciting new challenges on our public forecasting platform, Good Judgment Open, complete with 475 new forecasting questions! Partnerships with industry giants and educational institutions like Harvard Kennedy School have been pivotal in broadening our reach and offered organizations a unique way to spot in-house talent, train interns, and identify trends.

Training Services

Our workshops and the Forecasting Aptitude Screening Tool (FAST) have empowered organizations to refine their forecasting skills and assess their team’s capabilities. An analysis of workshop outcomes released by our data science team showed marked improvement in forecasting accuracy for workshop participants.

Other Highlights

Notable Mentions of Superforecasters in the Media in 2023

We’re excited to continue this journey in 2024 and invite you to stay connected through our newsletter. Cheers to a new year filled with insightful forecasts and strategic growth for our partners!

Superforecasters vs FT Readers: Results of an Informal Contest in the Financial Times

Superforecasters vs FT Readers: Results of an Informal Contest in the Financial Times

In early 2023, the Financial Times launched an informal contest that pitted the predictive prowess of the FT’s readership against that of Good Judgment’s Superforecasters. The contest involved forecasting key developments in the year ahead, ranging from geopolitical events to economic indicators to heat waves to sport. The results? Illuminating.

“To help illustrate what makes a superforecaster worthy of the name, the FT asked both readers and Good Judgment superforecasters to make predictions on ten questions early this year, spanning from GDP growth rates to viewership of the Fifa women’s world cup final,” Joanna S Kao and Eade Hemingway explain in their article.

A total of 95 Superforecasters made forecasts on the questions, while the reader poll had about 8,500 respondents.

The Results

Nine of the ten questions have now been scored. On a scale where 0.5 equals guessing and 1 equals perfect prediction, Superforecasters scored an average of 0.91 over nine questions, significantly outperforming FT readers who scored 0.73.

In this informal contest, the Superforecasters continued to work on the questions throughout the year, while the reader poll closed early. Based on everyone’s initial forecasts as of 2 February 2023, however, the Superforecasters outperformed the general crowd on eight out of nine questions.

Key to Forecasting Success

Key to the Superforecasters’ success, as the article notes, is their methodology. They focus on gathering comprehensive information, minimizing biases, and reducing the influence of irrelevant factors that only create noise. This methodological rigor stems from the foundational work of Philip Tetlock, a pioneer in the study of expert predictions and co-founder of Good Judgment Inc.

Read the full article in the FT for a fascinating glimpse into the realm of Superforecasting.

To benefit from Superforecasters’ insights on dozens of top-of-mind questions with probabilities that are updated daily, learn more about our forecast monitoring service, FutureFirst.

 



Ready to Elevate Your Forecasting Game in 2024?
Embrace the Future with Our Exclusive End-of-Year Offer!

As we approach the end of another dynamic year, it’s time to think ahead. Are you looking to empower your team’s professional development in 2024? Look no further. Our renowned Superforecasting® Public Workshop will help you make your forecasting more precise than ever.

Join Our January 2024 Public Workshop – Unleash the Power of Accurate Forecasts!

➡️ What to Expect in the Superforecasting Workshop?

  • Advanced Techniques: Dive into the latest forecasting methodologies.
  • Expert Insights: Learn directly from top forecasters and researchers.
  • Interactive Sessions: Engage in hands-on exercises for practical learning.

 

📈 Special Limited-Time Offer:
Claim your 20% discount on the January Public Workshop (16 & 18 January 2024). Use code GJ20XMS at registration. Hurry, offer valid while seats last!

Stop Guessing, Start Superforecasting with Good Judgment’s Superforecasting® Workshop. Register here.