Good Judgment’s 2024 in Review

Good Judgment’s 2024 in Review

Superforecasters always keep score. As we turn the page to 2025 at Good Judgment Inc, we look back at 2024 for highlights, statistics, and key developments.

What a year it was! From monetary policy shifts to volatile election outcomes, our Superforecasters tackled some of the most complex forecasting questions to date. Good Judgment’s clients and FutureFirst™ subscribers posed 151 questions to the Superforecasters on our proprietary platform, with a total of 1,132 forecasting questions live in 2024 across our platforms, including on GJ Open, our public forecasting site.

Forecasting Highlights

Good Judgment’s Superforecasters continued to outperform financial markets in 2024. This caught the eye of, among others, Financial Times reporters.

“A group of lay people with a talent for forecasting have consistently outperformed financial markets in predicting the Fed’s next move,” wrote data journalist Joel Suss for FT’s Monetary Policy Radar in July 2024. For the year as a whole, the Superforecasters outperformed the futures markets by 22%.

Our partnership with ForgeFront and the UK Government’s Futures Procurement Network continued to grow in 2024. In November, Good Judgment’s CEO Dr. Warren Hatch spoke remotely at the Department for Environment, Food and Rural Affairs (DEFRA) Futures Trend Briefing, discussing the role of Superforecasting in supporting the UK’s Biological Security Strategy.

We also saw an increased interest in subscriptions to specialized forecast channels on FutureFirst, including the “Superforecasting the Middle East” and “Superforecasting US Politics” channels. Individual FutureFirst channels provide access to a range of forecasting questions grouped by theme or topical focus and, like the all-inclusive subscription option, come with daily forecast updates and API access.

Media and Research

Throughout the past year, Good Judgment continued partnering with leading media organizations. Notably, The Economist once again featured our Superforecasters’ outlook in “The World Ahead 2025.” The focus for this year was on US tariffs, elections in Germany, Canada, and Australia, China’s inflation, and the Russia-Ukraine conflict. Our Superforecasters were also referenced in The New York Times, Wired, and Vox, among other media outlets. (See our Press page for the full list.)

Our research partners at the Forecasting Research Institute continued exploring the applications of Superforecasting in approaching key questions, from AI forecasting capabilities to nuclear risk. The institute’s ForecastBench, released on 1 October 2024, revealed that the top-performing large language models (LLMs) lagged behind Superforecasters by 19%. (See our Science of Superforecasting page for all relevant scientific publications.)

Private and Public Challenges on GJ Open

GJ Open continued partnering with media, businesses, and educational institutions to host public and private forecasting challenges on their behalf. Our public challenges included those from UBS Asset Management Investments, Man Group, Fujitsu, City University of Hong Kong, Harvard Kennedy School, and The Economist. We also hosted private challenges for our partners to help them identify in-house forecasting talent and train interns and staff in probabilistic thinking and accountable decision-making. We supplied the tools, a secure platform, data analysis, and Superforecasters’ feedback.

Training

As we continued to provide forecasting training to professional teams and individuals, we saw an increase in virtual as well as in-person workshops, seminars, and presentations, which were conducted for hundreds of individuals in dozens of government, non-profit, and private-sector organizations across the United States and abroad, including in the UK, the Netherlands, and Turkey.

We’re excited to continue this journey in 2025 and wish everyone a Happy New Year. May it be a year of thoughtful forecasts and better decisions!

Superforecasting Explained in Podcasts and Videos

Superforecasting® Explained in Podcasts and Videos

Superforecasting is a disciplined approach to forecasting that uses probabilistic thinking, continuous updating, and rigorous calibration to make well-informed judgments about future events. This approach is based on decades of research spearheaded by Dr. Philip Tetlock into what traits and tools make some people remarkably good at forecasting while others, including many experts, fall short. Since IARPA’s massive forecasting tournament of 2011-2015, Superforecasting has been proven to outperform traditional forecasting methods in many areas, including finance and policy decision-making (e.g., see our forecasting report on the early trajectory of Covid-19). Below, we’ve curated our favourite podcasts and videos that showcase the principles and real-world applications of Superforecasting.

Top 5 Podcasts and Videos

1. BBC Reel: Can You Learn to Predict the Future? (8:21)
This short video from BBC Reel introduces the concept of Superforecasting in an engaging and visual way. It explores the techniques that make accurate forecasting possible and discusses how anyone can improve their forecasting skills.

2. Quid Explore: Superforecasting with Dr. Warren Hatch (22:32)
In this detailed conversation, Dr. Warren Hatch, Superforecaster and CEO of Good Judgment Inc, explains the science behind Superforecasting. He discusses the traits of successful forecasters and shares practical tips for applying these skills in professional and personal decision-making.

3. More or Less: Superforecasting the Coronavirus (08:57)
Tim Harford talks to Terry Murray, GJ co-founder and project manager for the original Good Judgment Project (GJP), about how GJ Superforecasters tackled the uncertainties of the Covid-19 pandemic. This episode highlights how their methods and tools can be applied to making sense of real-world crises.

4. Talking Politics: David Spiegelhalter on Superforecasting (48:55)
Tim Harford talks to Terry Murray, GJ co-founder and project manager for the original Good Judgment Project (GJP), about how GJ Superforecasters tackled the uncertainties of the Covid-19 pandemic. This episode highlights how their methods and tools can be applied to making sense of real-world crises.

5. MarketWatch: Can an Ice Storm Predict the Next Meme Stocks? (25:38)
This podcast explores the intersection of forecasting and finance, showcasing how Superforecasting can shed light on trends in the stock market. In this episode, Dr. Hatch defines “prediction” vs “forecast,” describes the innate characteristics that make some people better at forecasting high-stakes world and financial events, and explains how anybody, whether they possess those innate characteristics or not, can get better at forecasting with practice.

Take a Deeper Dive: Edge Master Class on Superforecasting

For those seeking a more in-depth exploration of Superforecasting, consider the Edge Master Class on Superforecasting led by Dr. Philip Tetlock. This short course covers the foundational principles and techniques of Superforecasting and features discussions with renowned experts (including Dr. Daniel Kahneman, the Nobel laureate in economics and author of Thinking, Fast and Slow; Dr. Barbara Mellers, a leading researcher in decision-making and another key figure behind the GJP; Dr. Robert Axelrod, a political scientist specializing in international security, formal models, and complex adaptive systems), as well as entrepreneurs and journalists.

From Theory to Practice

Whether you’re new to Superforecasting or want to deepen your understanding, these podcasts and videos are a great place to start! Ready to take the next step? Superforecasters’ methods and traits can be learned and cultivated. Start building your own forecasting skills with our training programs.

Meet the winner of the “Right!” said FRED: Q3 2024 Challenge

Meet the winner of the Q3 2024 “Right!” said FRED Challenge

The winner of the Q3 2024 “Right!” said FRED Challenge, Julio Vieiro, is a retired geologist with two decades’ experience in the oil industry as well as an investor, photographer, and painter. Known on GJ Open as JAVL, in this interview he discusses his interest in forecasting, his diverse hobbies, and his tips for fellow forecasters. He lives in Argentina.

GJO: Could you please tell us about yourself and your background?

Hi. I was born and live in Argentina. Professionally, I’m a geologist, and I have also studied biology and engineering. I worked almost two decades in the oil industry, and I’m currently retired. Additionally, I’ve been a photographer and painter for many years. Nowadays I dedicate my ever-scarce time to personal investments in the stock market, artistic activities, and a two-year program to become a professional sommelier. I enjoy mountains, the outdoors, sports, reading, and barbecues with my partner, my two adult children, and close friends. I’m interested in diverse topics.

GJO: How did you first become interested in forecasting? What brought you to GJ Open specifically?

During my professional development, I was always involved in the forecasting of technical parameters such as hydrocarbon saturation, mineralized thickness, porosity, pressure, etc. In this context, I was often curious why many highly trained professionals had an unconscious tendency to “fall in love” with their own ideas or models, or to expect results mainly according to their desires or what they thought someone expected, wrongly allocating resources or expectations. Frequently, people were more accurate evaluating their peers’ projects than their own.

In my case, Daniel Kahneman’s Thinking Fast and Slow was very revealing. It allowed me to give shape to the intuition that humans have evolved not to develop accurate objective explanations of reality but to generate quick, plausible explanations in order to effectively operate in our original environment, which is not the current one. The way I see it, many times our minds tend to take shortcuts that seem reasonable and/or comforting instead of doing the hard work of looking for evidence. This characteristic would not always help us understand complex situations, especially if we are emotionally involved.

Regarding GJ Open, during the pandemic I read Philip Tetlock’s Superforecasting and found it captivating. I decided to join GJ Open as a fun challenge to test in a non-subjective way my abilities to predict results of complex situations.

GJO: You had some tough competition in the Q3 2024 “Right!” said FRED Challenge. In your opinion, what helped you top the leaderboard?

I’m sure there’s always a dose of luck, some randomness. On the other hand, I try to pay attention to economic data. There is a great availability of information and projections, and it’s difficult to weigh which variables are really relevant and which have little or no impact. I also try to understand the probabilities of future events that could change the observed trends.

GJO: What types of forecasting questions do you enjoy the most? What topics would you like to see more of on the platform in 2025?

I’m more interested in some topics, such as economics, technology, space, sports. I tend to focus on what I enjoy most and what I’m interested in learning about. Evaluating the possible results helps understanding and stimulates the search for information. I prefer questions with data available, not just opinions. I also prefer questions where possible outcomes are expressed in ranges with multiple probabilities rather than yes/no or single probability answers.

I would like to have more questions related to the Latin American reality. In particular, my country is currently going through a complex and interesting economic and political process with still uncertain results.

GJO: What tips could you offer beginner forecasters on GJ Open?

I’m not sure what the best advice is, and I suppose there are many things that could be said. In any case, what I try to do is understand the question very well, not give an opinion on things that I am totally unaware of, look for reliable information and sources of data with frequent updates, and discriminate the relevant factors among the multiple ones that could influence a result.

What I find most important, however, is to find the point at which doubt or uncertainty makes us start to feel uncomfortable with the probabilities we assign. In my experience, people tend to feel too confident or secure. In many of these cases, something important could be missing. On the contrary, I often tend to overextend the alternatives to ensure I don’t err. I try, then, to force myself to rethink the problem in a different way or, more thoroughly, look for more information, or review what I have, to adjust the answer until I feel unsure. It’s not usually easy. Logically, at some point there are cases that are mathematically defined or where the probabilities seem to me less than 1/1000. Another exercise that I find useful is to assign a higher likelihood to those outcomes that don’t match the one that I prefer.

GJO: Is there anything else you’d like to add?

It seems to me that the exercise of making forecasts accustoms us to confronting our ideas with reality and trains us to make decisions with probabilistic logic, which I consider very important for both professional and personal life. It is also a very fun activity, a game where one competes against others and against oneself. Many thanks to Good Judgment for the enjoyment.

See the latest forecasting challenges on GJ Open and try your hand at forecasting!