# Good Judgment Open marketing: how a crowd-forecasting site uses partner challenges, leaderboards and scoring in plain words
How Good Judgment Open markets crowd forecasting with challenges for The Economist and Harvard Kennedy School, leaderboards, Brier scores and badges.
The Convrt team 19 Nov 2026 13 min read 17 sources
2015 year the public tournament began
11,410 forecasters in Foxes Ask
22 challenges listed
The short version Good Judgment Open is the public crowd-forecasting site run by Good Judgment, the firm co-founded by Philip Tetlock. Its pitch fits in one line: Join the internet's smartest crowd.
The product is the challenge: a themed set of questions with its own leaderboard. Partners lend their names, from The Economist, in a 12th annual challenge, to a course at Harvard Kennedy School , and public data such as FRED and S&P Global PMIs.
Around the challenges sit three accuracy scores explained in plain words, a crowd forecast on every question page, 14 kinds of badge and one line that sets it apart: you can share your reasoning with other forecasters .
Good Judgment Open is a forecasting site that grows through challenges rather than ads. This breakdown covers who GJ Open is, the research project behind it, challenges as the product, the challenge with The Economist, the Harvard Kennedy School course, where the crowd is, where the forecasts are, public data as a challenge, one index as 57 questions, a challenge for every beat, what the questions cover, scoring in plain words, scoring against the crowd, the crowd on one question, badges that reward reasoning, the rules that keep scores honest, the path to Superforecaster and what any prediction market brand can copy.
## Who Good Judgment Open is
Good Judgment Open, or GJ Open, is a public forecasting site. The home page opens with a question and a promise: Are you a Superforecaster®? Join the internet's smartest crowd. Improve your forecasting skills and find out how you stack up.
The FAQ puts it plainly: GJ Open is a crowd-forecasting site where you can hone your forecasting skills, learn about the world, and engage with other forecasters. On the site you can make probabilistic forecasts about the likelihood of future events and learn how accurate you were and how your accuracy compares with the crowd .
Good Judgment Open is owned and operated by Good Judgment , a forecasting services firm that equips corporate, government, and non-governmental decision-makers with the benefit of foresight . The home page says co-founder Philip Tetlock literally wrote the book on state-of-the-art crowd-sourced forecasting .
The site is built for everyone. The FAQ says GJ Open is designed for anyone and everyone to improve their forecasting skills , and new users are pointed to a starting point: we encourage you to watch a short video about probability forecasting .
Good Judgment Open at a glance
- 01 2015 Public tournament began, in September.
- 02 22 Challenges on the Challenges page.
- 03 11,410 Forecasters in Foxes Ask.
- 04 189,003 Forecasts in Foxes Ask.
- 05 3 Accuracy scores on every profile.
- 06 14 Kinds of badge.
Good Judgment Open at a glance, from its Challenges page, FAQ and Wikipedia (read 19 Nov 2026).
How a forecaster moves through GJ Open
→ 01 Challenge Pick a theme with its own leaderboard
→ 02 Question Read how it will be resolved
→ 03 Forecast Give a probability
→ 04 Rationale Share the reasoning
→ 05 Update Change it as news lands
→ 06 Score Relative Brier Score against the crowd
How a forecaster moves through GJ Open, from its FAQ and question pages (read 19 Nov 2026).
“Unlike prediction markets and other forecasting sites, you can share your reasoning with other forecasters to challenge your assumptions.” Good Judgment Open, FAQ (read Nov 2026)
## Born out of a research project
The FAQ gives the origin in one line: GJ Open was born out of the Good Judgment Project . Wikipedia dates the project: The Good Judgment Project began in July 2011 . Its team recruited forecasters and gave them basic tutorials on forecasting best practice and overcoming cognitive biases .
Starting in September 2015, Good Judgment Inc has been running a public forecasting tournament at the Good Judgment Open site. The scoring carried over too: Predictions are scored using Brier scores.
That history is the brand. The site does not need to claim expertise when its founder wrote the book, and every page points to Superforecasting: The Art and Science of Prediction as the reading list.
The story behind the site
→ 01 July 2011 The Good Judgment Project begins
→ 02 Training Tutorials on best practice and biases
→ 03 Scoring Every forecast gets a Brier score
→ 04 September 2015 The GJ Open tournament starts
→ 05 Challenges Themed sets with partners
→ 06 Today 22 challenges listed
The story behind the site, from Wikipedia and the GJ Open FAQ (read 19 Nov 2026).
## Challenges are the product
GJ Open packages its questions as competitions. Competitions on GJ Open are called challenges. Challenges are collections of questions organized by a theme or topic. Each challenge has its own leaderboard, which ranks forecasters by comparative accuracy against the forecasters participating in a specific challenge.
That one design choice does most of the marketing. A challenge has a name, a theme, an end date and a winner, so it can be co-branded, announced and run again next year. The home page tells visitors Be sure to check out all of our active challenges, our featured questions, and our unfiltered list of all open forecasting questions.
Sponsors get named on the front page: UBS Asset Management, The Economist and Harvard Kennedy School are listed among them. On 19 November 2026 the Challenges page listed 22 challenges, from awards season to University of Mannheim: Champions League Leadership Forecasting Challenge , a challenge on clubs that several clubs enter the 2026/27 UEFA Champions League under freshly appointed head coaches , with 31 forecasters .
Challenges built with partners and data
- 01 The Economist The World Ahead, 12th year.
- 02 Harvard Kennedy School A course challenge.
- 03 UBS Asset Management Named as a sponsor.
- 04 University of Mannheim Champions League coaches.
- 05 FRED Every question sourced from it.
- 06 S&P Global Monthly PMI questions.
Challenges built with partners and public data, from the GJ Open home and Challenges pages (read 19 Nov 2026).
## A yearly challenge with The Economist
The longest partnership is with a magazine. The World Ahead 2027 challenge runs In our 12th annual collaboration with The Economist and its annual publication previewing the year ahead . It opens with a direct invitation: What do you think will happen in the year 2027? Here's your chance to forecast.
The rules give the prize its weight. Twenty-five questions are planned , and you must forecast on at least 22 of all the questions launched in this challenge . The reward is public: The winner will be published in The Economist in late 2027! On 19 November 2026 it had 13 active questions, 62 forecasters and 263 forecasts .
The challenge also feeds the badge system. The Economist MVP badge is a permanent one, and This permanent badge is awarded to the top 20% (by Relative Brier Score) of forecasters who answered at least 10 questions . There are also Top 5 badges for each yearly challenge.
The Economist: The World Ahead 2027
- 01 12th Annual collaboration.
- 02 25 Questions planned.
- 03 22 Needed to be eligible to win.
- 04 Late 2027 Winner published in The Economist.
- 05 Top 20% Earn the Economist MVP badge.
- 06 Top 5 Badges for each year.
The Economist: The World Ahead 2027 challenge, from its challenge page and the FAQ (read 19 Nov 2026).
## A course at Harvard Kennedy School
The second partner is a school. The challenge asks people to Practice making forecasts of real-world events over the course of this semester , and says we hope that you will deepen your appreciation that the world is an uncertain place .
This challenge was launched as part of the coursework for a class at the Harvard Kennedy School, Good Judgment's fifth collaboration with the elite public policy school. The course was inspired by the book Maxims for Thinking Analytically: The wisdom of legendary Harvard Professor Richard Zeckhauser .
The public plays alongside the class: This challenge is open to the public. Students enrolled in the course have been assigned to forecast the questions on this challenge. On 19 November 2026 the challenge had 281 forecasters and 3,797 forecasts .
The Harvard Kennedy School challenge
- 01 Fifth Collaboration with the school.
- 02 Semester Forecasts over one term.
- 03 Coursework Students assigned the questions.
- 04 Public Anyone can join in.
- 05 281 Forecasters.
- 06 3,797 Forecasts.
The Harvard Kennedy School challenge, from its challenge page and the Challenges page (read 19 Nov 2026).
## Where the crowd is
The biggest challenges are the ones the crowd and the workshops feed. Foxes Ask asks people to forecast on topics suggested by Good Judgment Open forecasters through our crowd discussion question, during Office Hours, or through our Help Desk , and it had 11,410 forecasters . We look forward to seeing your suggested questions here!
The Superforecasting Workshops challenge has people forecast on questions generated by participants of Good Judgment's public and private Superforecasting Workshops . It had 8,399 forecasters , so the workshops and the site feed each other.
Among the themed challenges, In the News 2026 had 3,558 forecasters and AI in 2026 and Beyond had 840 . The 2026-27 Sportsball challenge had 621 , A Challenge of Interest! had 277 and the Red Carpet challenge had 53 .
Forecasters per challenge
Foxes Ask 11,410
Superforecasting Workshops 8,399
In the News 2026 3,558
AI in 2026 and Beyond 840
2026-27 Sportsball 621
Harvard Kennedy School 281
A Challenge of Interest! 277
The Economist 2027 62
Forecasters per challenge, from the Challenges page (read 19 Nov 2026).
## Where the forecasts are
Forecasts tell a different story from sign-ups, because people return to update. Foxes Ask had 189,003 forecasts , In the News 2026 had 136,963 and the workshops challenge had 110,356 .
The FAQ pushes that habit. You are strongly encouraged to update your forecasts frequently no matter how wrong you think previous forecasts might be. A forecast also stays live on its own: we carry that forecast forward each day until you update it by submitting a new forecast .
Forecasts per challenge
Foxes Ask 189,003
In the News 2026 136,963
Superforecasting Workshops 110,356
2026-27 Sportsball 10,844
AI in 2026 and Beyond 9,054
A Challenge of Interest! 8,359
Harvard Kennedy School 3,797
FRED Q4 2026 1,591
Forecasts per challenge, from the Challenges page (read 19 Nov 2026).
## Public data as a challenge
Some challenges are built on a public data set. "Right!" said FRED starts with a short history: In 1991, the Federal Reserve Bank of St. Louis launched the Federal Reserve Economic Data database . It adds that FRED included over 845,000 data series covering an array of financial and economic data .
Fourteen questions are included, with all sourcing provided by FRED. The hook is a phrase: Do you have what it takes to "call the quarter?"
The prize is recognition. The top three performers who forecast on at least 12 of the 14 questions will receive a special GJO badge , and the top performer will be interviewed for a piece on our Good Judgment Insights blog . On 19 November 2026 the challenge had 77 forecasters and 1,591 forecasts .
The FRED challenge
- 01 1991 FRED launched by the St. Louis Fed.
- 02 845,000+ Data series in FRED.
- 03 14 Questions, all sourced from FRED.
- 04 12 of 14 Needed to qualify for the badge.
- 05 Top 3 Earn a special badge.
- 06 Interview For a first-time winner.
The FRED challenge, from its challenge page and the Challenges page (read 19 Nov 2026).
## One index, 57 questions
The Purchasing Managers’ Indices challenge turns one data release into a season. The page says there is one set that is particularly useful for economies all around the world , and PMIs were first created in the late 1940s, and today S&P Global publishes them monthly .
It lists 57 active questions, 48 forecasters and 1,554 forecasts , and every question carries the same Business and Economic Indicators tags .
Each question page explains the measure before asking for a number: Purchasing Managers’ Indices (PMIs) are measures of business activity on a scale of 0 to 100, with anything over 50 signaling expansion and anything under 50 signaling contraction .
The Purchasing Managers’ Indices challenge
- 01 57 Active questions.
- 02 48 Forecasters.
- 03 1,554 Forecasts.
- 04 Late 1940s When PMIs were first created.
- 05 Monthly How often S&P Global publishes them.
- 06 Over 50 Signals expansion.
The Purchasing Managers’ Indices challenge, from its challenge page, a question page and the Challenges page (read 19 Nov 2026).
## A challenge for every beat
Each challenge is written in its own voice. The awards one asks: Emmys and Grammys and Oscars, oh my! Can you predict who will bring home the hardware? The sports one explains its name: The term "sportsball" is often used by those who don't follow sports when asked a question about the topic. This is a great opportunity to learn more about various sports and athletic competitions.
The rates challenge plays with puns: Interest rates affect almost everything in everyday life, from markets and mortgages to college costs and retirement plans. Compound your experience and bond with your fellow forecasters! Take your forecasting to the bank!
The AI challenge sets the stakes in one line: AI holds the promise to fundamentally change the daily lives of every person on Earth . In the News keeps the site fresh with one promise: Expect new questions every week!
A challenge for every beat
→ 01 Awards Emmys, Grammys and Oscars
→ 02 Sport The Sportsball challenge
→ 03 Rates A Challenge of Interest
→ 04 AI AI in 2026 and Beyond
→ 05 Football Champions League head coaches
→ 06 News New questions every week
A challenge for every beat, from the challenge pages (read 19 Nov 2026).
## What the questions cover
In the News 2026 shows how wide the site goes. Its tag filter lists Business (157), Economic Indicators (91), Technology (46) and Finance (45) , then Society (24), Environment (16) and Sports (14) and Health (7) and Entertainment (5) , among others.
Topic tags work as navigation. A forecaster who likes markets can filter to finance, and one who likes awards can stay with entertainment, without leaving the challenge.
Questions by tag, In the News 2026
Business 157
Economic Indicators 91
Technology 46
Finance 45
Society 24
Environment 16
Sports 14
Health 7
Entertainment 5
Questions by tag in In the News 2026, selected tags, from its challenge page (read 19 Nov 2026).
## Scoring in plain words
GJ Open explains its maths the way a coach would. It reports three numbers: the Brier Score, the Median Score and the Relative Brier Score . Lower scores always indicate better accuracy, like in golf.
The FAQ starts with history, The Brier score was originally proposed to quantify the accuracy of weather forecasts , then gives the idea in one sentence: the Brier score indicates how far away from the truth your forecast was .
It works an example: For a yes/no question where you forecasted 70% and the event happened , the score is 0.18. The best (lowest) possible Brier score is 0, and the worst (highest) possible Brier score is 2. And we calculate a Brier score for every day on which you had an active forecast , so timing counts.
The Brier score in plain words
- 01 0 The best possible score.
- 02 2 The worst possible score.
- 03 0.18 A 70% yes that happened.
- 04 Golf Lower is better.
- 05 Daily A score for every day.
- 06 Weather Where the score began.
The Brier score in plain words, from the FAQ (read 19 Nov 2026).
## Scored against the crowd
The leaderboard number is relative. The Relative Brier Score is how we quantify your accuracy as compared to the crowd . A daily score is compared with the crowd median, and then we multiply the difference by your Participation Rate .
The sign is easy to read: negative scores indicate you were more accurate than the crowd . Skipping is safe, so you aren’t penalized for skipping a question .
The consensus line on each question is explained too. The graph displays the mean of the most recent 40% of the current forecasts from each active forecaster. The aim is a consensus forecast that is not overly-influenced by outlier forecasts but still reflects the most recent wisdom of the crowd .
How the Relative Brier Score is built
→ 01 Daily A Brier score for each day
→ 02 Average Across the life of the question
→ 03 Crowd Minus the crowd median
→ 04 Participation Times the share of days active
→ 05 Challenge Added up across its questions
→ 06 Leaderboard Below zero beats the crowd
How the Relative Brier Score is built, from the FAQ (read 19 Nov 2026).
## The crowd on one question
Every question page shows what the crowd thinks. The page on the UK Services PMI for February 2027 lists answer ranges with the columns Possible Answer Crowd Forecast Change in last 24 hours Change in last week Change in last month .
On 19 November 2026 the top range read at least 52.0, but less than 54.0, at 55.40% , with 21.70% on 50.0 to 52.0 . The page gives the last reading for context: For September 2026, S&P Global reported UK Services PMI as 52.1 . Reported "flash" estimates are immaterial.
The page ends with a pointer to help: Confused? Check our FAQ or ask us for help.
Crowd forecast, UK Services PMI, February 2027
Less than 46.0 1.0%
46.0 to 48.0 1.7%
48.0 to 50.0 6.3%
50.0 to 52.0 21.7%
52.0 to 54.0 55.4%
54.0 to 56.0 10.9%
56.0 or more 3.0%
Crowd forecast in percent for the UK Services PMI, February 2027, from the question page (read 19 Nov 2026).
## Badges that reward the reasoning
The FAQ names what sets GJ Open apart: Unlike prediction markets and other forecasting sites, you can share your reasoning with other forecasters to challenge your assumptions. The badges are built to reward exactly that.
Badges are public awards you can earn by participating in GJ Open. We award new badges (and expire old ones) on the first of each month. Badges do not affect how we score your forecasts.
The Influencer badge says it best: The best forecasters don't just put their reputation on the line, but explain how they chose their probabilities. It needs at least 2 comments (as rationales accompanying forecasts or replies to other forecasters) with at least 2 upvotes each . Rationale badges start with Show your work! You'll earn a badge for a total of 25, 50, and 100 rationales.
Others reward habits. For Frequent Forecaster, You will earn this badge if you made at least 10 forecasts in the previous calendar month. , and if you want to keep it, you have to stay active! The rest climb in levels. You earn this permanent badge by forecasting on 50, 100, 250, or 500 cumulative questions. You earn this permanent badge by updating your forecasts 100, 200, 500, or 1000 times. You earn this permanent badge by receiving 50, 100, 250, 500, or 1000 cumulative upvotes. You earn this permanent badge by posting 50, 100, 250, 500, or 1000 rationales with links.
The top tier is about accuracy: You earn this persistent badge by being in the top 10 in 25, 50, 100, or 250 questions , and since June 2022 it also needs a score better than the crowd. Forecasters pick what to show, since you can choose which badges you want to feature most prominently on your profile .
Badges for activity and reasoning
- 01 Frequent Forecaster 10 forecasts last month.
- 02 Influencer 2 comments with 2 upvotes each.
- 03 Rationale 25, 50 and 100 rationales.
- 04 Researcher Rationales with links.
- 05 Updater 100 to 1,000 updates.
- 06 Top Forecaster Top 10, better than the crowd.
Badges for activity and reasoning, from the FAQ (read 19 Nov 2026).
## Rules that keep the score honest
Trust in a leaderboard comes from rules people can read. There is no way to withdraw from a question or delete a forecast. Data questions use first prints: forecasting questions will be resolved when relevant data are initially released, and subsequent revisions to the data will not affect the question’s resolution . Discussion is kept apart: Open questions are never scored for accuracy.
The FAQ also admits the limits of its own rule. The usual Brier score does not give any credit for “near-misses.” , so ordered questions use a special rule. And a question that outlives its challenge is not wasted: GJ Open will roll the question over into the next version of the challenge or a similar challenge .
The etiquette policy fits on one line: “Be kind, respect others, and stay on topic.” The goal is our goal is to provide a fun, respectful, and constructive place for everyone to do so . When an argument stalls, the advice is to let your forecast speak for itself . Eventually, scores will show who was right and who was wrong.
Help starts with the community too: First, consult the GJ Open crowd. Other forecasters on the site are your best resource. And the crowd shapes what comes next: To suggest a question, you can post your suggestion on the webpage itself.
## The path to Superforecaster
The site keeps one goal in front of every visitor. The FAQ answers how to become a Superforecaster in one line: In short: elite accuracy, along with quality comments and collegiality.
The advice to get there is reading and practice: the book Superforecasting: The Art and Science of Prediction by Philip E. Tetlock and Dan Gardner , and then Most importantly, PRACTICE on questions here on GJ Open!
## What any prediction market brand can copy
What any prediction market brand can copy
→ 01 Challenges Group questions by theme
→ 02 Partners Co-brand with media and schools
→ 03 Leaderboards One for each challenge
→ 04 Scores Explain them in plain words
→ 05 Reasons Reward written rationales
→ 06 Crowd Let users suggest questions
GJ Open markets forecasting as a game with rules, seasons and partners. It packages questions as named challenges, gives each one a leaderboard and lends the format to a magazine, a school and public data sets.
The lessons are simple. Run themed seasons with a clear winner. Co-brand them with media and schools. Explain the score in plain words. Reward people who write down their reasoning. Then cut the clearest minute of every challenge launch and every winner story into clips and post them daily on TikTok, Instagram and YouTube Shorts from accounts built for short form.
How we would run it for you Creator campaigns for sportsbooks We run creator and clipping campaigns for sportsbooks and prediction markets, with every post checked against the ad rules in each state and tracked for views, link clicks and click-through rate. The system in this article, run for you.
Apply Now How we run growth for prediction markets →
## Frequently asked questions
GJ Open is a crowd-forecasting site where people make probability forecasts on future events, see how accurate they were and compare their accuracy with the crowd. It is owned and operated by Good Judgment, a forecasting services firm, and was born out of the Good Judgment Project.
No. Its FAQ sets it apart in one line: unlike prediction markets and other forecasting sites, you can share your reasoning with other forecasters to challenge your assumptions. Forecasters give probabilities and are ranked by accuracy, not by trading.
It reports three numbers: the Brier Score, the Median Score and the Relative Brier Score. Lower is better, like in golf. The Relative Brier Score compares a forecaster with the crowd median each day, scaled by how many days they had a forecast, and it ranks every challenge leaderboard.
On 19 November 2026 its Challenges page listed The Economist: The World Ahead 2027, its 12th annual collaboration with The Economist, a Harvard Kennedy School course challenge, a University of Mannheim Champions League challenge and challenges built on FRED and S&P Global PMI data.
Package questions as themed challenges, give each one its own leaderboard, co-brand challenges with media and schools, explain scoring in plain words, reward written reasoning with badges, and let the crowd suggest the next questions.
- Good Judgment Open, home page, read 19 Nov 2026.
- Good Judgment Open, FAQ, read 19 Nov 2026.
- Good Judgment Open, Challenges page, read 19 Nov 2026.
- Good Judgment Open, Challenges page 2, read 19 Nov 2026.
- Good Judgment Open, The Economist: The World Ahead 2027 challenge, read 19 Nov 2026.
- Good Judgment Open, Harvard Kennedy School challenge (2026), read 19 Nov 2026.
- Good Judgment Open, "Right!" said FRED challenge, read 19 Nov 2026.
- Good Judgment Open, Purchasing Managers’ Indices challenge, read 19 Nov 2026.
- Good Judgment Open, Red Carpet challenge, read 19 Nov 2026.
- Good Judgment Open, 2027-28 Sportsball challenge, read 19 Nov 2026.
- Good Judgment Open, A Challenge of Interest 2027, read 19 Nov 2026.
- Good Judgment Open, Artificial Intelligence in 2026 and Beyond challenge, read 19 Nov 2026.
- Good Judgment Open, In the News 2026 challenge, read 19 Nov 2026.
- Good Judgment Open, Superforecasting Workshops challenge, read 19 Nov 2026.
- Good Judgment Open, Foxes Ask challenge, read 19 Nov 2026.
- Good Judgment Open, question on the UK Services PMI for February 2027, read 19 Nov 2026.
- Wikipedia, The Good Judgment Project, read 19 Nov 2026.
## More breakdowns
All breakdowns →
Breakdown · 5 min read How Diary of a CEO mastered podcast clipping Breakdown · 4 min read The Joe Rogan clip economy: half of the biggest podcast’s views are clips Breakdown · 8 min read How Patrick Bet-David and Valuetainment use clips: the PBD Podcast, short-form and distribution
## Want distribution done properly?
Apply and we'll map your existing content to real reach on accounts you own.
Apply Now View pricing

---
Source: https://convrt.media/breakdowns/good-judgment-open-marketing/ · Updated: 2026-11-19 · Convrt Media · contact@convrt.media
