All leagues — Validation

Every played match: our pre-match forecast vs. what actually happened. The receipts. 🧾

181 graded matches

By league

The same forecasts, split by competition, next to the bookmakers' closing consensus. The better of each pair is green; for RPS, lower is better. Sample sizes differ a lot early in a season, so a league with few graded matches will look noisier than it is.

LeagueGraded Outcome accuracyAvg. RPS (lower better)
SFMMOMarketSFMMOMarket
Premier League 100 47.0% 48.0% 0.211 0.205
Bundesliga 81 54.3% 56.8% 0.208 0.205
50.3%
Outcome accuracy
91 / 181 results called
50.3% vs Market 51.9%
9.9%
Exact scoreline
18 / 181 spot‑on
0.210
Avg. RPS (lower better)
coin‑flip baseline 0.237
0.210 vs Market 0.205
11.7%
Skill vs. coin‑flip
RPS improvement over uniform

Market = de-vigged bookmaker consensus (closing average odds) over 181 of 181 graded matches. Both figures above are scored on that same subset. SFMMO trails the closing market by 2.2% on RPS.

Wait — how can 50.3% accuracy still beat a coin-flip on RPS?

Because accuracy and RPS measure different things, on different scales — they're not in competition.

  • Accuracy only asks: was our single top pick right? It's blind to the probabilities, and a model almost never makes draw its top pick — so a draw-heavy round drags it down even when the forecast was good.
  • RPS grades the whole probability spread (e.g. 55 / 25 / 20) against a uniform “coin-flip” (33 / 33 / 33). The coin-flip never commits, so it's never punished hard — which makes it a surprisingly tough baseline, and means a few % of skill is a genuine edge.

Our committed forecast cuts both ways (lower RPS = better):

MatchOur forecastResultOur RPSCoin-flip RPS
Favourite delivers55 / 25 / 20home win0.12 ✓0.28
We back home, it's a draw55 / 25 / 20draw0.170.11 ✓

When a favourite wins we crush the baseline; on a draw, the hedging coin-flip actually beats us. Matchday 1 had 9 draws in 24 games, so the wins and losses partly cancel — the net edge is the “skill” figure above. A few % over uniform is roughly what bookmakers manage, so it's a real, healthy edge.

Premier League · Matchday 1
Match Forecast (1 / X / 2) Our call Predicted Actual
77.3 / 14.8 / 7.9 Arsenal 2–0 3–0 ✓
17.2 / 23.7 / 59.0 Manchester United 0–1 2–0 ✗
45.7 / 27.8 / 26.5 Everton 1–1 2–0 ✓
32.4 / 28.6 / 38.9 Sunderland 1–1 2–1 ✗
50.8 / 24.3 / 24.8 Nottingham Forest 1–1 0–1 ✗
49.1 / 24.5 / 26.4 Brentford 1–1 3–0 ✓
42.8 / 27.4 / 29.9 Brighton & Hove Albion 1–1 4–0 ✓
65.0 / 19.9 / 15.1 Manchester City 2–0 2–1 ✓
31.3 / 26.4 / 42.3 Liverpool 1–1 2–2 ✗
31.1 / 28.0 / 40.9 Chelsea 1–1 2–3 ✓
Premier League · Matchday 2
Match Forecast (1 / X / 2) Our call Predicted Actual
22.0 / 25.8 / 52.2 Manchester City 1–1 1–4 ✓
60.6 / 22.5 / 16.9 Liverpool 1–1 2–2 ✗
42.8 / 27.0 / 30.2 AFC Bournemouth 1–1 1–1 ✗
38.5 / 27.6 / 33.9 Coventry City 1–1 0–1 ✗
42.9 / 25.6 / 31.5 Tottenham Hotspur 1–1 0–2 ✗
50.1 / 25.6 / 24.3 Chelsea 1–1 4–3 ✓
32.0 / 25.3 / 42.7 Brentford 1–1 1–1 ✗
36.8 / 28.9 / 34.3 Sunderland 1–1 1–0 ✓
74.4 / 16.7 / 8.9 Manchester United 2–0 5–2 ✓
20.2 / 23.5 / 56.3 Arsenal 1–1 0–1 ✓
Premier League · Matchday 3
Match Forecast (1 / X / 2) Our call Predicted Actual
13.3 / 19.1 / 67.6 Liverpool 0–2 0–2 ✓ ⚛
48.0 / 24.6 / 27.5 Newcastle United 1–1 2–2 ✗
61.4 / 22.9 / 15.7 Brentford 1–0 1–1 ✗
55.2 / 23.3 / 21.5 Brighton & Hove Albion 1–1 1–1 ✗
46.7 / 27.0 / 26.4 Fulham 1–1 2–3 ✗
83.1 / 11.6 / 5.3 Manchester City 2–0 1–0 ✓
48.6 / 25.4 / 26.1 Nottingham Forest 1–1 0–0 ✗
32.4 / 28.3 / 39.3 Aston Villa 1–1 0–0 ✗
32.1 / 27.6 / 40.3 Manchester United 1–1 2–2 ✗
53.2 / 24.2 / 22.6 Arsenal 1–1 2–1 ✓
Premier League · Matchday 4
Match Forecast (1 / X / 2) Our call Predicted Actual
39.2 / 25.4 / 35.4 AFC Bournemouth 1–1 2–2 ✗
40.4 / 27.9 / 31.6 Aston Villa 1–1 1–2 ✗
71.5 / 18.6 / 10.0 Chelsea 2–0 2–2 ✗
62.2 / 21.9 / 15.9 Crystal Palace 2–0 2–3 ✗
65.7 / 20.7 / 13.6 Liverpool 2–0 0–0 ✗
40.1 / 27.9 / 32.0 Tottenham Hotspur 1–1 0–0 ✗
17.7 / 24.7 / 57.6 Arsenal 0–1 0–2 ✓
22.7 / 24.8 / 52.4 Brighton & Hove Albion 1–1 0–5 ✓
38.9 / 26.3 / 34.8 Manchester United 1–1 0–1 ✗
39.6 / 26.0 / 34.4 Leeds United 1–1 4–1 ✓
Premier League · Matchday 5
Match Forecast (1 / X / 2) Our call Predicted Actual
39.5 / 25.9 / 34.6 Brentford 1–1 3–0 ✓
45.4 / 26.8 / 27.9 Tottenham Hotspur 1–1 2–3 ✗
30.3 / 26.3 / 43.5 Arsenal 1–1 3–0 ✗
68.3 / 19.6 / 12.0 Everton 2–0 1–0 ✓
60.1 / 22.9 / 17.0 Newcastle United 1–0 2–1 ✓
66.2 / 20.4 / 13.4 Nottingham Forest 2–0 0–1 ✗
30.6 / 25.6 / 43.7 Liverpool 1–1 0–1 ✓
48.3 / 25.1 / 26.7 Leeds United 1–1 0–0 ✗
74.7 / 17.1 / 8.2 Manchester City 2–0 5–3 ✓
27.7 / 26.7 / 45.5 Manchester United 1–1 1–1 ✗
Premier League · Matchday 6
Match Forecast (1 / X / 2) Our call Predicted Actual
68.0 / 18.9 / 13.0 Arsenal 2–0 2–1 ✓
34.0 / 26.6 / 39.5 Brentford 1–1 2–2 ✗
56.7 / 22.8 / 20.5 Chelsea 1–1 5–1 ✓
27.9 / 26.8 / 45.3 Fulham 1–1 2–1 ✗
25.6 / 27.0 / 47.3 Brighton & Hove Albion 1–1 0–2 ✓
61.1 / 22.2 / 16.8 Manchester United 1–1 1–1 ✗
38.2 / 28.2 / 33.6 Crystal Palace 1–1 3–1 ✓
28.3 / 29.4 / 42.4 Everton 1–1 2–2 ✗
38.2 / 26.7 / 35.2 Liverpool 1–1 0–3 ✗
25.7 / 25.1 / 49.3 Newcastle United 1–1 4–1 ✗
Premier League · Matchday 7
Match Forecast (1 / X / 2) Our call Predicted Actual
33.5 / 27.8 / 38.7 Chelsea 1–1 0–2 ✓
39.8 / 26.3 / 33.9 Brentford 1–1 1–2 ✗
54.0 / 25.8 / 20.2 Fulham 1–0 1–0 ✓ ⚛
87.7 / 8.7 / 3.6 Manchester City 3–0 3–2 ✓
45.6 / 25.5 / 28.9 Newcastle United 1–1 0–1 ✗
54.7 / 24.5 / 20.8 AFC Bournemouth 1–1 2–0 ✓
56.2 / 24.2 / 19.6 Brighton & Hove Albion 1–1 5–0 ✓
29.2 / 25.8 / 45.1 Manchester United 1–1 1–1 ✗
24.6 / 25.6 / 49.9 Arsenal 1–1 0–1 ✓
62.1 / 21.5 / 16.4 Tottenham Hotspur 1–0 3–1 ✓
Premier League · Matchday 8
Match Forecast (1 / X / 2) Our call Predicted Actual
26.3 / 25.7 / 48.0 Nottingham Forest 1–1 1–1 ✗
21.8 / 24.2 / 54.1 Manchester City 1–1 2–1 ✗
63.7 / 22.1 / 14.1 Arsenal 2–0 2–0 ✓ ⚛
30.6 / 27.3 / 42.1 Fulham 1–1 0–1 ✓
60.3 / 22.1 / 17.5 Chelsea 1–1 0–2 ✗
40.8 / 27.0 / 32.2 Crystal Palace 1–1 0–2 ✗
23.6 / 25.4 / 51.0 Brentford 1–1 1–1 ✗
47.9 / 25.9 / 26.2 Liverpool 1–1 2–0 ✓
60.6 / 21.7 / 17.6 Manchester United 1–1 0–3 ✗
33.4 / 27.6 / 39.0 Leeds United 1–1 0–0 ✗
Premier League · Matchday 9
Match Forecast (1 / X / 2) Our call Predicted Actual
45.6 / 26.4 / 28.0 Chelsea 1–1 2–0 ✓
48.8 / 24.1 / 27.1 AFC Bournemouth 1–1 2–0 ✓
54.4 / 24.0 / 21.6 Brentford 1–1 2–0 ✓
36.5 / 28.6 / 34.9 Coventry City 1–1 3–1 ✓
49.6 / 26.0 / 24.4 Hull City 1–1 2–2 ✗
60.6 / 21.8 / 17.6 Manchester City 1–1 0–1 ✗
52.6 / 24.8 / 22.6 Tottenham Hotspur 1–1 2–0 ✓
47.8 / 27.2 / 25.0 Aston Villa 1–1 1–1 ✗
39.2 / 27.1 / 33.7 Liverpool 1–1 0–1 ✗
44.3 / 27.3 / 28.3 Newcastle United 1–1 0–1 ✗
Premier League · Matchday 10
Match Forecast (1 / X / 2) Our call Predicted Actual
61.7 / 22.8 / 15.6 Everton 1–0 3–1 ✓
39.2 / 26.0 / 34.8 Leeds United 1–1 1–0 ✓
78.5 / 14.8 / 6.7 Arsenal 2–0 1–0 ✓
43.5 / 27.1 / 29.3 Fulham 1–1 1–1 ✗
22.3 / 24.7 / 53.0 Manchester City 1–1 3–1 ✗
46.3 / 25.7 / 28.0 Brighton & Hove Albion 1–1 2–0 ✓
22.9 / 26.2 / 50.9 Liverpool 1–1 1–3 ✓
24.1 / 23.5 / 52.4 AFC Bournemouth 1–1 1–2 ✓
19.8 / 25.7 / 54.5 Chelsea 0–1 1–0 ✗
54.9 / 24.6 / 20.4 Manchester United 1–1 4–4 ✗
Bundesliga · Matchday 1
Match Forecast (1 / X / 2) Our call Predicted Actual
69.1 / 18.3 / 12.6 Bayern Munich 2–0 5–1 ✓
20.6 / 22.5 / 56.9 Bayer Leverkusen 1–1 3–2 ✗
61.3 / 21.9 / 16.9 RB Leipzig 1–1 3–0 ✓
63.6 / 21.8 / 14.6 Mainz 05 2–0 0–0 ✗
41.8 / 27.4 / 30.9 Union Berlin 1–1 3–3 ✗
32.3 / 25.4 / 42.3 Hoffenheim 1–1 3–2 ✗
66.1 / 20.2 / 13.7 Borussia Dortmund 2–0 2–0 ✓ ⚛
44.2 / 24.9 / 30.9 Freiburg 1–1 4–1 ✓
49.1 / 27.0 / 24.0 Augsburg 1–1 3–0 ✓
Bundesliga · Matchday 2
Match Forecast (1 / X / 2) Our call Predicted Actual
55.0 / 22.9 / 22.0 VfB Stuttgart 1–1 4–1 ✓
32.4 / 23.9 / 43.7 Borussia Dortmund 1–1 2–3 ✓
59.1 / 22.1 / 18.8 Bayer Leverkusen 1–1 4–0 ✓
55.8 / 23.0 / 21.2 Borussia Mönchengladbach 1–1 3–4 ✗
22.8 / 22.4 / 54.8 RB Leipzig 1–1 3–1 ✗
25.6 / 26.0 / 48.4 Freiburg 1–1 0–1 ✓
9.2 / 16.2 / 74.5 Bayern Munich 0–2 0–0 ✗
35.8 / 29.0 / 35.2 Hamburger SV 1–1 0–5 ✗
46.7 / 25.3 / 28.0 Eintracht Frankfurt 1–1 1–4 ✗
Bundesliga · Matchday 3
Match Forecast (1 / X / 2) Our call Predicted Actual
49.2 / 27.1 / 23.8 Union Berlin 1–1 1–3 ✗
80.5 / 13.2 / 6.3 Borussia Dortmund 2–0 3–0 ✓
43.7 / 23.1 / 33.2 Hoffenheim 1–1 2–1 ✓
51.3 / 24.4 / 24.4 Freiburg 1–1 5–0 ✓
33.0 / 25.1 / 41.9 Bayer Leverkusen 1–1 2–2 ✗
53.6 / 23.9 / 22.5 Mainz 05 1–1 1–3 ✗
36.0 / 24.4 / 39.6 Werder Bremen 1–1 1–1 ✗
73.0 / 17.1 / 9.9 RB Leipzig 2–0 5–0 ✓
11.2 / 16.6 / 72.1 Bayern Munich 0–2 1–2 ✓
Bundesliga · Matchday 4
Match Forecast (1 / X / 2) Our call Predicted Actual
82.2 / 12.2 / 5.6 Bayern Munich 2–0 7–0 ✓
42.2 / 25.1 / 32.7 Eintracht Frankfurt 1–1 2–2 ✗
35.7 / 26.1 / 38.3 Mainz 05 1–1 3–4 ✓
39.6 / 26.9 / 33.4 Hamburger SV 1–1 2–1 ✓
41.9 / 25.2 / 32.9 Werder Bremen 1–1 3–2 ✓
32.1 / 24.2 / 43.7 Borussia Dortmund 1–1 0–1 ✓
41.1 / 24.2 / 34.7 Bayer Leverkusen 1–1 2–0 ✓
50.5 / 25.0 / 24.5 Schalke 04 1–1 0–0 ✗
22.0 / 23.0 / 55.1 Hoffenheim 1–1 3–1 ✗
Bundesliga · Matchday 5
Match Forecast (1 / X / 2) Our call Predicted Actual
67.6 / 18.0 / 14.5 Borussia Dortmund 2–1 2–2 ✗
61.7 / 20.9 / 17.4 Hoffenheim 2–1 2–3 ✗
15.4 / 20.4 / 64.2 Bayern Munich 0–2 2–2 ✗
33.5 / 25.1 / 41.3 Bayer Leverkusen 1–1 3–4 ✓
48.2 / 25.0 / 26.8 Union Berlin 1–1 1–0 ✓
23.1 / 24.4 / 52.5 VfB Stuttgart 1–1 0–2 ✓
64.9 / 19.5 / 15.5 RB Leipzig 2–1 6–0 ✓
42.1 / 25.6 / 32.3 1. FC Köln 1–1 2–1 ✓
57.5 / 24.0 / 18.5 Freiburg 1–1 2–1 ✓
Bundesliga · Matchday 6
Match Forecast (1 / X / 2) Our call Predicted Actual
53.0 / 23.4 / 23.6 Eintracht Frankfurt 1–1 1–0 ✓
19.8 / 22.9 / 57.2 Borussia Dortmund 1–1 0–0 ✗
29.2 / 25.5 / 45.3 VfB Stuttgart 1–1 1–0 ✗
66.7 / 19.4 / 13.9 Werder Bremen 2–0 2–2 ✗
33.7 / 27.4 / 38.8 Mainz 05 1–1 0–1 ✓
30.6 / 25.7 / 43.7 Augsburg 1–1 4–3 ✗
62.6 / 20.1 / 17.2 Bayern Munich 2–1 6–1 ✓
60.1 / 21.2 / 18.7 Bayer Leverkusen 2–1 2–1 ✓ ⚛
39.5 / 23.4 / 37.1 Borussia Mönchengladbach 1–1 1–2 ✗
Bundesliga · Matchday 7
Match Forecast (1 / X / 2) Our call Predicted Actual
58.5 / 22.1 / 19.5 VfB Stuttgart 1–1 2–3 ✗
75.8 / 14.8 / 9.4 RB Leipzig 2–0 4–0 ✓
54.3 / 24.5 / 21.2 Augsburg 1–1 1–1 ✗
48.7 / 23.6 / 27.7 Mainz 05 1–1 2–3 ✗
42.7 / 28.1 / 29.2 1. FC Köln 1–1 0–0 ✗
35.1 / 27.7 / 37.2 Hamburger SV 1–1 1–0 ✗
68.9 / 18.0 / 13.0 Borussia Dortmund 2–0 1–0 ✓
31.4 / 22.7 / 45.9 Bayer Leverkusen 1–1 3–0 ✗
15.7 / 19.9 / 64.4 Bayern Munich 1–2 1–3 ✓
Bundesliga · Matchday 8
Match Forecast (1 / X / 2) Our call Predicted Actual
28.8 / 24.7 / 46.5 Mainz 05 1–1 4–1 ✗
57.3 / 21.6 / 21.0 Bayer Leverkusen 2–1 2–4 ✗
44.4 / 25.8 / 29.8 Augsburg 1–1 1–2 ✗
60.1 / 22.1 / 17.8 Borussia Mönchengladbach 1–1 0–0 ✗
44.3 / 22.6 / 33.2 Werder Bremen 1–1 2–0 ✓
20.2 / 23.7 / 56.1 RB Leipzig 1–1 0–2 ✓
68.6 / 18.0 / 13.4 Bayern Munich 2–1 2–2 ✗
45.8 / 27.0 / 27.1 Union Berlin 1–1 1–1 ✗
53.1 / 24.3 / 22.6 Eintracht Frankfurt 1–1 3–1 ✓
Bundesliga · Matchday 9
Match Forecast (1 / X / 2) Our call Predicted Actual
40.4 / 26.6 / 33.0 Hamburger SV 1–1 3–1 ✓
75.7 / 15.1 / 9.3 Borussia Dortmund 2–0 2–1 ✓
68.1 / 18.6 / 13.3 RB Leipzig 2–0 5–2 ✓
14.3 / 19.2 / 66.4 Bayern Munich 0–2 1–2 ✓
29.2 / 26.1 / 44.7 Eintracht Frankfurt 1–1 2–2 ✗
49.6 / 22.8 / 27.6 VfB Stuttgart 1–1 1–0 ✓
23.9 / 23.7 / 52.4 Bayer Leverkusen 1–1 1–2 ✓
55.1 / 24.3 / 20.6 Freiburg 1–1 2–0 ✓
57.2 / 23.2 / 19.6 Hoffenheim 1–1 2–1 ✓

✓ = our most-likely result was correct  ·  ⚛ = exact scoreline nailed  ·  multiclass Brier score 0.601. Click any match for its full forecast breakdown.

Data API Build on our forecasts Every forecast as JSON or CSV, plus the archive frozen before kick-off. $29/month · coming soon. Join the waitlist →