CalculatorsUpdated 22 Jul 20262 min read
Brier Score & Log Loss Calculator
Enter what you predicted and what happened. This scores the set two ways and compares both with the "know nothing" baseline.
| # | Forecast probability | Result | Brier contribution |
|---|---|---|---|
| 1 | 0.0625 | ||
| 2 | 0.1600 | ||
| 3 | 0.3025 | ||
| 4 | 0.1600 | ||
| 5 | 0.4900 | ||
| 6 | 0.0400 |
Base-rate baseline 0.2500 — lower is better.
Base-rate baseline 0.6931.
6 forecasts, of which 50% happened. Your probabilities beat simply predicting that base rate every time.
A handful of forecasts cannot separate skill from luck whatever the score says. Treat anything under a few hundred as a sanity check, not a verdict.
Why the baseline is the whole point#
A scoring number on its own says nothing. If 80% of your fixtures ended in a home win, predicting "80% home" every single time scores well without containing a single piece of insight. The skill score is the honest reading: it asks whether your probabilities beat that lazy baseline.
Anything at or below zero means they did not — no matter how good the raw Brier looked.
Two metrics that disagree on purpose#
Both Brier and log loss are proper scoring rules: each is minimised by stating what you actually believe, so neither rewards hedging toward 50%. Where they part company is confidence.
Brier is quadratic and forgiving — being certain and wrong costs a bounded amount. Log loss is logarithmic and brutal about it, which is what you want from a model whose probabilities feed a staking decision, because a confidently wrong 95% is exactly the forecast that empties a bankroll.
Try it: set a forecast to 0.99 and mark it as not happening. Brier barely moves. Log loss jumps.
Scoring is not the same as profit#
A well-calibrated model can still lose money, and a badly calibrated one can win for a while. Scoring tells you whether the probabilities are honest; closing line value tells you whether they were better than the market's. You need both, and you need enough of a sample for either to mean anything.
This is the same arithmetic behind Tofiko's own Model Accuracy view — read how our models work for what goes into them, and calibration for what a score like this can and cannot detect.
Related
- The Brier Score: How We Grade Our Own Predictions
- Log Loss: Scoring Probabilities That Have to Be Honest
- Calibration: The Only Promise a Prediction Can Keep
- Sample Size: How Many Bets Before You Know You Have an Edge
- How Our Models Work: Poisson, Dixon-Coles and Elo
- Closing Line Value Calculator — Grade a Bet Without Waiting for the Result
- Expected Value Calculator — Is Your Bet +EV?
- Fair Odds Calculator — Remove the Bookmaker Margin from Any 1X2 Book
Frequently asked questions
What is a good Brier score?
There is no absolute answer — it depends entirely on how predictable the events are. A Brier of 0.21 is strong on evenly matched fixtures and poor on a slate of heavy favourites. Always read it against the base-rate baseline, which is what this calculator reports alongside it.
What is the difference between Brier score and log loss?
Both reward honest probabilities, but log loss is logarithmic and punishes confident mistakes far harder. A forecast of 99% that fails costs a little under Brier and a great deal under log loss, which is why a model can look acceptable on one and bad on the other.
What is a Brier skill score?
It compares your Brier score with the score you would have got by predicting the base rate every time. Above zero means your forecasts added information; zero or below means they did not, however confident they looked.
How many forecasts do I need before the score means anything?
More than most people expect. A few dozen results cannot separate skill from luck — treat anything under a few hundred as a sanity check rather than a verdict, and see the sample size guide for the arithmetic.