Sign up and get 3 free requests with Start plan accessSign up →

Claude Fable 5

claude-fable-5

Research profile — published report figures only.

Tracked since Aug 3-9, 2026 UTC, first published 10 Aug 2026.

Live benchmark page →All modelsResearch

Research benchmark — not financial or investment advice; paper trading only.

Current standing

Where Claude Fable 5 finished in the most recent published window — the figures the issue printed, not a live reading.

Hit rate
48.5%
95% Wilson [44.8%, 52.2%]
Scored calls
705
directional calls in the window
Rank
#4 of 7
by hit rate, this issue
Coverage
53.0%
calls scored divided by the mature calls available to that model
vs prior window
+6.0pp
42.5% → 48.5%

Weekly Model Watch #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC · 48.5% is level with the all-model figure of 48.5% for the same window

Hit rate follows the benchmark's TP/SL/expiry outcome rules; it is not simply the asset's price direction at the end of the forecast horizon. The weekly and monthly metrics shown here use the 1h, 4h and 1d horizons; stability runs have their own test coverage.

Monthly hit rate
48.2%
95% Wilson [46.4%, 50.0%]
Monthly calls
3,003
directional calls in the month
Monthly rank
#7 of 7
by hit rate, this issue

Monthly Model Watch #3 · Oct 1-31, 2026 UTC · cutoff Sun 1 Nov 2026 16:00 UTC

Calibration

Stated confidence against realised accuracy. The pooled all-model row of the same table is printed next to Claude Fable 5's, because a gap only means something against the population it was measured in.

ScopenHit rateMean stated conf.GapBrier95% Wilson
Weekly Calibration #15Claude Fable 570548.5%59.2%+10.7pp0.2622[44.8%, 52.2%]
Weekly Calibration #15field, all models5,66948.5%60.9%+12.4pp0.2677—
Monthly Calibration #3Claude Fable 53,00348.2%60.5%+12.3pp0.2661[46.4%, 50.0%]
Monthly Calibration #3field, all models22,57948.6%61.8%+13.2pp0.2701—

Weekly Calibration #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC — Monthly Calibration #3 · Oct 1-31, 2026 UTC · cutoff Sun 1 Nov 2026 16:00 UTC

Gap vs prior window. 17.6pp → 10.7pp (-6.9pp), as Weekly Calibration #15 printed it.
Stated confidence bucketnHit rateMean stated conf.
50-6031347.6%56.1%
60-7039249.2%61.7%
70-800no datano data
80-1000no datano data

Buckets as Weekly Calibration #15 printed them; a cell the issue marked insufficient or empty keeps its count and prints no rate.

Stability

How much Claude Fable 5's answer moves when nothing else does: identical payloads replayed several times, counted as unanimous sets and as flips. The caption on each tile is the same measurement in the comparison run shipped with the issue.

Unanimity
70.4%
baseline (Jul 31): 81.5%
Hard flips
0
baseline (Jul 31): 0
Soft flips
8
baseline (Jul 31): 5
Invalid
0.0%
baseline (Jul 31): 0.0%
Sideways
52.6%
baseline (Jul 31): 19.3%
Confidence SD
1.2pp
baseline (Jul 31): 1.2pp

Stability Index — Run 2 · 10 Aug 2026 · 945 calls, 5 repeats per set, 27 sets per model, 3 tickers · compared against baseline (Jul 31)

By horizon

Claude Fable 5 split by forecast horizon, as the Calibration issues print it. Only the horizons inside the reports' scoring gate appear here; a cell the builder annotated keeps its annotation.

HorizonWeekly nWeekly hit rateMonthly nMonthly hit rate
1H40749.1%1,90649.2%
4H23442.7%93446.6%
1D6465.6%16345.4%

Weekly Calibration #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC — Monthly Calibration #3 · Oct 1-31, 2026 UTC · cutoff Sun 1 Nov 2026 16:00 UTC

By asset

The Model Watch issues print a best-pairs and a worst-pairs table — the model-instrument cells that stood out in the window. Only Claude Fable 5's own rows are listed; a model that made neither list simply has no row there.

InstrumentListnHit rateIssue
SOLbest pairs15051.3%Weekly Model Watch #15
BTCworst pairs15243.4%Weekly Model Watch #15
XRPbest pairs55050.9%Monthly Model Watch #3
SOLworst pairs63546.9%Monthly Model Watch #3
BNBworst pairs59246.0%Monthly Model Watch #3

Weekly Model Watch #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC — Monthly Model Watch #3 · Oct 1-31, 2026 UTC · cutoff Sun 1 Nov 2026 16:00 UTC

Long
12.8%
share of the model's calls
Short
40.2%
share of the model's calls
Sideways
47.0%
share of the model's calls
Long / short
0.32
ratio, not a share
Mature calls
1,330
behind the mix

Weekly Model Watch #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC

Consensus

Forecasts are grouped by whether their direction matched or opposed the leave-one-out majority of the other eligible model lines. Claude Fable 5 is scored separately on each group.

ScopeAgree nAgree hit rateDisagree nDisagree hit rateLiftThin or tied
Consensus Watch #1563749.9%425.0%+24.9pp64
Monthly Consensus Watch #32,63048.6%1127.3%+21.3pp362

leave-one-out: matched vs opposed the majority of the other model lines · Consensus Watch #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC — Monthly Consensus Watch #3 · Oct 1-31, 2026 UTC · cutoff Sun 1 Nov 2026 16:00 UTC

Paper trading (scored separately from prediction quality)

What a mechanical paper-trading rule made of Claude Fable 5's forecasts in the same windows. These figures are kept apart from the accuracy and calibration figures above: a model can be well calibrated and unprofitable, or profitable and badly calibrated.

ScopeTradesWin rateNet PnLGross PnLMax drawdown
Weekly Calibration #1570544.1%$46.68$117.18-$59.80
Monthly Calibration #33,00338.8%-$271.41$28.89-$282.31

Weekly Calibration #15 · Nov 9-15, 2026 UTC · cutoff Mon 16 Nov 2026 16:00 UTC — Monthly Calibration #3 · Oct 1-31, 2026 UTC · cutoff Sun 1 Nov 2026 16:00 UTC

Published history

Every window Claude Fable 5's slot has been published in, oldest first. Model Watch supplies the count, the hit rate, the interval and the rank; Calibration adds Brier, the gap and the mean stated confidence. The cadences are separate tables because a quarter, a month and a week are different windows over the same forecasts, and a window an older issue also filed under a superseded id keeps that reading on its own line: no issue published the two as one figure.

Weekly windows

15 published windows, from Aug 3-9, 2026 UTC to Nov 9-15, 2026 UTC
IssueWindownHit rate95% WilsonRankBrierGapMean stated conf.
#1 · Model Watch · CalibrationAug 3-9, 2026 UTC64241.4%[37.7%, 45.3%]#70.2811+19.2pp60.7%
#2 · Model Watch · CalibrationAug 10-16, 2026 UTC47241.7%[37.4%, 46.2%]#60.2782+18.1pp59.8%
#3 · Model Watch · CalibrationAug 17-23, 2026 UTC77956.5%[53.0%, 59.9%]#20.2464+4.7pp61.2%
#4 · Model Watch · CalibrationAug 24-30, 2026 UTC65143.0%[39.3%, 46.8%]#30.2799+17.9pp60.9%
#5 · Model Watch · CalibrationAug 31-Sep 6, 2026 UTC62842.8%[39.0%, 46.7%]#30.2795+17.9pp60.7%
#6 · Model Watch · CalibrationSep 7-13, 2026 UTC62436.5%[32.9%, 40.4%]#60.2921+23.6pp60.1%
#7 · Model Watch · CalibrationSep 14-20, 2026 UTC79952.3%[48.9%, 55.8%]#20.2593+9.1pp61.4%
#8 · Model Watch · CalibrationSep 21-27, 2026 UTC73646.7%[43.2%, 50.3%]#50.2692+14.7pp61.4%
#9 · Model Watch · CalibrationSep 28-Oct 4, 2026 UTC62349.9%[46.0%, 53.8%]#40.2630+11.1pp61.0%
#10 · Model Watch · CalibrationOct 5-11, 2026 UTC61345.0%[41.1%, 49.0%]#20.2714+14.9pp59.9%
#11 · Model Watch · CalibrationOct 12-18, 2026 UTC70445.6%[41.9%, 49.3%]#70.2714+14.4pp60.0%
#12 · Model Watch · CalibrationOct 19-25, 2026 UTC76856.4%[52.8%, 59.9%]#50.2486+4.5pp60.9%
#13 · Model Watch · CalibrationOct 26-Nov 1, 2026 UTC63340.4%[36.7%, 44.3%]#70.2835+20.1pp60.5%
#14 · Model Watch · CalibrationNov 2-8, 2026 UTC60242.5%[38.6%, 46.5%]#70.2769+17.6pp60.1%
#15 · Model Watch · CalibrationNov 9-15, 2026 UTC70548.5%[44.8%, 52.2%]#40.2622+10.7pp59.2%

Monthly windows

3 published windows, from Aug 1-31, 2026 UTC to Oct 1-31, 2026 UTC
IssueWindownHit rate95% WilsonRankBrierGapMean stated conf.
#1 · Model Watch · CalibrationAug 1-31, 2026 UTC2,81246.7%[44.9%, 48.6%]#30.2689+13.9pp60.6%
#2 · Model Watch · CalibrationSep 1-30, 2026 UTC2,94545.4%[43.6%, 47.2%]#30.2733+15.6pp61.0%
#3 · Model Watch · CalibrationOct 1-31, 2026 UTC3,00348.2%[46.4%, 50.0%]#70.2661+12.3pp60.5%

Quarterly windows

1 published window: Jul 15-Sep 30, 2026 UTC
IssueWindownHit rate95% WilsonRankBrierGapMean stated conf.
#1 · Model Watch · CalibrationJul 15-Sep 30, 2026 UTC8,44745.5%[44.5%, 46.6%]#30.2722+15.1pp60.7%

Each figure is the one its issue froze.

Definitions & method

Quoted from the issues these figures come from.

  • Hit. direction: exit tp1/tp2 -> hit, sl -> miss, expiry -> sign of gross pnl
  • Reading the hit rate. Hit rate follows the benchmark's TP/SL/expiry outcome rules; it is not simply the asset's price direction at the end of the forecast horizon. The weekly and monthly metrics shown here use the 1h, 4h and 1d horizons; stability runs have their own test coverage.
  • Scored pool. directional forecasts resolved inside the FH gate (1h/4h/1d) since Jul 11, at the issue cutoff
  • Gap and Brier. Gap pp = mean stated confidence minus hit-rate, in percentage points; positive means overconfident.
  • Coverage. calls scored divided by the mature calls available to that model
  • Confidence buckets. Models report confidence at discrete levels, not a continuous scale; the buckets reflect those natural breakpoints. Cells below N=10 are marked insufficient.
  • Wilson intervals. 95% Wilson CIs shown are descriptive, not inferential: observations inside one window are dependent, so read them as a range, not a formal coverage guarantee.
  • Weekly title. >=5pp gap AND non-overlapping 95% CI, N>=10
  • Paper trading. A mechanical simulation on Binance USDT-M futures, scored separately from prediction quality and reported on its own. The starting bank, the per-trade notional and the taker fee are set out on Benchmarks methodology.

Methodology v1.1 (2026-08-10) · hash e66c7e8c864a2233 · Methodology · Benchmarks methodology · Dataset