Repository · Full text

Minimax Calibration Distance under Simultaneous Play

Read PDF

HTML version 1 Added

Papers are listed without authors and are not intended for submission or formal publication.

Contents

Minimax Calibration Distance under Simultaneous Play

Abstract

We establish the Θ⁡(T) minimax rate of calibration distance in sequential binary prediction under simultaneous play. This closes the lower-bound exponent gap posed by Qiao and Zheng [13], from Ω⁡(T1/3) to Ω⁡(T), for behavioral-kernel randomized forecasters against deterministic past-adaptive adversaries. The adversary may use past forecasts and outcomes but cannot observe the current private forecast. Calibration distance is the total ℓ1 change needed to make the forecast sequence perfectly calibrated in hindsight. For every T≥2, every such forecaster incurs expected distance at least T/4320, while a deterministic algorithm guarantees distance below T on every outcome path. For deterministic forecasters, one fixed outcome string also forces Ω⁡(T) distance. The upper bound improves the explicit 2⁢T+1 guarantee of Arunachaleswaran et al. [1]. Its shifted-grid construction admits exact integer optimization and O⁡(log⁡(T+1)) worst-case time per round in the word-RAM model. Restarting gives a horizon-free bound below (2+2)⁢T for every prefix, using O⁡(T) memory. The lower bound combines a mean-reverting adversary, Lipschitz calibration witnesses, and martingale fluctuations; averaging then fixes a deterministic adversary. Together, these results determine the minimax exponent in the stated simultaneous-play model. The randomized-forecaster rate against a fixed outcome string remains open.

Note. This paper was generated entirely by AI, including MiMo, using an automated research pipeline developed by Chenghua Liu and Hanyu Li.

1 Introduction

Calibration asks that among rounds assigned probability z, the event occur with frequency z. This foundational criterion in sequential prediction [5, 8] is commonly measured by cumulative unbinned ℓ1 calibration error (ECE). ECE is discontinuous in the forecasts: an arbitrarily small perturbation can split a bin and change the score sharply. Deterministic self-calibration is impossible in the revealed-forecast setting [10], whereas randomized calibration follows from approachability and minimax arguments [8, 6].

Błasiok, Gopalan, Hu, and Nakkiran proposed the ℓ1 distance to a nearest perfectly calibrated sequence as a continuous calibration measure [2]. Qiao and Zheng initiated its sequential study and proved expected upper and lower bounds of O⁡(T) and Ω⁡(T1/3), respectively [13]. Arunachaleswaran, Collina, Roth, and Shi later gave an explicit deterministic pathwise bound 2⁢T+1 [1].

Our results.

We close the exponent gap for the behavioral-kernel randomized model against a deterministic past-adaptive adversary. The two players act simultaneously: the adversary knows the forecasting strategy and public history but not the current private draw. Every forecaster incurs expected calibration distance at least T/4320. For deterministic forecasters, specializing the construction gives the companion result that one fixed outcome string, chosen after the rule, forces distance at least T/1200.

Our upper bound is deterministic and holds on every outcome path, so it matches the order of both lower bounds. It also improves the leading constant in the known explicit construction from 2 to 1. We optimize its finite-horizon grid exactly, reduce its implementation time from a naive O⁡(T) scan to O⁡(log⁡(T+1)) worst-case time per round. Building on the restart framework of Collina et al. [3], block subadditivity yields a horizon-free guarantee with the explicit constant 2+2 for all prefixes of the same run.

Proof ideas.

For the lower bound, the witness f0⁢(u)=1/2−u charges the mean deviation and conditional forecast variance under an auxiliary mean-reverting Bernoulli adversary. Low expected energy leaves a square-root martingale fluctuation after controlling the drift; averaging then fixes one adversary tape. For the upper bound, shifted grid biases control an outcome-dependent proxy, and Lipschitz stability transfers this control to the announced forecasts.

2 Protocols and main results

This section defines the loss and the two information structures used in the paper, then states the matching minimax bounds. All measurable spaces below carry their Borel sigma-fields.

2.1 Calibration distance

Fix T≥1. For predictions p=(p1,…,pT)∈[0,1]T and binary outcomes y=(y1,…,yT)∈{0,1}T, let

C(y):={r∈[0,1]T:∑t:rt=z(yt−z)=0 for every z∈[0,1]}.(2.1)

Thus r is perfectly calibrated in hindsight. Empty sums are zero. The set is nonempty: the constant sequence rt=T−1⁢∑s=1Tys belongs to C⁡(y). Define the unnormalized calibration distance by

CalDist⁡(p,y):=infr∈C⁡(y)∑t=1T|pt−rt|.(2.2)

The infimum is in fact attained. Every value used by a calibrated sequence is the empirical mean of a nonempty subset of the outcomes, so only finitely many calibrated vectors are possible for fixed y.

For any u∈[0,1]T, let Im⁡(u):={ut:1≤t≤T} denote its set of occupied forecast values. The cumulative unbinned ℓ1 calibration error is

ECE(u,y):=∑z∈Im⁡(u)|∑t:ut=z(yt−z)|.(2.3)

We use cumulative losses throughout. Their normalized versions are

CalDistnorm⁡(p,y):=CalDist⁡(p,y)T,ECEnorm⁡(u,y):=ECE⁡(u,y)T.

2.2 Simultaneous and oblivious protocols

Before round t, the public history belongs to

Ht−1:=([0,1]×{0,1})t−1,ht−1=((ps,ys))s<t.

A behavioral-kernel forecaster is a collection of Borel probability kernels Kt,T⁢(⋅∣h) from Ht−1 to [0,1] and draws Pt∼Kt,T⁢(⋅∣ht−1). These public-history kernels, without additional persistent private state, are the randomized strategy class considered in this paper. A deterministic adaptive adversary consists of Borel-measurable maps

At,T:Ht−1→{0,1},Yt=At,T⁢(ht−1).

The two actions are simultaneous: At,T does not observe the realized Pt. For fixed K and A, the transition kernel

Kt,T⁢(d⁢p∣h)⁢δAt,T⁢(h)⁢(d⁢y)

recursively induces a unique trajectory law, denoted PK,A, with expectation EK,A. This is the finite-horizon Ionescu–Tulcea construction. The loss CalDist⁡(P,Y) is bounded and Borel measurable, so the expectation below is well defined. We set

VTrand,ad:=infKsupAEK,A⁢[CalDist⁡(P,Y)].(2.4)

The expectation is over the forecaster’s private randomization. Both players may know T, and the adversary knows K but not the current private draw. The lower bound below exhibits a deterministic adversary in the stated class.

For the companion oblivious result, a deterministic forecaster consists of maps

Ft,T:{0,1}t−1→[0,1],pt=Ft,T⁢(y1,…,yt−1).

Write pF⁢(y) for its path on y and set

VTdet,obl:=infFsupy∈{0,1}TCalDist⁡(pF⁢(y),y).(2.5)

Because the current prediction is determined by the past, allowing a past-adaptive adversary does not change the worst-case value in (2.5). For later comparison, if y is fixed and K is randomized, then PK⁢(y) denotes the random path obtained recursively by sampling Pt∼Kt,T⁢(⋅∣((Ps,ys))s<t); its law contains only the forecaster’s randomization.

2.3 Main minimax theorem

The next theorem closes the exponent gap in both stated protocols. The same pathwise construction supplies their upper bounds.

For m∈Z≥1, write

gT⁢(m):=T2⁢m+m−12,UT:=minm∈Z≥1⁡gT⁢(m).(2.6)
Theorem 2.1 (Square-root minimax rate).

For every integer T≥2,

14320⁢T≤VTrand,ad≤UT<T,(2.7)
11200⁢T≤VTdet,obl≤UT<T.(2.8)

An integer minimizer in (2.6) is

mT∗=⌈4⁢T+1−12⌉.(2.9)

For T=1, both minimax values equal 1/2.

Consequently, VTrand,ad/T,VTdet,obl/T=Θ(T−1/2). The upper algorithm is deterministic and pathwise, and hence works against arbitrary outcome generation, including an adversary that sees the current forecast.

Restarting this finite-horizon construction gives a single algorithm for all prefixes. The following corollary records the constant and implementation cost proved in Section 7.

Corollary 2.2 (Horizon-free guarantee).

There is a single deterministic forecaster, independent of the terminal horizon, such that for every infinite outcome sequence and every prefix T≥1,

CalDist(p1:T,y1:T)<(2+2)T.(2.10)

In the word-RAM model of Proposition 6.5, with word size Ω⁡(log⁡(T+1)), it uses O⁡(log⁡(T+1)) time per round and O⁡(T) memory at time T.

Remark 2.3 (The remaining quantifier order).

For a randomized forecaster against a fixed string, define

VTrand,obl:=infKsupy∈{0,1}TE⁡[CalDist⁡(PK⁢(y),y)].

Fix jointly Borel sampling maps that realize the kernels by inverse transforms, and let W=(W1,…,WT) have independent Unif⁡[0,1] coordinates. For each fixed w, let Fw be the resulting deterministic rule and set L⁡(w,y):=CalDist⁡(pFw⁢(y),y). The deterministic result bounds EW⁢[supyL⁡(W,y)]. The displayed value instead requires control of supyEW⁢[L⁡(W,y)], and these two operations cannot be exchanged in this direction. Conversely, the adversary for (2.7) depends on past realized forecasts and is not a fixed string. Thus VTrand,obl remains open.

3 Related work

We separate the closest work on calibration distance from results for the discontinuous ECE objective. This distinction is essential because the two losses support different lower-bound mechanisms.

Classical sequential calibration.

Dawid’s formulation of calibrated probability assessment [5] was followed by Oakes’s deterministic impossibility [10] and randomized calibration via approachability [8, 6]. In our simultaneous protocol, a deterministic rule’s current output is known from the public history; choosing yt=1{pt<1/2} gives ECE⁡(p,y)=∑t|yt−pt|≥T/2. This finite-horizon calculation is ours, not the literal statement of Oakes’s historical theorem.

Kakade and Foster developed deterministic weak calibration [9]; Foster and Hart established deterministic smooth calibration in the leaky protocol, where Nature observes the current forecast [7]. Both differ from the distance studied here.

Distance to calibration.

Błasiok et al. introduced exact ℓ1 distance to calibration and compared it with continuous surrogates [2]. Qiao and Zheng transferred the metric to sequential prediction and proved an expected O⁡(T) upper bound and an Ω⁡(T1/3) lower bound using i.i.d. Bernoulli⁡(1/2) outcomes with adaptive stopping [13]. Without stopping, the same paper gives expected O⁡(log3/2⁡T) distance against i.i.d. fair bits, so ordinary sampling noise alone cannot prove a square-root lower bound. Their work also records the standard comparison CalDist≥smCE/2 used below.

Arunachaleswaran et al. gave an elementary deterministic predictor with pathwise distance at most 2⁢T+1 [1]. Collina et al. already used doubling for a horizon-free pathwise O⁡(T) guarantee [3]. Our upper-bound contributions are the improved leading constant, exact integer-grid optimization, explicit anytime constant, and worst-case implementation. Post-hoc computation and estimation are studied by Qiao [11].

The discontinuous ECE objective.

The sequential ECE landscape is different. Qiao and Valiant introduced sidestepping and proved an expected Ω⁡(T0.528) lower bound in the revealed-forecast protocol [12]. Dagan et al. gave a randomized expected O⁡(T2/3−ε) upper bound for some ε>0 and an Ω⁡(T0.54389) lower bound for an oblivious distribution over outcome strings [4]; Zhang later gave an efficient randomized forecaster with expected O⁡(T2/3−ε) ECE for some ε>0 [14]. These results neither imply nor contradict ours: CalDist≤ECE on every path, so an ECE lower bound does not lower-bound calibration distance. Lipschitz stability enables our proxy comparison, while the shifted-bias invariant supplies the pathwise proxy control.

4 Calibration witnesses

The following elementary inequality is the interface between calibration distance and the lower-bound process.

Lemma 4.1 (Witness comparison).

For every integer T≥1, p∈[0,1]T, y∈{0,1}T, and Lipschitz f:[0,1]→R, let L:=Lip⁡(f) be its least Lipschitz constant and B:=‖f‖∞. Then

|∑t=1Tf⁡(pt)⁢(yt−pt)|≤(L+B)⁢CalDist⁡(p,y).(4.1)

Consequently,

CalDist⁡(p,y)≥|∑t=1T(yt−pt)|,(4.2)
CalDist⁡(p,y)≥23⁢|∑t=1T(1/2−pt)⁢(yt−pt)|.(4.3)
Proof.

Fix r∈C⁡(y). Calibration and grouping by the distinct values of r imply

∑t=1Tf⁡(rt)⁢(yt−rt)=0.

Consequently,

∑t=1Tf⁡(pt)⁢(yt−pt)=∑t=1T(f⁡(pt)−f⁡(rt))⁢(yt−pt)+∑t=1Tf⁡(rt)⁢(rt−pt).

Because |yt−pt|≤1, the absolute value of the right-hand side is at most

(L+B)⁢∑t=1T|pt−rt|.

Taking the infimum over r∈C⁡(y) proves (4.1). The choice f≡1 has (L,B)=(0,1) and gives (4.2); the choice f⁡(u)=1/2−u has (L,B)=(1,1/2) and gives (4.3). ∎

For comparison with prior work, let

F1:={f:[0,1]→[−1,1]:Lip(f)≤1}

and define the cumulative smooth calibration error

smCE⁡(p,y):=supf∈F1∑t=1Tf⁡(pt)⁢(yt−pt).(4.4)

The class is closed under negation. Thus Lemma 4.1 recovers the standard comparison [13]

CalDist⁡(p,y)≥12⁢smCE⁡(p,y).(4.5)

The witness-specific constants in (4.2) and (4.3), rather than the coarser factor in (4.5), materially improve the finite-horizon lower bounds below.

5 The square-root lower bounds

We first prove the randomized-adaptive statement by analyzing an auxiliary randomized adversary and then fixing its tape. Specializing the construction gives the companion fixed-string result for deterministic forecasters.

5.1 Randomized forecasters against adaptive adversaries

The next theorem supplies the lower half of (2.7). Its adversary uses the public history and the known kernel, but never the current realized forecast.

Theorem 5.1 (Randomized simultaneous lower bound).

For every integer T≥2 and every Borel behavioral-kernel forecaster K defined in Section 2, there is a Borel-measurable deterministic past-adaptive adversary A that does not observe the current forecast and satisfies

EK,A⁢CalDist⁡(P,Y)≥14320⁢T.(5.1)
Proof.

The proof first obtains the bound under an auxiliary randomized adversary, using an energy split and a martingale residual, and then fixes the auxiliary tape. Fix K. For every h∈Ht−1, define the history functions

μ¯t⁢(h):=∫[0,1]p⁢Kt,T⁢(dp∣h),(5.2)
v¯t⁢(h):=∫[0,1](p−μ¯t⁢(h))2⁢Kt,T⁢(dp∣h).

Set sgn⁡(0):=0 and

a:=⌈12⁢log4⁢T⌉,ϵ¯t⁢(h):=μ¯t⁢(h)−12,(5.3)
d¯t⁢(h):=sgn⁡(ϵ¯t⁢(h))⁢|ϵ¯t⁢(h)|a,q¯t⁢(h):=μ¯t⁢(h)−d¯t⁢(h).

The logarithmic choice of a balances the mean-reversion drift and the martingale fluctuation at the square-root scale. Since a≥1, q¯t⁢(h) lies between μ¯t⁢(h) and 1/2; all these history functions are Borel measurable.

For the analysis, use the joint transition kernel

Kt,T⁢(d⁢p∣h)⁢Bernoulli⁡(q¯t⁢(h))⁢(d⁢y).(5.4)

Write P⋆ and E⋆ for the induced law and expectation. Under this law, Pt and Yt are conditionally independent given the pre-round history. Define the history random variable, its filtration, and the realized quantities by

Ht−1:=((Ps,Ys))s<t,Ht−1:=σ⁡(Ht−1),
μt:=μ¯t⁢(Ht−1),vt:=v¯t⁢(Ht−1),ϵt:=ϵ¯t⁢(Ht−1),dt:=d¯t⁢(Ht−1),qt:=q¯t⁢(Ht−1).

Thus μt=E⋆⁢[Pt∣Ht−1] and vt=Var⋆⁡(Pt∣Ht−1). Define the sum of predictable energy increments by

G:=∑t=1T(|ϵt|a+1+vt).(5.5)

Energy identity.

For f0⁢(u)=1/2−u, conditional independence and (5.3) give

E⋆⁢[f0⁢(Pt)⁢(Yt−Pt)∣Ht−1]=E⋆⁢[(1/2−Pt)⁢(qt−Pt)∣Ht−1]
=(1/2−μt)⁢(qt−μt)+vt
=|ϵt|a+1+vt.(5.6)

Applying (4.3), Jensen’s inequality, and the tower property yields

E⋆⁢CalDist⁡(P,Y)≥23⁢E⋆⁢|∑t=1Tf0⁢(Pt)⁢(Yt−Pt)|≥23⁢E⋆⁢G.(5.7)

Put

R:=T(a−1)/(2⁢a)=TT−1/(2a),14T≤R≤T.(5.8)

With c0:=1/720, the case E⋆⁢G≥c0⁢R follows from (5.7) and (5.8) because

E⋆⁢CalDist⁡(P,Y)≥23⁢c0⁢R≥14320⁢T.(5.9)

It remains to assume E⋆⁢G<c0⁢R. Call round t bad when |ϵt|>1/4, and let Nbad be the number of such rounds. Since Nbad≤4a+1⁢∑t|ϵt|a+1 and 4a+1≤16⁢T, (5.8) gives

E⋆⁢Nbad<T/45.(5.10)

On every other round, qt⁢(1−qt)≥3/16.

Define

ζt:=(Yt−qt)−(Pt−μt),Z:=∑t=1Tζt,D:=∑t=1Tdt.(5.11)

Conditional independence gives E⋆⁢[ζt∣Ht−1]=0, so the ζt are martingale differences. It also gives

E⋆⁢[ζt2∣Ht−1]=qt⁢(1−qt)+vt.(5.12)

Martingale orthogonality and (5.10) imply

E⋆⁢Z2≥316⁢(T−E⋆⁢Nbad)≥1160⁢T.(5.13)

Each of the two centered summands in ζt has conditional support in an interval of length one. Conditional Hoeffding, tail integration, and moment interpolation therefore give

E⋆⁢|Z|≥12⁢(1160)3/2⁢T.(5.14)

Hölder and Jensen, together with the exponent identity 1/(a+1)+(a/(a+1))⁢(a−1)/(2⁢a)=1/2, give

E⋆⁢|D|≤1720⁢T.(5.15)

The complete moment and drift calculations appear in Section A.1.

Finally, qt−μt=−dt, so

∑t=1T(Yt−Pt)=Z−D.(5.16)

By (4.2), (5.14), and (5.15),

E⋆⁢CalDist⁡(P,Y)≥E⋆⁢|Z−D|
≥[12⁢(1160)3/2−1720]⁢T>14320⁢T.(5.17)

An exact check of the final strict inequality is given in Section A.2.

Removing adversary randomization.

Realize (5.4) with independent uniforms W1,…,WT by setting Yt=1{Wt≤q¯t(Ht−1)}. For every fixed tape w∈[0,1]T, the maps

At,Tw(h):=1{wt≤q¯t(h)}

form a Borel-measurable deterministic past-adaptive adversary and do not use the current forecast. By Fubini’s theorem, the average over w of EK,Aw⁢CalDist⁡(P,Y) is the auxiliary expected loss just bounded. Hence some fixed w satisfies (5.1). This is an existence argument and does not give an efficient procedure for finding the good tape. ∎

The construction respects simultaneous play because it uses the known conditional law of Pt, never its current realization. The variance term in (5.6) is what permits this distinction.

5.2 A companion deterministic fixed-string bound

When the forecaster is deterministic, forecast innovation vanishes. The same construction can then use a larger energy threshold and yields a better constant, although the two theorems concern different strategy classes.

Theorem 5.2 (Deterministic oblivious lower bound).

For every integer T≥2 and deterministic nonanticipating forecaster F, there is a fixed string y∈{0,1}T such that

CalDist⁡(pF⁢(y),y)≥11200⁢T.(5.18)
Proof.

We specialize the preceding energy split and then use the probabilistic method to fix one outcome string. Run the auxiliary construction from the proof of Theorem 5.1, retaining the definitions of a,R,G,D,Nbad,ϵt,dt, and qt. Under its auxiliary law, Pt=Ft,T⁢(Y<t)=μt almost surely and vt=0. Use the larger threshold c0=1/200. If E⋆⁢G≥c0⁢R, then (5.7) and (5.8) give

E⋆⁢CalDist⁡(pF⁢(Y),Y)≥23⁢c0⁢R≥11200⁢T.(5.19)

Suppose instead that E⋆⁢G<c0⁢R, and put Z:=∑t(Yt−qt). The bad-round calculation now gives

E⋆⁢Nbad<2⁢T25,E⋆⁢Z2≥69400⁢T,E⋆⁢Z4≤T2.(5.20)

Thus interpolation gives E⋆⁢|Z|≥(69/400)3/2⁢T, while the drift calculation gives E⋆⁢|D|≤T/200. Therefore

E⋆⁢CalDist⁡(pF⁢(Y),Y)≥[(69400)3/2−1200]⁢T>11200⁢T.(5.21)

The calculations and exact strict inequality are verified in Section A.3.

For fixed F, the auxiliary recursion defines a probability law on the finite set {0,1}T. In either energy branch,

maxy∈supp⁡(Y)⁡CalDist⁡(pF⁢(y),y)≥E⋆⁢CalDist⁡(pF⁢(Y),Y).

Thus one fixed string satisfies (5.18). This string is chosen after F but before play, exactly as required by (2.5). ∎

For T=1, perfect calibration forces the comparison sequence to equal the single outcome. A deterministic forecast p therefore has worst-case distance max⁡{p,1−p}. For a randomized forecast P, the two deterministic adversary choices give worst-case expected distance max⁡{E⁢P,1−E⁢P}≥1/2. The constant forecast P=1/2 attains equality in both models, proving the T=1 assertion in Theorem 2.1.

6 An exactly optimized deterministic upper bound

We now give the common upper bound in Theorem 2.1. The construction is a shifted-bias refinement of the grid-proxy method of Arunachaleswaran et al. [1]. The proxy p~t is assigned only after observing yt. It is internal state, not the forecast announced on round t.

Fix m∈Z≥1 and let xj=j/m for j=0,…,m. The algorithm maintains post-outcome proxies p~s; initially all proxy biases are zero. After rounds 1,…,t−1, define

bt−1,j:=∑s<t:p~s=xj(xj−ys),βt−1,j:=bt−1,j+xj−12.(6.1)

The algorithm chooses the first nonnegative shifted bias, announces the midpoint of the adjacent grid points, and then assigns the proxy according to the outcome:

jt:=min⁡{j∈{0,…,m}:βt−1,j≥0},it:=jt−1,(6.2)
pt:=xit+xjt2,(6.3)
p~t:={xit,yt=0,xjt,yt=1.(6.4)

The unshifted endpoint biases remain zero: coordinate 0 is updated only after outcome 0, and coordinate m only after outcome 1. Hence βt−1,0=−1/2, βt−1,m=1/2, so 1≤jt≤m and

βt−1,it<0≤βt−1,jt.(6.5)

No monotonicity of the bias vector is assumed. Finally, all state before round t is a deterministic function of y<t, so the announced forecast is nonanticipating.

The following invariant bounds every proxy-bin residual and will therefore control the proxy ECE.

Lemma 6.1 (Shifted-bias invariant).

Under the construction (6.1)–(6.4), for every t∈{0,…,T} and j∈{0,…,m},

xj−1≤βt,j≤xj,equivalently−12≤bt,j≤12.(6.6)
Proof.

Initially β0,j=xj−1/2∈[xj−1,xj]. Suppose the invariant holds before round t. If yt=0, only coordinate it changes, and its shifted bias increases by xit. By (6.5), its new value lies in

[2⁢xit−1,xit]⊆[xit−1,xit].

If yt=1, only coordinate jt changes, and its shifted bias increases by xjt−1. Its new value lies in

[xjt−1,2⁢xjt−1]⊆[xjt−1,xjt].

All other coordinates are unchanged, completing the induction. ∎

We next transfer the proxy’s ECE control to the forecasts announced online. The first inequality is the Lipschitz stability of distance to a fixed set; the second supplies the required calibrated comparator.

Lemma 6.2 (Proxy comparison).

For every integer T≥1, u,p∈[0,1]T, and y∈{0,1}T,

|CalDist⁡(p,y)−CalDist⁡(u,y)|≤∑t=1T|pt−ut|,(6.7)
CalDist⁡(p,y)≤∑t=1T|pt−ut|+ECE⁡(u,y).(6.8)
Proof.

Distance to a fixed nonempty subset of a normed space is 1-Lipschitz. Since CalDist⁡(p,y) is the ℓ1-distance from p to C⁡(y), the triangle inequality gives (6.7).

For the second claim, for every z∈Im⁡(u) define

y¯z:=1|{t:ut=z}|∑t:ut=zyt,rt:=y¯ut.

Within every original u-bin, the residuals yt−rt sum to zero. If two or more such bins receive the same value of rt, their zero residual sums simply merge, so r∈C⁡(y). Moreover,

∑t=1T|ut−rt|=∑z∈Im⁡(u)|{t:ut=z}|⁢|z−y¯z|
=∑z∈Im⁡(u)|∑t:ut=z(z−yt)|=ECE(u,y).

Thus CalDist⁡(u,y)≤ECE⁡(u,y); combining this inequality with (6.7) proves (6.8). ∎

Combining the invariant with the proxy comparison yields the fixed-grid guarantee used by both upper bounds.

Proposition 6.3 (Finite-horizon pathwise bound).

For every integer T≥1 and m∈Z≥1, the construction (6.1)–(6.4) satisfies, on every outcome sequence,

CalDist⁡(p,y)≤gT⁢(m)=T2⁢m+m−12.(6.9)
Proof.

The invariant gives ECE⁡(p~,y)=∑j=0m|bT,j|≤(m−1)/2, since both unshifted endpoint biases vanish. Also ∑t|pt−p~t|=T/(2⁢m), so (6.8) proves the claim. ∎

Optimizing the grid over positive integers gives the advertised leading constant without changing the pathwise guarantee.

Corollary 6.4 (Exact grid optimization).

For every integer T≥1, the integer mT∗ in (2.9) minimizes gT. Let m¯:=⌈T⌉ and δ:=m¯−T∈[0,1). Then

UT≤gT⁢(m¯)=T−12+δ22⁢m¯<T.(6.10)
Proof.

For m≥1,

gT⁢(m+1)−gT⁢(m)=m⁡(m+1)−T2⁢m⁢(m+1).

Hence gT decreases until the first positive integer m with m⁡(m+1)≥T and increases thereafter. This proves the formula for mT∗ in (2.9). If mT∗⁢(mT∗+1)=T, then mT∗ and mT∗+1 tie; otherwise mT∗ is the unique minimizer.

Let s:=T, m¯:=⌈s⌉, and δ:=m¯−s. Direct substitution gives

gT⁢(m¯)=s−12+δ22⁢m¯.

Since 0≤δ<1 and m¯≥1,

s−gT⁢(m¯)=m¯−δ22⁢m¯>0,

including when T=1, where δ=0. ∎

The finite-horizon construction also admits an exact implementation with worst-case, rather than amortized, per-round guarantees.

Proposition 6.5 (Efficient exact implementation).

For a fixed m≥1, the algorithm in (6.1)–(6.4) admits O⁡(m) initialization time and memory, followed by O⁡(log⁡(m+1)) worst-case time per round. Its forecasts are represented exactly as rationals. All stored integers have O⁡(log⁡(m+1)) bits, so these bounds hold in a word-RAM with word size Ω⁡(log⁡(m+1)).

The data-structure and exact-arithmetic details are given in Section B.1.

The upper inequalities in Theorem 2.1 follow from Propositions 6.3 and 6.4. With m=mT∗=Θ⁡(T), Proposition 6.5 uses O⁡(log⁡(T+1)) worst-case time per round and O⁡(T) memory.

7 Removing knowledge of the horizon

We combine the required one-sided block property with dyadic restarts, including a truncated final epoch. For an index set I, write pI and yI for the corresponding restrictions.

Lemma 7.1 (Block subadditivity).

For every integer T≥1, p∈[0,1]T, and y∈{0,1}T, let I1,…,IK be a partition of {1,…,T} into nonempty consecutive blocks. Then

CalDist⁡(p,y)≤∑k=1KCalDist⁡(pIk,yIk).(7.1)
Proof.

Concatenate blockwise minimizers; their calibration residuals sum to zero and their ℓ1 costs add. ∎

Proof of Corollary 2.2.

Use dyadic epochs Ik:={2k,…,2k+1−1} of length Lk:=2k, resetting the finite-horizon algorithm with m=mLk∗. For a prefix T, let kT:=⌊log2⁡T⌋ and let the last block be JkT:={2kT,…,T}, of length n≤LkT. Applying the fixed-grid proof to this truncated block and Lemma 7.1 to the full prefix gives

CalDist(p1:T,y1:T)≤∑k<kTLk+n2⁢mLkT∗+mLkT∗−12
≤∑k=0kT2k
=(2+2)⁢2kT/2−(1+2)<(2+2)⁢T.(7.2)

For the runtime bound, during an epoch of length L the algorithm schedules the O⁡(m2⁢L∗)=O⁡(L) initialization work for the next epoch across the current L rounds. At the boundary it swaps the prepared roots in O⁡(1) time and retires the old epoch arena without traversing it. The arena sizes form a geometric sum of order O⁡(T), while current-epoch operations have the worst-case cost in Proposition 6.5. The node-reuse and retirement details are in Section B.2. ∎

8 Discussion and open directions

Two limitations remain after closing the exponent gap. The leading minimax constants are open, and the randomized-oblivious value in Remark 2.3 is unresolved because our averaging argument does not produce one seed-independent hard string. The result is otherwise scoped to binary, context-free forecasting and the behavioral-kernel class of Section 2; its randomized lower bound is in expectation and uses a kernel-dependent adversary. It concerns continuous distance to an exactly calibrated sequence in hindsight, not discontinuous ECE, and therefore does not resolve the separate ECE exponent problem.

References

  • [1] E. R. Arunachaleswaran, N. Collina, A. Roth, and M. Shi. An elementary predictor obtaining 2⁢T+1 distance to calibration. In Proceedings of the 2025 Annual ACM–SIAM Symposium on Discrete Algorithms (SODA), pages 1366–1370, 2025. doi:10.1137/1.9781611978322.41. Extended version: arXiv:2402.11410.
  • [2] J. Błasiok, P. Gopalan, L. Hu, and P. Nakkiran. A unifying theory of distance from calibration. In Proceedings of the 55th Annual ACM Symposium on Theory of Computing (STOC), pages 1727–1740, 2023. doi:10.1145/3564246.3585182. Extended version: arXiv:2211.16886.
  • [3] N. Collina, S. Goel, V. Gupta, and A. Roth. Tractable agreement protocols. In Proceedings of the 57th Annual ACM Symposium on Theory of Computing (STOC), pages 1532–1543, 2025. doi:10.1145/3717823.3718222. Extended version: arXiv:2411.19791.
  • [4] Y. Dagan, C. Daskalakis, M. Fishelson, N. Golowich, R. Kleinberg, and P. Okoroafor. Breaking the T2/3 barrier for sequential calibration. In Proceedings of the 57th Annual ACM Symposium on Theory of Computing (STOC), pages 2007–2018, 2025. doi:10.1145/3717823.3718178.
  • [5] A. P. Dawid. The well-calibrated Bayesian. Journal of the American Statistical Association, 77(379):605–610, 1982. doi:10.1080/01621459.1982.10477856.
  • [6] D. P. Foster. A proof of calibration via Blackwell’s approachability theorem. Games and Economic Behavior, 29(1–2):73–78, 1999. doi:10.1006/game.1999.0719.
  • [7] D. P. Foster and S. Hart. Smooth calibration, leaky forecasts, finite recall, and Nash dynamics. Games and Economic Behavior, 109:271–293, 2018. doi:10.1016/j.geb.2017.12.022.
  • [8] D. P. Foster and R. V. Vohra. Asymptotic calibration. Biometrika, 85(2):379–390, 1998. doi:10.1093/biomet/85.2.379.
  • [9] S. M. Kakade and D. P. Foster. Deterministic calibration and Nash equilibrium. Journal of Computer and System Sciences, 74(1):115–130, 2008. doi:10.1016/j.jcss.2007.04.017.
  • [10] D. Oakes. Self-calibrating priors do not exist. Journal of the American Statistical Association, 80(390):339, 1985. doi:10.1080/01621459.1985.10478117.
  • [11] M. Qiao. Computational and statistical hardness of calibration distance. arXiv:2603.18391, 2026.
  • [12] M. Qiao and G. Valiant. Stronger calibration lower bounds via sidestepping. In Proceedings of the 53rd Annual ACM Symposium on Theory of Computing (STOC), pages 456–466, 2021. doi:10.1145/3406325.3451050.
  • [13] M. Qiao and L. Zheng. On the distance from calibration in sequential prediction. In Proceedings of the 37th Conference on Learning Theory (COLT), volume 247 of Proceedings of Machine Learning Research, pages 4307–4357, 2024. Proceedings version; arXiv:2402.07458.
  • [14] Z. Zhang. Efficient sequential calibration with O⁡(T2/3−ε) error bound. arXiv:2607.12928, 2026.

Appendix A Deferred lower-bound details

This appendix supplies the deferred moment calculations and elementary exact comparisons used for the lower-bound constants.

A.1 Moment and drift calculations for the randomized lower bound

We work in the small-energy branch E⋆⁢G<c0⁢R with c0=1/720. The definition of a bad round gives the pathwise inequality

Nbad≤4a+1⁢∑t=1T|ϵt|a+1.

The choice of a implies 4a+1≤16⁢T. Therefore, using R≤T,

E⋆⁢Nbad<16⁢T⁢c0⁢R≤16⁢c0⁢T=T45.(A.1)

On a nonbad round, μt∈[1/4,3/4]; since qt lies between μt and 1/2, this gives qt⁢(1−qt)≥3/16. Martingale orthogonality and (5.12) now yield

E⋆⁢Z2=∑t=1TE⋆⁢[qt⁢(1−qt)+vt]
≥316⁢(T−E⋆⁢Nbad)≥1160⁢T.(A.2)

Conditionally on Ht−1, each of Yt−qt and −(Pt−μt) is centered and supported on an interval of length one, and the two variables are independent. Conditional Hoeffding’s lemma therefore gives, for every λ∈R,

E⋆⁢[eλ⁢ζt∣Ht−1]≤eλ2/8⁢eλ2/8=eλ2/4.

Iteration and the exponential Markov inequality imply

P⋆(|Z|≥u)≤2e−u2/T(u≥0).(A.3)

Tail integration then gives

E⋆Z4=4∫0∞u3P⋆(|Z|≥u)du≤8∫0∞u3e−u2/Tdu=4T2.(A.4)

The interpolation inequality

E⋆⁢Z2≤(E⋆⁢|Z|)2/3⁢(E⋆⁢Z4)1/3

combined with (A.2) and (A.4) proves

E⋆⁢|Z|≥12⁢(1160)3/2⁢T,

which is (5.14).

For the drift, Hölder’s inequality gives pathwise

|D|≤∑t=1T|ϵt|a≤T1/(a+1)⁢(∑t=1T|ϵt|a+1)a/(a+1).

Jensen’s inequality and ∑t|ϵt|a+1≤G hence give

E⋆⁢|D|≤T1/(a+1)⁢(E⋆⁢G)a/(a+1)
<c0a/(a+1)⁢T1/(a+1)⁢Ra/(a+1)≤c0⁢T.(A.5)

Here a/(a+1)≥1/2, c0<1, and

1a+1+aa+1⁢a−12⁢a=12.

This proves (5.15).

A.2 Exact randomized constant

The bracket in (5.17) equals

11⁢165−60⁢53600.

Since 165>64/5 and 5<9/4, it is strictly larger than 29/18000, which in turn is larger than 1/4320.

A.3 Details for the deterministic companion bound

In the small-energy branch with c0=1/200, the calculation in (A.1) instead gives

E⋆⁢Nbad<16⁢c0⁢T=2⁢T25.(A.6)

Here Pt=μt almost surely, so Z=∑t(Yt−qt) and the conditional variance of its tth increment is qt⁢(1−qt). Thus

E⋆⁢Z2≥316⁢(1−225)⁢T=69400⁢T.(A.7)

Each increment is centered and has conditional support in an interval of length one. Conditional Hoeffding, iteration, and tail integration give

P⋆(|Z|≥u)≤2e−2u2/T,E⋆Z4≤8∫0∞u3e−2u2/Tdu=T2.

The same interpolation inequality therefore yields

E⋆⁢|Z|≥(69400)3/2⁢T.(A.8)

The drift proof in Section A.1, now with c0=1/200, gives E⋆⁢|D|≤T/200. Finally,

(69400)3/2−1200=207⁢69−1200⁢224000.

The elementary bounds 69>83/10 and 2<99/70 make the numerator strictly larger than 207⁢(83/10)−1200⁢(99/70)=1467/70>20. Hence the displayed constant is strictly larger than 20/24000=1/1200, as used in (5.21).

Appendix B Implementation details for the upper bounds

The proofs below supply the data-structure details deferred from the main text.

B.1 Proof of the exact finite-horizon implementation

Proof of Proposition 6.5.

Maintain

St:={j∈{0,…,m}:βt,j≥0}

in a worst-case balanced search tree and maintain the nonzero unshifted biases bt,j in a worst-case balanced dictionary. Initially the latter is empty and

S0={⌈m/2⌉,…,m},

so the tree can be bulk-built from sorted keys in O⁡(m) time. On round t, jt is the minimum key in St−1; the endpoint invariant ensures that this set is nonempty. Only the bias at it or jt changes, so one dictionary entry is updated and at most one key is inserted into or deleted from St−1. Both structures draw node records from fixed O⁡(m) pools and return deleted records to free lists, so repeated zero crossings do not grow the storage. These operations take O⁡(log⁡(m+1)) worst-case time.

For exact arithmetic, store the integer 2⁢m⁢bt,j. The corresponding shifted-bias numerator is

2⁢m⁢βt,j=2⁢m⁢bt,j+2⁢j−m.

An outcome-0 update at coordinate it adds 2⁢it, whereas an outcome-1 update at coordinate jt adds 2⁢(jt−m). The invariant bounds the stored and shifted-bias numerators in magnitude by 2⁢m, so O⁡(log⁡(m+1)) bits suffice. The announced forecast is the exact rational

pt=2⁢jt−12⁢m.

All word operations therefore have constant cost in the stated model. ∎

B.2 Worst-case implementation of the anytime construction

It remains to ensure that restarting at a dyadic boundary does not create an occasional linear-time round. During an epoch of length L, prepare the initial search tree for the next epoch, whose parameter is m2⁢L∗. Its initial key set is sorted and known in advance. A linear-time bulk build can therefore be scheduled as O⁡(1) elementary node and pointer operations on each of the L current rounds. Since m2⁢L∗=O⁡(L), this budget suffices for every sufficiently large epoch; the finitely many initial cases are initialized directly. Allocate each epoch’s search tree and sparse-bias dictionary in a single arena. At an epoch boundary, switch both current roots in O⁡(1) time (the new dictionary root is null) and retire the old arena without traversing it. The scheduled construction also initializes the two fixed-size node pools and their epoch-local free lists, so insertions reuse records rather than accumulating allocations. Retired arenas need not be reclaimed during play: up to any prefix T, their total size is

∑k≤⌊log2⁡T⌋O⁡(2k)=O⁡(T).

The current sparse-bias dictionary is maintained by the balanced-tree method of Proposition 6.5. Thus each round performs O⁡(log⁡(T+1)) worst-case current-epoch work plus O⁡(1) scheduled build work, while all current, future, and retired arenas together use O⁡(T) memory. This establishes the computational claim in Corollary 2.2.