Repository · Full text

Nonminimizing Limits of Noisy Clarke Subgradient Descent

Read PDF

HTML version 1 Added

Papers are listed without authors and are not intended for submission or formal publication.

Contents

Nonminimizing Limits of Noisy Clarke Subgradient Descent

Abstract

We disprove the conjecture of Davis, Drusvyatskiy, and Jiang [11] that generic convergence of noisy subgradient descent to local minima remains valid without subdifferential regularity. Our counterexample is an explicit two-dimensional, nonnegative, coercive, globally Lipschitz, semialgebraic continuous piecewise-affine objective. For every linear tilt in a nonempty open set, every initialization in a fixed positive-area rectangle, and every γ∈(1/2,1), the noisy Clarke-subgradient iterates with steps αk=(k+8)−γ converge almost surely to the origin, which is not a local minimizer. The conclusion holds for every admissible Clarke choice made before the current noise is sampled, under conditionally absolutely continuous perturbations bounded coordinatewise by 10−2. In particular, a fixed Borel selection with independent and identically distributed uniform disk noise satisfies the original stochastic-approximation assumptions and directly falsifies the conjecture; the open bad-tilt set rules out an almost-everywhere guarantee. The limit is Clarke-critical but not limiting-critical, identifying subdifferential convexification as the obstruction. A shrinking pathwise invariant gives an O⁡(αk−1) convergence envelope. Scaling and separable embedding extend the construction to arbitrary finite uniform-noise radii and every dimension at least two. Thus definability, coercivity, generic linear perturbations, and continuous noise do not suffice to guarantee local-minimum convergence for this recursion.

Note. This paper was generated entirely by AI, including MiMo, using an automated research pipeline developed by Chenghua Liu and Hanyu Li.

1 Introduction

Noise is a standard device for avoiding unstable stationary points. For smooth stochastic approximation, classical nonconvergence theorems show that sufficiently excited noise prevents convergence to linearly unstable equilibria [15]. Related results now cover important nonsmooth models, especially weakly convex and convex-composite objectives with active strict saddles [10, 9, 2, 16]. These works support the principle that sufficiently excited stochastic first-order methods should avoid suitably structured saddles.

Davis et al. [11] (DDJ) established this principle for subdifferentially regular definable objectives. Their theorem combines two facts. Generic linear tilts classify limiting-critical points as local minima or active strict saddles, and uniform noise rules out convergence to the latter. They conjectured that the same conclusion remains valid after subdifferential regularity is removed. The issue matters for nonsmooth optimization theory: definability controls geometric complexity, but it does not by itself prevent the Clarke subdifferential from containing convexified vectors absent from the limiting subdifferential.

Throughout, a property holds generically if it holds for Lebesgue-almost every parameter, equivalently on a conull parameter set. A function is tame here when it is definable in a fixed o-minimal structure; every semialgebraic function is tame.

This paper gives a negative answer using a nonnegative, coercive, continuous piecewise-affine function in R2. The failure holds throughout an open set of tilts and for every history-dependent Clarke subgradient chosen before the current perturbation is sampled. Closely related static geometry already appears in Example 2 of Bianchi et al. [2]; the new point is a coercive objective together with a standard noisy recursion that actually converges to the nonminimizing critical point.

Contributions.

The main result combines the following features.

  • •

    Global and variational geometry. The objective and every bad tilt are nonnegative and coercive, while the trapped origin is Clarke-critical but not limiting-critical or locally minimizing.

  • •

    Oracle-robust dynamics. The trap holds for every γ∈(1/2,1), every initialization in a positive-area basin, every pre-noise Clarke oracle, and conditionally absolutely continuous bounded noise. Independence and centering are not used by the invariant.

  • •

    A direct contradiction. A fixed Borel selection, an ordinary differentiability-point initialization, iid uniform disk noise, and the displayed power-law steps satisfy the published assumptions. The open bad-tilt set therefore rules out a conull good-tilt set.

  • •

    A quantitative mechanism and extensions. A three-transition pathwise invariant gives an O⁡(αk−1) envelope. Scaling and separable embedding extend the construction to every finite noise radius and every dimension d≥2; we make no minimal-dimension claim.

Organization.

Section 2 formalizes the target and states the counterexample. Sections 3, 4 and 5 establish its geometry, singular-set avoidance, and pathwise invariant; Section 6 assembles the proof. Section 7 states the finite-radius and higher-dimensional consequences, and Section 8 gives interpretation and comparisons. Technical robustness details and extension proofs are collected after the references in Appendix A.

2 Setup and main result

This section fixes the variational and probabilistic conventions, states the DDJ target with all algorithmic quantifiers bound, and then gives both the oracle-robust theorem and its fixed-selection specialization.

2.1 Subdifferentials and noisy Clarke oracles

For a locally Lipschitz function h:Rd→R, the Fréchet subdifferential is

∂^⁢h⁢(z):={w:lim infu→0u≠0h⁡(z+u)−h⁡(z)−⟨w,u⟩‖u‖2≥0}.

The limiting, or Mordukhovich, subdifferential is

∂h⁡(z):={w:there exist ⁢zi→z,h⁡(zi)→h⁡(z), and ⁢wi→wwith ⁢wi∈∂^⁢h⁢(zi)}.

Writing Dh for the differentiability set of h, the Clarke subdifferential is

∂ch(z):=cl⁢conv{limi→∞∇h(zi):zi→z,zi∈Dh}.

Here cl⁢conv denotes the closed convex hull. These definitions agree with the standard variational-analysis conventions [7, 18]. Adding a C1 function translates all three subdifferentials. Thus, for v∈Rd and hv⁢(z):=h⁡(z)−⟨v,z⟩,

Dhv(z)=Dh(z)−vfor D∈{∂^,∂,∂c}.(2.1)

We use

Crit⁡(h):={z:0∈∂h⁡(z)},Critc⁡(h):={z:0∈∂ch⁡(z)},

for the limiting- and Clarke-critical sets, and LocMin⁡(h) for the set of local minimizers. We call h subdifferentially regular at z when its epigraph is Clarke regular at (z,h⁡(z)) in the standard epigraphical sense of Rockafellar and Wets [18]; for locally Lipschitz functions this implies agreement of the Fréchet, limiting, and Clarke subdifferentials at z. For ρ≥0, the function is locally ρ-weakly convex near z if h+ρ2⁢‖⋅‖22 is convex on some convex neighborhood of z.

Fix a filtered probability space (Ω,F,(Fk)k≥0,P). The sigma-field Fk contains the initialization, all past perturbations, and any oracle randomness used before the perturbation at step k is sampled. For fixed h and v, an admissible pre-noise Clarke oracle is a sequence (wk) such that zk and wk are Fk-measurable and

wk∈∂chv⁢(zk)almost surely.

The perturbation νk and the next iterate are Fk+1-measurable, and νk is sampled after wk. The update for positive step sizes (αk) is

zk+1=zk−αk⁢(wk+νk).(2.2)

A fixed Borel selection sv⁢(z)∈∂chv⁢(z), used through wk=sv⁢(zk), is a special case. No jointly measurable policy family is required: every result below is stated for one fixed measurable oracle process. We write Br⁢(0):={u:‖u‖2≤r} for the closed Euclidean ball centered at zero. The notation Law⁡(X∣Fk) denotes a version of the conditional law of X given Fk, Leb2 denotes two-dimensional Lebesgue measure, and μ≪λ means that μ is absolutely continuous with respect to λ.

2.2 The conjectural target

In arXiv version 2, immediately after their informal main theorem, Davis et al. [11, p. 2] conjecture that its conclusion remains valid without subdifferential regularity. The sentence does not repeat the algorithmic quantifiers, so we state the natural uniform reading explicitly. The fixed-selection specialization below already refutes the conjecture and does not rely on this stronger uniform formulation.

For an algorithmic instance, define the bounded-orbit and local-minimum-limit events

B:={supk≥0‖zk‖2<∞},Lv(h):={∃z⋆∈LocMin(hv):zk→z⋆}.(2.3)

Thus conditional convergence to a local minimizer means P⁡(B∖Lv⁢(h))=0, equivalently P⁡(Bc∪Lv⁢(h))=1.

Target statement 2.1 (Generic convergence without subdifferential regularity).

Let h:Rd→R be locally Lipschitz and definable in a fixed o-minimal structure. Without assuming subdifferential regularity, does there exist a Lebesgue-conull set Gh⊆Rd, fixed independently of subsequent algorithmic choices, with the following property? For every v∈Gh, every Borel Clarke selection, every deterministic initial point, every fixed radius r>0 with iid noise νk∼Unif⁡(Br⁢(0)), and every positive deterministic step sequence for which there exist 0<c1≤c2<∞ and γ∈(1/2,1) satisfying

c1⁢(k+1)−γ≤αk≤c2⁢(k+1)−γ(k≥0),

do the resulting iterates satisfy P⁡(B∖Lv⁢(h))=0?

In DDJ’s notation, a fixed Borel selection gives their measurable map in Algorithm (4.5) and Assumption E1; the displayed step condition is E2. The iid centered uniform-ball perturbations have bounded fourth moments and hence satisfy E3 and Uniform-noise Assumption F, while our finite-valued objective satisfies E4. This gives the promised direct correspondence with the published stochastic-approximation framework.

2.3 A coercive counterexample

Define the local core and its coercive extension by

g⁡(x,y):=min⁡{|x|+2⁢|y|, 7⁢|x|−|y|},(2.4)
F⁡(x,y):=8+max⁡{g⁡(x,y),|x|+|y|−8}=max⁡{g⁡(x,y)+8,|x|+|y|}.(2.5)

Let

U:=(−10−2,10−2)2,Fv⁢(z):=F⁡(z)−⟨v,z⟩.(2.6)

For γ∈(1/2,1), put

αk:=(k+8)−γ,D⋆:={(x,y):|x|<180,|y|<120}.(2.7)

Since k+8≤8⁢(k+1), these steps satisfy the bounds in target statement 2.1 with c1=8−γ and c2=1.

The next theorem states a pathwise-robust result that is stronger than needed for falsification: after the first step, every subsequent oracle value is forced by the realized iterate.

Theorem 2.2 (Coercive trapping on an open set of tilts).

Fix any v∈U, γ∈(1/2,1), and deterministic z0∈D⋆. Let (wk) be any admissible pre-noise Clarke oracle for Fv. Suppose that, for every k, almost surely

Law⁡(νk∣Fk)≪Leb2,‖νk‖∞≤10−2.(2.8)

Writing zk=(xk,yk), the iterates (2.2), with the steps in (2.7), satisfy almost surely

|xk|≤7.2αk−1,|yk|≤3.9αk−1(k≥1).(2.9)

Consequently zk→0.

Moreover, Fv is nonnegative and coercive, the origin is Clarke-critical but not limiting-critical for Fv, and the origin is not a local minimizer. In particular, for iid νk∼Unif⁡(B10−2⁢(0)) and every fixed Borel Clarke selection,

P⁡(zk→0)=1,P⁡(B∖Lv⁢(F))=1.(2.10)

The set D⋆ is independent of γ and has area 1/400; the phenomenon is therefore not tied to the exact initialization z0=0. For each fixed pre-noise oracle and conditional noise kernel, the probability-one event in the theorem may depend on that pair; no common event over an uncountable policy class is asserted.

For each v∈U, define the concrete fixed selection

sv∘⁢(z):=argminu∈∂cFv⁢(z)‖u‖2.(2.11)

The value is unique because ∂cFv⁢(z) is nonempty, compact, and convex. For a function with finitely many affine pieces, the graph of its Clarke multifunction is semialgebraic. The graph of (2.11) is then semialgebraic by quantifier elimination, so sv∘ is Borel measurable.

The following specialization makes the contradiction with the DDJ conjecture independent of the stronger oracle quantifier in Theorem 2.2.

Corollary 2.3 (A fixed-selection counterexample in the DDJ framework).

Fix v∈U and γ∈(1/2,1). Starting from z0=(1/160,1/100), use the Borel selection sv∘, iid noise νk∼Unif⁡(B10−2⁢(0)), and αk=(k+8)−γ. Then zk→0 almost surely although 0∉LocMin⁡(Fv). This instance satisfies DDJ’s Algorithm (4.5), Assumptions E1–E4, and Uniform-noise Assumption F.

Proof.

The initialization lies in D⋆, so Theorem 2.2 gives the stated limit and shows that it is not a local minimizer. The assumptions, including the step bounds after (2.7), were matched immediately after target statement 2.1. ∎

Remark 2.4 (Differentiable and random initializations).

Fix v∈U and γ∈(1/2,1). The initialization

z0=(1/160, 1/100)

lies in D⋆ and is a differentiability point of F. With iid disk noise and any admissible pre-noise oracle, almost surely every finite-time iterate is a differentiability point and the method evaluates the unique ordinary gradient at every step, yet converges to the nonminimum at zero. If instead z0 is uniform on D⋆, independently of the noise and any exogenous oracle randomization, conditioning on z0 gives the same result.

Corollary 2.5 (Failure of a conull good-tilt set).

The conull set requested in target statement 2.1 does not exist, even when restricted to nonnegative coercive globally Lipschitz semialgebraic continuous piecewise-affine objectives.

Proof strategy.

Inside the ℓ1-ball of radius 4, the coercive extension F equals g+8. Its two branch families meet on |y|=2⁢|x|. In the broad horizontal sector, sign-gradient steps attract both coordinates toward zero. In the narrow vertical sector, the horizontal gradient has magnitude 7: one step crosses the vertical axis and lands strictly in the horizontal sector. Three explicit transitions between a tight envelope and a recovery envelope keep the orbit inside an O⁡(αk−1) bound. Conditional absolute continuity ensures that positive-time iterates never hit an axis or branch boundary, so after the first step every Clarke oracle is forced to return the unique gradient.

3 Geometry of the objective

We first verify the global function class and coercivity, and then compute the local limiting and Clarke subdifferentials. The latter calculation identifies the criticality gap that permits convergence to a nonminimum.

3.1 Global coercivity and the local core

Here a continuous piecewise-affine function means a continuous function that is affine on every cell of a finite polyhedral decomposition. The coercive extension in (2.5) preserves this finite structure while leaving the core unchanged near the origin.

Lemma 3.1 (Function class and coercive tilts).

The function F is nonnegative, coercive, globally Lipschitz, semialgebraic, and continuous piecewise affine. For every v∈U,

Fv⁢(z)≥(1−‖v‖∞)⁢‖z‖1>0.99⁢‖z‖1(z≠0),(3.1)

and hence Fv is nonnegative and coercive. Furthermore,

F⁡(z)=g⁡(z)+8whenever ⁢‖z‖1<4.(3.2)
Proof.

Both branches defining g are globally Lipschitz, semialgebraic, and continuous piecewise linear. Finite minimum and maximum operations preserve global Lipschitz continuity, semialgebraicity, and the continuous piecewise-affine property. Also

g⁡(z)≥−|y|≥−‖z‖1.

If ‖z‖1<4, then

g⁡(z)+8≥8−‖z‖1>‖z‖1,

which proves (3.2). Globally, F⁡(z)≥‖z‖1. Hölder’s inequality therefore gives

Fv⁢(z)≥‖z‖1−|⟨v,z⟩|≥(1−‖v‖∞)⁢‖z‖1.

Since ‖v‖∞<0.01, this proves (3.1), nonnegativity, and coercivity. ∎

Write

p⁡(x,y):=|x|+2⁢|y|,q⁡(x,y):=7⁢|x|−|y|.

Their comparison is

p−q=3⁢|y|−6⁢|x|.(3.3)

The finite singular arrangement

N:={x=0}∪{y=0}∪{|y|=2|x|}(3.4)

contains every nondifferentiability point of g. Outside N, the local core has horizontal and vertical branch families

H:={(x,y):|y|<2⁢|x|},∇g⁢(x,y)=(sgn⁡x, 2⁢sgn⁡y),(x,y)∈H∖N,(3.5)
V:={(x,y):|y|>2⁢|x|},∇g⁢(x,y)=(7⁢sgn⁡x,−sgn⁡y),(x,y)∈V∖N.(3.6)

Here sgn⁡t∈{−1,1} for t≠0. In H, both coordinate gradients point away from their axes, so a negative-gradient step attracts the coordinates toward zero. In V, the larger horizontal component drives the one-step axis crossing used below.

3.2 Exact subdifferentials

The main theorem requires more than Clarke criticality: its limit must fall outside the limiting-critical classification used in the generic theory. We therefore compute both subdifferentials exactly.

Proposition 3.2 (Limiting and Clarke geometry at the origin).

At the origin,

∂F⁡(0)=∂g⁡(0)=({−1,1}×[−2,2])∪([−7,7]×{−1,1}),(3.7)

whereas

∂cF(0)=∂cg(0)=conv({(σ,2τ):σ,τ∈{−1,1}}∪{(7σ,τ):σ,τ∈{−1,1}}).(3.8)

In particular,

[−1,1]×[−2,2]⊆∂cF⁡(0).(3.9)
Proof.

Local equality (3.2) shows that all three subdifferentials of F and g agree at the origin. We compute those of g.

At a nonzero point of the horizontal axis, the local formula is p, so

∂^⁢g⁢(x,0)={sgn⁡x}×[−2,2](x≠0).(3.10)

At a nonzero point of the vertical axis, the local formula is q, so

∂^⁢g⁢(0,y)=[−7,7]×{−sgn⁡y}(y≠0).(3.11)

Now fix a nonzero point on |y|=2⁢|x|. In a sufficiently small neighborhood contained in one open orthant, g is the minimum of two distinct affine functions with gradients a≠b. If w were a Fréchet subgradient, applying the defining inequality along t⁢d and −t⁢d as t↓0, for a direction d with ⟨a−b,d⟩≠0, would give

⟨w,d⟩≤min⁡{⟨a,d⟩,⟨b,d⟩},⟨w,d⟩≥max⁡{⟨a,d⟩,⟨b,d⟩},

a contradiction. Hence the Fréchet subdifferential is empty on every nonzero branch-boundary ray. Finally, g⁡(0,t)=−|t|. The positive and negative vertical directions would require simultaneously wy≤−1 and wy≥1, so ∂^⁢g⁢(0)=∅.

The finite stratification now makes the limiting calculation exact. The only nonempty Fréchet values on nondifferentiable strata approaching zero are (3.10) and (3.11); all differentiable gradients are endpoints of those segments. Conversely, (σ,η)∈{−1,1}×[−2,2] is realized along zi=(σ/i,0), while (ξ,τ)∈[−7,7]×{−1,1} is realized along zi=(0,−τ/i). This proves (3.7).

The Clarke subdifferential is the closed convex hull of the eight gradients realized in the open sectors, giving (3.8). The four gradients from H alone have convex hull [−1,1]×[−2,2], which proves (3.9). ∎

The exact formulas place the origin in the Clarke–limiting gap for every tilt in the open square U, while a vertical displacement gives an explicit descent direction.

Corollary 3.3 (Criticality gap at a nonminimum).

For every v∈U,

0∈∂cFv⁢(0),0∉∂Fv⁢(0).(3.12)

The origin is not a local minimizer of Fv. Moreover, F is not subdifferentially regular at the origin and is not locally ρ-weakly convex there for any ρ≥0.

Proof.

By (2.1), the two criticality statements are equivalent to v∈∂cF⁡(0) and v∉∂F⁡(0). The first follows from (3.9). The second follows from (3.7), because neither coordinate of v∈U equals 1 or −1.

For 0<|t|<4, local equality gives

Fv⁢(0,t)=8−|t|−vy⁢t<8=Fv⁢(0,0),(3.13)

since |vy|<1. Thus zero is not a local minimizer. The mismatch between the Fréchet and limiting subdifferentials rules out subdifferential regularity. Finally, for any ρ≥0, the restriction of F+ρ2⁢‖⋅‖22 to the vertical axis near zero is 8−|t|+ρ2⁢t2. Its left and right derivatives at zero are 1 and −1, respectively, violating the necessary convexity condition that the left derivative not exceed the right derivative. Hence no such local weak-convexity parameter exists. ∎

4 Conditional absolute continuity avoids the singular locus

We show that every positive-time iterate avoids the singular arrangement N from (3.4), where the Clarke oracle could otherwise be set-valued. This is the only part of the proof that uses conditional absolute continuity; the support bound instead closes the deterministic invariant.

Lemma 4.1 (Oracle-independent first-step bound).

Under the hypotheses of Theorem 2.2, uniformly over every admissible pre-noise value w0∈∂cFv⁢(z0), the first iterate satisfies almost surely

|x1|<7.2⁢α0,|y1|<2.5⁢α0.(4.1)
Proof.

Since γ<1, we have α0=8−γ>1/8. Hence z0∈D⋆ implies

|x0|<0.1⁢α0,|y0|<0.4⁢α0,‖z0‖1<116<4.

Thus F=g+8 near z0. The closed convex hull of the finite cell gradients shows that every Clarke value of g has first coordinate in [−7,7] and second coordinate in [−2,2]. Hence

|w0,x|<7.01,|w0,y|<2.01.

Together with ‖ν0‖∞≤0.01 and the preceding bounds, the first update gives

|x1|<(0.1+7.02)⁢α0<7.2⁢α0,|y1|<(0.4+2.02)⁢α0<2.5⁢α0.

∎

Lemma 4.2 (Almost-sure avoidance of the singular locus).

Under the hypotheses of Theorem 2.2, fix an admissible pre-noise oracle and a noise process satisfying (2.8). Then

P⁡(zk∉N⁢ for every ⁢k≥1)=1.(4.2)

On this event, whenever k≥1 and ‖zk‖1<4,

wk=∇g⁢(zk)−v,zk+1=zk−αk⁢(∇g⁢(zk)+ek),ek:=νk−v,(4.3)

and ‖ek‖∞<δ:=0.02.

Proof.

Conditional on Fk, both zk and wk are fixed, while νk has an absolutely continuous law. Since αk>0, the conditional law of

zk+1=zk−αk⁢wk−αk⁢νk

is absolutely continuous. Therefore P⁡(zk+1∈N∣Fk)=0 almost surely. Taking expectations and then a countable union proves (4.2).

For k≥1 with ‖zk‖1<4, F=g+8 locally. Outside N, the core is locally affine, so ∂cFv⁢(zk)={∇g⁢(zk)−v}. The oracle is therefore forced to take the value in (4.3). Finally, ‖νk−v‖∞<0.02. ∎

Remark 4.3 (A weaker noise condition).

The noise assumption in Theorem 2.2 separates two roles: conditional absolute continuity supplies singular-locus avoidance, while the support bound supplies the pathwise invariant. Absolute continuity can be weakened to the direct conditional-hit condition

P⁡(zk−αk⁢wk−αk⁢νk∈N∣Fk)=0almost surely for every ⁢k.

This condition handles the history-dependent affine preimage of N. Marginal nullity for the fixed set N is insufficient because a conditional law could concentrate on that preimage after observing the past. Conversely, neither iid sampling nor mean zero is required.

For each realized path on the event in (4.2), all remaining estimates are deterministic and use only the coordinate bound.

5 The shrinking two-sector trap

After removing the singular-locus event, the proof is deterministic. We first record a scalar sign-step estimate and then use it to close a two-envelope invariant through three transitions.

The state at time k≥1 is normalized by the preceding step rk:=αk−1; the update at time k must produce bounds at scale αk. This convention explains the index shift in (2.9).

Lemma 5.1 (Attracting sign step).

If u≥0, a>δ≥0, α>0, and |e|≤δ, then

|u−α⁡(a+e)|≤max⁡{u−(a−δ)⁢α,(a+δ)⁢α}.(5.1)
Proof.

If the step does not cross zero, the first term bounds the remaining distance. If it crosses zero, the overshoot is at most (a+δ)⁢α. Equivalently, one may maximize the convex function e↦|u−α⁡(a+e)| over [−δ,δ]. ∎

For k≥1, call zk tight when

|xk|≤7.2⁢rk,|yk|≤2.5⁢rk,(5.2)

and call it a recovery state when

|xk|≤7.2⁢rk,|yk|≤3.9⁢rk,|yk|<2⁢|xk|.(5.3)
Proposition 5.2 (Two-state pathwise invariant).

Let {αk}k≥0 be positive and nonincreasing, with αk→0, and suppose

αk−1αk≤κ:=1.13(k≥1).(5.4)

Consider the core dynamics

zk+1=zk−αk(∇g(zk)+ek),zk∉N,‖ek‖∞≤0.02(k≥1).

Writing zk=(xk,yk), suppose

|x1|≤7.2⁢α0,|y1|≤2.5⁢α0.(5.5)

Then |xk|≤7.2⁢αk−1 and |yk|≤3.9⁢αk−1 for every k≥1, and zk→0. More precisely, if this trajectory is tight and lies in V, its next iterate lies strictly in H; hence two consecutive V-steps are impossible.

Proof.

Every recovery state lies in H, and the initial state is tight. We verify three transitions; the two predicates need not be mutually exclusive.

Tight state in H. Multiplying each coordinate update by the sign of that coordinate reduces it to Lemma 5.1. Using a=1 horizontally, a=2 vertically, and rk≤κ⁢αk, we obtain

|xk+1|≤max⁡{(7.2⁢κ−0.98)⁢αk, 1.02⁢αk}=7.156⁢αk<7.2⁢αk,(5.6)
|yk+1|≤max⁡{(2.5⁢κ−1.98)⁢αk, 2.02⁢αk}=2.02⁢αk<2.5⁢αk.(5.7)

The next state is tight, regardless of its new sector.

Tight state in V. The sector inequality and (5.2) give

|xk|<|yk|2≤1.25⁢rk≤1.4125⁢αk.(5.8)

Writing σx=sgn⁡xk and σy=sgn⁡yk, the update in V is

σx⁢xk+1=|xk|−αk⁢(7+σx⁢ek,x),
σy⁢yk+1=|yk|+αk⁢(1−σy⁢ek,y).

The first expression is negative because 7−0.02>1.4125; hence the horizontal coordinate crosses zero. The second is positive, so the vertical coordinate keeps its sign. Moreover,

5.5675⁢αk<|xk+1|<7.02⁢αk<7.2⁢αk,(5.9)
|yk+1|≤(2.5⁢κ+1.02)⁢αk=3.845⁢αk<3.9⁢αk.(5.10)

Since 3.845<2⁢(5.5675), the next state lies strictly in H and is in the recovery envelope.

Recovery state in H. The horizontal estimate (5.6) is unchanged. For the vertical coordinate, Lemma 5.1 and the looser bound in (5.3) give

|yk+1|≤max⁡{(3.9⁢κ−1.98)⁢αk, 2.02⁢αk}=2.427⁢αk<2.5⁢αk.(5.11)

Thus the next state is tight.

The transitions close the induction. Both state types satisfy the asserted bounds; since αk→0, the trajectory converges to zero. The tight-V calculation also proves the final assertion. ∎

6 Proof of the main theorem

We now combine first-step capture, singular-locus avoidance, and the pathwise invariant. The proof also checks that the invariant remains inside the neighborhood where the coercive extension equals the local core.

Proof of Theorem 2.2.

Fix v,γ,z0, an admissible pre-noise oracle, and a noise process satisfying (2.8). By Lemma 4.1, (4.1) holds and hence so does the initial condition (5.5) of Proposition 5.2. Work on the probability-one event from Lemma 4.2.

For every k≥1,

αk−1αk=(k+8k+7)γ<k+8k+7≤98<1.13.(6.1)

We now apply the transitions of Proposition 5.2 inductively. There is one local-to-global point to check. At every stage of the transition induction, the tight or recovery bounds give

‖zk‖1≤11.1⁢αk−1≤11.1⁢α0<11.18<4.(6.2)

Thus the induction hypothesis itself places zk in the region where F=g+8. Since zk∉N, Lemma 4.2 forces the oracle update to be the core dynamics with ‖ek‖∞<0.02. The appropriate transition in Proposition 5.2 then produces the next state. This proves (2.9), simultaneously verifies the local formula, and closes the induction. It also proves zk→0 and boundedness.

Lemma 3.1 proves that Fv is nonnegative and coercive, while Corollary 3.3 proves that the limit is Clarke-critical, not limiting-critical, and not a local minimizer. This establishes P⁡(zk→0)=1; since zero is not in LocMin⁡(Fv), it also gives P⁡(B∖Lv⁢(F))=1, proving (2.10). ∎

Proof of Corollary 2.5.

The open square U has Lebesgue measure 4⋅10−4>0. If a conull good set GF existed, then GF∩U would have positive measure. For every v∈GF∩U, however, the explicit algorithmic instance in Corollary 2.3 is admissible and has P⁡(B∖Lv⁢(F))=1, a contradiction. ∎

7 Further consequences

The counterexample extends to every finite uniform-noise radius and every dimension at least two. The statements are recorded here; their technical proofs appear in Appendix A.

7.1 Arbitrary finite uniform-noise radius

Corollary 7.1 (Scaling to every finite noise radius).

Fix R>0 and γ∈(1/2,1). There is a nonnegative coercive globally Lipschitz semialgebraic piecewise-affine counterexample for iid noise uniform on BR⁢(0). More precisely, choose C≥100⁢R, set F^:=C⁢F, use any tilt v~:=C⁢v with v∈U, let ak:=(k+8)−γ, and use steps

βk:=C−1⁢ak.

For every fixed Borel selection s^v~⁢(z)∈∂cF^v~⁢(z), every initialization in D⋆ converges almost surely to the nonminimizing origin.

7.2 Embedding in every dimension

The separable embedding preserves both the two-dimensional oracle robustness and the Clarke–limiting gap. It uses only absolute continuity of the first two-dimensional noise marginal, not independence of coordinates.

Corollary 7.2 (Counterexamples in all dimensions d≥2).

For d≥2, define

F(d)⁢(z):=F⁡(z1,z2)+2⁢∑j=3d|zj|.

Let Ud:=U×(−10−2,10−2)d−2, and for v∈Ud set Fv(d):=F(d)−⟨v,⋅⟩. For every v∈Ud, γ∈(1/2,1), iid noise uniform on the Euclidean ball of radius 10−2 in Rd, and every fixed Borel Clarke selection of ∂cFv(d), the iterates with z0=0 and αk=(k+8)−γ converge almost surely to the nonminimizing origin.

8 Interpretation and related work

8.1 The exact gap in the generic theory

In arXiv version 2 of Davis et al. [11], Theorem 3.30 and Corollary 4.2 classify limiting-critical points after generic tilting, while Corollary 6.5 gives Clarke-critical convergence on the bounded-orbit event under the standing step and noise assumptions. Subdifferential regularity identifies these notions so that the classification and saddle-avoidance argument applies. Our origin instead has 0∈∂cFv⁢(0) but 0∉∂Fv⁢(0). The example therefore does not contradict the limiting-critical classification; it shows that definability, coercivity, generic tilting, and continuous noise do not replace regularity for a Clarke-subgradient algorithm.

8.2 Why noise does not force escape

Nonzero vertical displacements near the origin decrease Fv, but conditional absolute continuity makes positive-time hits of the vertical axis null. Inside V, the gradient forces an axis crossing whose overshoot obeys (5.9)–(5.10). Continuous-time differential inclusions and asymptotic-pseudotrajectory heuristics [1] do not encode these one-step bounds.

8.3 Relation to prior work

Example 2 of Bianchi et al. [2] already gives the static open-tilt Clarke–limiting gap for f⁡(y,z)=−|y|+|z|, but neither coercivity nor a noisy orbit converging to the origin. Those are the global and dynamical additions here. The tame convergence theorem of Davis et al. [12] places limit points in the Clarke critical set, while conservative-field theory gives analogous endpoint guarantees for automatic differentiation [4]. Neither classifies every Clarke-critical point as a local minimum.

Daniilidis and Drusvyatskiy [8] construct a four-dimensional limit cycle using a nondefinable interval-splitting function and a specially chosen Clarke selection. Ríos-Zertuche [17] use infinitely many shrinking modifications to obtain deterministic nonconvergence around a critical circle, and Bolte et al. [5] study oscillatory occupation measures. By contrast, our construction gives convergence to a nonminimum for a two-dimensional semialgebraic piecewise-affine objective under bounded conditionally absolutely continuous noise and every pre-noise Clarke oracle. Appendix C of Bianchi et al. [2] also discusses the invalid asymptotic-pseudotrajectory implication behind the withdrawn preprint of Schechtman [19].

Recent positive results impose assumptions or reach endpoints that do not close the present gap. In the active-geometry regimes of Lai and Song [14], bounded momentum trajectories converge for steps of order k−a with 1/2<a≤1, and bounded stochastic subgradient trajectories converge almost surely for 2/3<a≤1, while bounded nonconvergence can occur at a=1/2. Related work [13, 6] likewise classifies critical rather than local-minimum endpoints, and Bolte et al. [3] analyze inexact semialgebraic subgradient methods. For representation-dependent piecewise gradients, Traoré [20] obtains conservative-critical convergence; its Clarke-critical upgrade also requires a null interface, generic step scaling and initialization, and the stated dimension–smoothness condition. Qiu et al. [16] treat smooth and mirror methods and convex-composite normal-map proximal methods under an active strict saddle property. None covers arbitrary Clarke selections at the gap in (3.12).

8.4 Scope

The result concerns the selected Clarke-subgradient recursion (2.2), not momentum, adaptive preconditioning, or proximal normal-map algorithms. It also leaves intact escape theorems assuming weak convexity, active-manifold regularity, or an active strict saddle property.

9 Conclusion

Subdifferential regularity cannot be removed without replacement from the DDJ theorem for selected Clarke-subgradient recursions. For every γ∈(1/2,1), the iterates generated with the schedule αk=(k+8)−γ converge from an explicit positive-area basin to a nonminimizing Clarke-critical point on an open tilt set, almost surely and for every pre-noise Clarke oracle.

References

  • [1] M. Benaïm, J. Hofbauer, and S. Sorin. Stochastic approximations and differential inclusions. SIAM Journal on Control and Optimization, 44(1):328–348, 2005. doi:10.1137/S0363012904439301.
  • [2] P. Bianchi, W. Hachem, and S. Schechtman. Stochastic subgradient descent escapes active strict saddles on weakly convex functions. Mathematics of Operations Research, 49(3):1761–1790, 2024. doi:10.1287/moor.2021.0194.
  • [3] J. Bolte, T. Le, E. Moulines, and E. Pauwels. Inexact subgradient methods for semialgebraic functions. Mathematical Programming, online first, 2025. doi:10.1007/s10107-025-02245-w.
  • [4] J. Bolte and E. Pauwels. Conservative set valued fields, automatic differentiation, stochastic gradient methods and deep learning. Mathematical Programming, 188(1):19–51, 2021. doi:10.1007/s10107-020-01501-5.
  • [5] J. Bolte, E. Pauwels, and R. Ríos-Zertuche. Long term dynamics of the subgradient method for Lipschitz path differentiable functions. Journal of the European Mathematical Society, 26(7):2533–2563, 2024. doi:10.4171/JEMS/1285.
  • [6] E. Chzhen and S. Schechtman. On convergence rates of subgradient descent on semialgebraic functions. arXiv preprint arXiv:2604.17060v1, 2026. https://arxiv.org/abs/2604.17060v1.
  • [7] F. H. Clarke. Optimization and Nonsmooth Analysis. SIAM, Philadelphia, second edition, 1990. doi:10.1137/1.9781611971309.
  • [8] A. Daniilidis and D. Drusvyatskiy. Pathological subgradient dynamics. SIAM Journal on Optimization, 30(2):1327–1338, 2020. doi:10.1137/19M1298147.
  • [9] D. Davis, M. Díaz, and D. Drusvyatskiy. Escaping strict saddle points of the Moreau envelope in nonsmooth optimization. SIAM Journal on Optimization, 32(3):1958–1983, 2022. doi:10.1137/21M1430868.
  • [10] D. Davis and D. Drusvyatskiy. Proximal methods avoid active strict saddles of weakly convex functions. Foundations of Computational Mathematics, 22(2):561–606, 2022. doi:10.1007/s10208-021-09516-w.
  • [11] D. Davis, D. Drusvyatskiy, and L. Jiang. Active manifolds, stratifications, and convergence to local minima in nonsmooth optimization. Foundations of Computational Mathematics, 26(2):779–861, 2026. doi:10.1007/s10208-025-09691-0. https://arxiv.org/abs/2108.11832v2.
  • [12] D. Davis, D. Drusvyatskiy, S. M. Kakade, and J. D. Lee. Stochastic subgradient method converges on tame functions. Foundations of Computational Mathematics, 20(1):119–154, 2020. doi:10.1007/s10208-018-09409-5.
  • [13] L. Lai and M. Song. On the diameter of subgradient sequences in o-minimal structures. arXiv preprint arXiv:2511.06868v3, 2025; revised 2026. https://arxiv.org/abs/2511.06868v3.
  • [14] L. Lai and M. Song. Convergence of difference inclusions: A diameter criterion and step-size conditions. arXiv preprint arXiv:2605.14345v2, 2026. https://arxiv.org/abs/2605.14345v2.
  • [15] R. Pemantle. Nonconvergence to unstable points in urn models and stochastic approximations. The Annals of Probability, 18(2):698–712, 1990. doi:10.1214/aop/1176990853.
  • [16] J. Qiu, B. Ma, A. Milzarek, and J. Zhang. Stochastic saddle avoidance beyond unit excitation and smoothness: A pathwise Lyapunov–Perron framework. arXiv preprint arXiv:2608.03001v2, 2026. https://arxiv.org/abs/2608.03001v2.
  • [17] R. Ríos-Zertuche. Examples of pathological dynamics of the subgradient method for Lipschitz path-differentiable functions. Mathematics of Operations Research, 47(4):3184–3206, 2022. doi:10.1287/moor.2021.1241.
  • [18] R. T. Rockafellar and R. J.-B. Wets. Variational Analysis. Springer, Berlin, 1998. doi:10.1007/978-3-642-02431-3.
  • [19] S. Schechtman. Stochastic subgradient descent on a generic definable function converges to a minimizer. arXiv preprint arXiv:2109.02455v3, 2021; withdrawn in 2022. https://arxiv.org/abs/2109.02455v3.
  • [20] C. Traoré. Piecewise smooth functions and conservative fields: Calculus for nonsmooth nonconvex optimization beyond stratification. arXiv preprint arXiv:2607.13973v3, 2026. https://arxiv.org/abs/2607.13973v3.

Appendix A Robustness and extensions

This appendix records the strict parameter inequalities behind the pathwise invariant, noise rescaling, and a separable high-dimensional embedding. These technical extensions are not needed for the main falsification.

A.1 A parameter-family criterion

The numerical choices are convenient rather than isolated. The next criterion exposes the inequalities behind the mechanism.

Proposition A.1 (Parameterized two-sector trap).

Let

gA,B⁢(x,y):=min⁡{|x|+A⁢|y|,B⁢|x|−|y|},m:=B−1A+1,

where 0≤δ<1, A>δ, and B>1. Suppose κ≥1 and X,Y,Z>0 satisfy

B+δ<X,A+δ<Y,X⁡(κ−1)<1−δ,(A.1)
Y⁡(κ−1)<A−δ,Y⁢κm<B−δ,Y⁢κ+1+δ<Z,(A.2)
Z<m⁡(B−δ)−Y⁢κ,Z⁢κ−(A−δ)<Y.(A.3)

Define the singular arrangement for this parameterized core by

NA,B:={x=0}∪{y=0}∪{|y|=m|x|}.

Call |y|<m⁢|x| and |y|>m⁢|x| the horizontal and vertical sectors, respectively. Let positive steps satisfy αk→0 and αk−1/αk≤κ for every k≥1. Every trajectory

zk+1=zk−αk(∇gA,B(zk)+ek),zk∉NA,B,‖ek‖∞≤δ(k≥1),

with zk=(xk,yk) and |x1|≤X⁢α0 and |y1|≤Y⁢α0 obeys

|xk|≤Xαk−1,|yk|≤Zαk−1(k≥1),

and converges to zero. Whenever |xk|≤X⁢αk−1, |yk|≤Y⁢αk−1, and |yk|>m⁢|xk| at some k≥1, its next iterate lies in the horizontal sector.

Proof.

Use tight bounds (X,Y) and recovery bounds (X,Z). In the horizontal sector, Lemma 5.1 closes the x-coordinate by the first and third inequalities in (A.1), and closes the y-coordinate by the second inequality in (A.1) and the first inequality in (A.2). In a tight vertical state,

|xk|<Y⁢αk−1m≤Y⁢κm⁢αk.

The second inequality in (A.2) forces the horizontal step to cross zero. Its new magnitude is below (B+δ)⁢αk<X⁢αk and above (B−δ−Y⁢κ/m)⁢αk. The vertical magnitude is below (Y⁢κ+1+δ)⁢αk<Z⁢αk. The first inequality in (A.3) places this landing point strictly in the horizontal sector. Finally, the last inequality in (A.3), together with A+δ<Y, returns a recovery state to the tight y-bound. These are the same three transitions as in Proposition 5.2. ∎

Our constants

(A,B,δ,κ,X,Y,Z)=(2,7,0.02,1.13,7.2,2.5,3.9)

satisfy all inequalities strictly. Consequently an open neighborhood of the displayed parameter tuple preserves the same pathwise core trapping invariant. After singular-locus avoidance, the statement is entirely pathwise: no independence, centering, summability, martingale argument, or continuous-time approximation is used.

A.2 Finite-radius scaling

Proof of Corollary 7.1.

Write F^v~=C⁢Fv and Wk:=s^v~⁢(zk). Then C−1⁢Wk is a Clarke value for Fv at zk. The update becomes

zk+1=zk−βk⁢(Wk+νk)=zk−ak⁢(C−1⁢Wk+νkC).

The scaled noise has a density and radius R/C≤0.01, so Theorem 2.2 applies. Constant rescaling preserves the admissible power-law order. Finally, F^v~=C⁢Fv remains nonnegative and coercive. ∎

A.3 High-dimensional embedding

Proof of Corollary 7.2.

For z=(z1,…,zd), separability and the definition by gradient limits give the product formula

∂cFv(d)⁢(z)=∂cF(v1,v2)⁢(z1,z2)×∏j=3d(2⁢∂c|⋅|⁢(zj)−vj).(A.4)

Consequently the first two coordinates of any d-dimensional pre-noise oracle form an Fk-measurable two-dimensional pre-noise oracle. The first two coordinates of uniform noise on a d-ball have an absolutely continuous two-dimensional marginal and are bounded in absolute value by 10−2. Thus Theorem 2.2 applies to the first two coordinates; no coordinate independence is used.

Writing zj,k and νj,k for coordinate j of zk and νk, respectively, the full singular set is a finite union of hyperplanes. Thus the argument of Lemma 4.2 gives zj,k≠0 for every 3≤j≤d and k≥1, almost surely. With ej,k:=νj,k−vj, the positive-time update is

zj,k+1=zj,k−αk⁢(2⁢sgn⁡zj,k+ej,k),|ej,k|<0.02.

At the origin the extra-coordinate Clarke value lies in [−2,2]−vj, so the first step satisfies |zj,1|<2.02⁢α0. If |zj,k|≤2.1⁢αk−1, Lemma 5.1 gives

|zj,k+1|≤max⁡{(2.1⋅1.13−1.98)⁢αk, 2.02⁢αk}<2.1⁢αk.

Thus all extra coordinates converge to zero.

For completeness, Fréchet subdifferentials factor for sums on orthogonal coordinates. Passing to limits yields one inclusion in the limiting-product identity below. For the reverse inclusion, synchronize a sequence realizing the chosen element of ∂F⁡(0) with constant zero sequences in the extra coordinates and fixed Fréchet subgradients in [−2,2]. Hence

∂F(d)⁢(0)=∂F⁡(0)×[−2,2]d−2,

and convexification similarly yields

∂cF(d)⁢(0)=∂cF⁡(0)×[−2,2]d−2.

Translation by v∈Ud now shows that the origin remains Clarke-critical but not limiting-critical, and the vertical descent from (3.13) persists. Finally,

Fv(d)⁢(z)≥0.99⁢‖(z1,z2)‖1+1.99⁢∑j=3d|zj|,

so every tilt in Ud remains nonnegative and coercive. ∎