A tractable streaming moment with square-root cancellation cost
in symmetric Lévy decompositions
Abstract
We construct a fixed computable nonnegative even function on the integers whose moment admits a small-space turnstile sketch, but whose approximation by differences of real symmetric Lévy–Khintchine exponents requires large cancellation. The function satisfies and for . Its sketch uses space polynomial in inverse relative accuracy and in the logarithms of dimension, final frequency bound, and inverse failure probability. On the integers , the cancellation cost of a split is the least such that . Among splits satisfying , the minimum cost is for every fixed ; an exact finite Fourier split supplies the matching upper bound. This refutes the real-even integer specialization of the controlled-decomposition conjecture of Pettie and Wang (arXiv 2026). The witness uses Rudin–Shapiro signs: their order- pairing with the target’s second differences contrasts with the uniform norm of their cosine polynomial. A positive-measure representation of second differences turns this contrast into a lower bound for the entire symmetric Lévy cone, including arbitrary jump measures and Gaussian parts.
Note. This paper was generated entirely by AI, including MiMo, using an automated research pipeline developed by Chenghua Liu and Hanyu Li.
1 Introduction
A turnstile stream maintains an integer vector under coordinate increments and decrements. For a fixed function , moment estimation asks for a relative approximation to using small space. When and for , a sample of the nonzero coordinates is enough, provided its weights can be evaluated in small space: every sampled weight is bounded, and the total weight is comparable to the support size. This argument places no restriction on how the values are arranged. We show that their arrangement can nevertheless obstruct a proposed analytic characterization of tractability.
The Fourier–Hahn–Lévy construction of Pettie and Wang represents moments by differences of Lévy–Khintchine exponents [1, 2]. For an exact split , estimates of the two component moments with relative error have combined absolute error at most . Thus a bound permits relative error by estimating the components to accuracy . The size of , not merely the existence of a signed representation, determines whether this reduction preserves a small-space guarantee. A Fourier expansion always provides such a representation on a finite integer interval, but need not control the cancellation uniformly as the interval grows.
We exhibit one fixed computable function with nonzero values in for which the smallest cancellation cost is on , even after allowing a small fixed relative approximation error. The function is a constant plus the Rudin–Shapiro sequence. Its streaming algorithm only needs to evaluate a sampled sign; its analytic representation must reproduce the pattern of all the signs. The lower bound allows both exponents to depend on and the approximation error, so selecting a different decomposition at each scale does not remove the gap.
Proving that one Fourier split has large mass would not establish this claim: another set of frequencies, or a continuous jump measure, might give a cheaper split. We instead test every symmetric Lévy exponent through its centered second differences. These are cosine coefficients of a positive measure whose total mass is the exponent’s value at . A cosine polynomial therefore bounds the corresponding pairing with by its uniform norm times . Rudin–Shapiro signs supply both sides of the separation: linearly many sign changes give a pairing of order , whereas the polynomial has norm . The pairing loses only under relative error , which is why approximation does not avoid the obstruction. Parseval’s identity gives an exact Fourier split of matching cost.
The pointwise controlled-decomposition question is Conjecture 1 of the expanded Pettie–Wang manuscript [2, Section 8.1]; we address its real-even integer specialization below. Wang’s harmonic sketch also uses a domination condition for signed combinations [3, Theorem 1 and Remark 3]. Our example shows why such an analytic condition cannot be inferred from streaming tractability alone. General turnstile characterizations, such as [4], impose no Lévy representation, and the bounded weights here require only the support-sampling methods of [5, 6].
1.1 Model and separation theorem
Let be the cone of real symmetric Lévy–Khintchine exponents
| (1.1) |
where is a positive Borel measure on . Every is even and nonnegative, and . For an even function with , an integer , and , define
| (1.2) |
The infimum of the empty set is . We call the cancellation cost; is the corresponding cancellation envelope. The case requires exact agreement on the specified integers. No condition is imposed outside this range. Formulating the constraints as inequalities also covers targets that vanish at additional integers.
Write for the fixed nonnegative even functions with for which the following holds. For every dimension , integer frequency bound , accuracy , and failure probability , the moment
admits a one-pass turnstile sketch using
| (1.3) |
and returning a -estimate with probability at least . The vector is initially zero, updates have the form with , and the stream is fixed independently of the sketch’s randomness. The promise on concerns the final vector; no bound on intermediate frequencies is needed for our construction. Space includes the random seed and decoding workspace, but not the read-only binary encoding of an incoming update. Unless a base is indicated, denotes the natural logarithm.
The real-even integer formulation of the controlled-decomposition question asks whether
| (1.4) |
for some polynomial depending only on . This is the real-symmetric specialization of Conjecture 1 in the expanded 2026 version of Pettie–Wang [2]. Their formulation uses a common size parameter for dimension and frequency range; keeping these parameters separate in (1.3) does not change the implication under consideration when both are polynomially bounded in that parameter.
Our counterexample uses the Rudin–Shapiro sequence
| (1.5) | ||||
Define
| (1.6) |
This is a single computable function, not a family of tables indexed by the cutoff.
Theorem 1.1.
For example, at the theorem gives for every . With dimension and final frequency bound at most , the streaming space at fixed accuracy is polynomial in , while the cancellation cost grows as . The theorem concerns precisely the envelope in (1.2); it does not give a lower bound for estimators that use correlations between components or a different complex or asymmetric representation.
2 Second differences and the Rudin–Shapiro certificate
The jump measure in (1.1) can have infinite mass near the origin, so its total variation is not itself a suitable measure of cancellation. Second differencing inserts the integrable factor . The resulting finite measure retains all the integer values needed for the lower bound, and its mass is already controlled by the cancellation constraint at the single integer .
For a function on , write
| (2.1) |
The factor of makes for an even function vanishing at zero. The next identity extends this normalization to all cosine coefficients.
Lemma 2.1 (Positive second-difference measure).
For every , there is a finite positive measure on such that
| (2.2) |
Proof.
Take the pushforward of under reduction modulo , and add , where and are from (1.1). This defines a positive finite measure because , and its mass is
The identities
now give (2.2). Passing the finite difference through the integral is legitimate: each original integrand is integrable at the relevant integer, and the resulting integrand is bounded in absolute value by the integrable function . The measure itself need not be finite. ∎
Corollary 2.2 (Dual inequality).
Let and , with . For every finitely supported real sequence ,
| (2.3) |
Proof.
The signed measure has total variation at most . Integrating the cosine polynomial against this measure gives (2.3). ∎
Remark 2.3.
The inequality applies to Gaussian terms, finite or infinite jump measures, and both continuous and atomic measures. Its relation to the normalized Lévy cone can be made explicit. For integer , put
The value at is the continuous limit, and the measure in Lemma 2.1 satisfies
Consequently, if , then is a probability mixture of the normalized generators . If , then and is concentrated, up to a null set, on positive multiples of ; hence at every integer. In particular, atoms invisible on the integers cannot affect the certificate, and no restriction to a discrete frequency grid is involved.
To use (2.3), the test coefficients must correlate with the second differences of without adding coherently at any frequency. Alternating coefficients would fail: at , every term equals one, and the dual norm is as large as the number of terms. The Rudin–Shapiro construction instead has uniform norm of square-root order. It also has linearly many sign changes, each of which contributes with the same sign to the second-difference pairing. We record both properties, including the endpoint terms needed when .
Set and define
| (2.4) | ||||
The coefficients of are , as in the classical Rudin–Shapiro construction [7]. To verify the identification with (1.5), define
Prefixing binary words gives and . Indeed, the two halves of the word for are obtained by prefixing an -bit word by and , respectively; the first produces the signs in , and the second reverses those in . Since , induction gives and .
Lemma 2.4 (Norm and transition counts).
Let . For every real ,
| (2.5) |
If and count adjacent sign transitions in the coefficient words of and , then , and for ,
| (2.6) |
Proof.
At the word level, (2.4) concatenates and . Exactly one of their two joins is a transition. Thus
and the initial counts are zero, so . Both words begin with . In the concatenation forming , the left word ends with , since has binary ones. For , this join is therefore a transition exactly when is odd. Adding the internal transitions gives
which is (2.6). ∎
The certificate must avoid second differences involving the exceptional value . For , retain only the interior terms:
| (2.7) |
Indeed, it is the real part of after deleting the three terms at indices , each of modulus at most . On these indices, . Moreover, counts the sign changes on the two edges adjacent to : a neighboring equal sign contributes zero and a different sign contributes one. Thus the transition count gives a linear pairing, with the following exact boundary correction.
Lemma 2.5 (Exact second-difference pairing).
For ,
| (2.8) |
In particular, the absolute value is at least .
Proof.
Write and . A transition contributes to , and a nontransition contributes , so
The endpoint signs are
Thus , , and . Summing the two neighboring products in gives
| (2.9) |
By (2.6), this equals for odd and for even . The term may be deleted because . For , all three arguments in the second difference are nonzero, and the constant in (1.6) cancels. Hence , and division by proves (2.8). Excluding is necessary for this last identity: the exceptional value prevents the constant part from cancelling there. ∎
3 Proof of the separation theorem
The certificate now gives the lower bound for any admissible pair. Because the target is bounded by , relative error changes each second difference by at most . Its total effect is therefore smaller than the linear pairing whenever . Only target values inside the prescribed interval are used; after applying the dual inequality, the envelope is needed only at .
Proposition 3.1 (Dyadic lower bound).
Let , , and . If satisfy
| (3.1) |
then
| (3.2) |
At , this implies
| (3.3) |
Proof.
Put , , and . Since , the approximation condition gives for . Therefore, for ,
All three indices lie in . There are terms in the pairing, so Lemma 2.5 yields
| (3.4) |
Applying Corollary 2.2 with for and zero elsewhere, and then using (2.7), gives
On the other hand, , so the cancellation constraint at gives . This proves (3.2). For , the first simplification in (3.3) uses , and the second uses , both valid for . ∎
Corollary 3.2 (All cutoffs).
For every and ,
| (3.5) |
Proof.
Take . Then , , and . Restricting an admissible pair to preserves both constraints. Thus Proposition 3.1 implies
For ,
Substitution gives
as required. ∎
For the matching upper bound, it suffices to apply the periodic Fourier–Hahn construction [1, 2] on a group of size . The bounded values of give a bounded mean-square Fourier norm. Cauchy–Schwarz then loses a factor when passing to the absolute Fourier mass, exactly the scale forced by the certificate.
Proposition 3.3.
For every , there are such that
Proof.
Put and identify with . Let be the corresponding real even function, with normalized Fourier coefficients
Pairing with shows that is real. Fourier inversion gives , and implies . Hence
| (3.6) |
Define , , and
Both functions belong to , with finite positive atomic jump measures. The omitted term in (3.6) is identically zero, so on the required integers.
Cauchy–Schwarz and Parseval give
Since , the cancellation envelope is at most . At a nonzero integer in the prescribed range, ; at zero, the target and both exponents vanish. This proves the claimed pointwise bound. ∎
The exact split uses atoms. It certifies the upper bound on cancellation, but is not the small-space algorithm for the moment. That algorithm recovers a sparse sample of the input coordinates and evaluates their weights directly. We finish by verifying that it works in the bit-space model of (1.3), including the promise on final rather than intermediate frequencies.
Proposition 3.4.
The function in (1.6) is a fixed computable member of .
Proof.
Let , , and . When , . If the coordinates are retained with probability using pairwise independent indicators , then
Thus a sample with expected support size of order suffices for a relative estimate with constant success probability. Dyadic subsampling and sparse recovery implement this idea when is unknown, following the support-sampling framework [5, 6].
For the precise final-frequency model used here, Lemma A.2 supplies a self-contained finite-field implementation, including the selection of a sampling level, recovery errors, and amplification to failure probability . It uses space (1.3) for any weight function taking values in away from zero, provided those values can be evaluated in polylogarithmic space. The value is obtained by scanning the binary expansion of and recording the parity of the number of adjacent pairs of ones. This requires workspace when . The lemma therefore applies to , including the zero vector, for which its output is exactly zero. ∎
Proof of Theorem 1.1.
Proposition 3.4 gives . Corollaries 3.2 and 3.3, together with the inclusion of exact admissible pairs among approximate ones, give (1.7). For fixed , these bounds are of order . If (1.4) held for this , then at it would imply , contradicting (3.5) as . ∎
The separation depends on the sign pattern, not on large weights. For comparison, Appendix B constructs controlled splits of , an example considered in [2], and more generally of fixed logarithmic powers multiplying , . The first has cancellation cost at relative accuracy , despite its slightly superquadratic growth. Together these examples distinguish growth restrictions on a target from the oscillatory obstruction detected by the second-difference certificate.
Appendix A A finite-field support-sampling sketch
This appendix supplies the bit-space guarantee used in Proposition 3.4, without a bound on intermediate frequencies. At each sampling level, a linear summary either recovers the retained frequencies or reports that the sample is too dense. The usual dyadic subsampling strategy [5, 6] then chooses a level with enough retained coordinates for concentration. Finite-field arithmetic removes any dependence on intermediate frequency magnitudes; an independent checksum prevents a dense vector from being mistaken for a sparse one. The decoder below uses polynomial time in the dimension, the sparsity threshold, and the field bit length.
Lemma A.1 (Sparse recovery with a checksum).
Let be integers, and let be prime. There is a linear turnstile summary over , using bits, with the following guarantee for any fixed final vector . If has at most nonzero coordinates, the decoder returns exactly. Otherwise it returns , except with probability at most . Decoding uses workspace and time polynomial in .
Proof.
Store the power sums and one random checksum
| (A.1) |
where is uniform in . These quantities are linear in the updates. The seed , powers, and accumulators fit within bits.
There is at most one vector with at most nonzero coordinates that matches all the . Indeed, the difference of two candidates is supported on some distinct indices. Its first power sums form a Vandermonde system over , whose determinant is nonzero because the indices are distinct modulo . Every coordinate of the difference is therefore zero modulo . Its absolute value is at most , so the two candidates are equal as integer vectors.
We next describe how to find this candidate, if it exists, without using or . If all power sums are zero, take the zero candidate. Otherwise try each . If the Hankel matrix is invertible, solve
| (A.2) |
Scan the indices for roots of . If there are exactly roots, solve the Vandermonde system on these indices using to obtain their candidate values in . Reject this trial if any value has no representative in . Otherwise take those representatives and check all power sums. Retain a trial only if every check passes. If no trial passes, there is no candidate found and the decoder returns .
To see that this procedure finds every valid sparse candidate, suppose has support and matches the power sums. Let for . Then
is invertible over : the indices are distinct, and the nonzero values of remain nonzero modulo . The polynomial satisfies (A.2), so it is precisely the polynomial found at this trial. Its roots and values therefore recover . The zero candidate was handled separately, and uniqueness shows that two successful trials cannot produce different vectors.
Finally, return the candidate only if it also matches , and return otherwise. For a -sparse , the candidate is and always passes. If is not -sparse, any candidate differs from and is determined independently of . The polynomial
is nonzero and has degree at most . It has at most roots, so the probability of false acceptance is at most .
The linear systems have dimension at most , and a candidate uses at most index-value pairs. Gaussian elimination, the scans over indices, and the checks therefore use workspace and polynomial time in the stated parameters. All stored summaries are reduced modulo after each update. Since the final coordinates lie in , arbitrary intermediate integer values do not affect the argument. ∎
We apply this recovery primitive at nested sampling levels. The level is selected from the sketch itself, so it is not enough to establish accuracy at one fixed level. The proof bounds the total probability of an inaccurate estimate over all levels that could be selected.
Lemma A.2 (Bounded-weight moments).
Let satisfy and for . Suppose that can be evaluated in space polynomial in . Then has a one-pass turnstile sketch with the space and success guarantees in (1.3), under the promise on the final vector alone.
Proof.
We first construct one copy with success probability at least . Set
Choose a prime
| (A.3) |
Such a prime exists by Bertrand’s postulate, and may be found by trial division in space. In particular, .
Let be the length- binary representation of . Choose a uniform matrix and a uniform vector , independently, and put . For distinct indices the hash values are independent and uniform: the difference is uniform in , while independently makes either hash value uniform. At level , retain when the first bits of are zero. The indicators are pairwise independent at each level, with retention probability . Level zero retains every coordinate.
At each level maintain the summary in Lemma A.1 for the sampled vector , using independent checksums and the same prime . All checksum seeds are independent of the hashing. At the end, decode the summaries and select the smallest level whose decoder does not return . If this level is , let be its recovered candidate and output
| (A.4) |
summing over its recovered support. If every decoder returns , output zero. Each update can be processed by testing its index at every level and adding its contribution modulo . Even an arbitrarily long binary encoding of can be reduced modulo as it is read, using workspace.
Fix the stream, let , and put . Conditioned on the hash function, the sampled vectors are fixed, and Lemma A.1 applies independently of that conditioning. A union bound gives probability at most
| (A.5) |
that any nonsparse sampled vector is falsely accepted. If , level zero always recovers the full vector, so the estimate is exact, including when .
Suppose now that , and define
Then and . Write for the sampled support size. Pairwise independence gives . Chebyshev’s inequality therefore yields
| (A.6) |
For each , consider the estimator on the true sampled vector,
It satisfies , , and . Hence
No independence between levels is required. Summing these failure probabilities gives
| (A.7) |
If none of the bad events bounded in (A.5)–(A.7) occurs, then level is recoverable, the selected level is at most , and its recovered vector is correct. The output is therefore within . The total failure probability is less than
Choose to be the smallest odd integer at least . Run independent copies and return their median. The probability that at least half the copies fail is at most , by Hoeffding’s inequality applied to their failure indicators. The hash seed uses bits, and the summaries of one copy use bits. Sequential decoding uses an additional workspace, and evaluating requires the polynomial in from the hypothesis. Storing the outputs for their median also fits within (1.3). This proves the stated space bound and success probability. ∎
Appendix B Controlled decompositions for logarithmic moments
The logarithm can be approximated by a small difference of powers: for small , approximates . Multiplying this identity by suggests a split of into a Gaussian exponent and a damped quadratic. The point requiring verification is that the damped term is itself a Lévy exponent. Bernstein-function calculus establishes this and also permits higher finite differences for fixed powers of the logarithm.
Recall that a Bernstein function is a nonnegative smooth function on with completely monotone derivative, meaning for all integers . When , its representation has the form
| (B.1) |
Here is a positive measure on . A complete Bernstein function is a Bernstein function whose measure has a completely monotone density. We use the equivalent analytic characterization: a nonnegative function on with a finite nonnegative limit at zero is a complete Bernstein function if it extends holomorphically to and has nonnegative imaginary part in the upper half-plane [8, Chapters 3 and 6].
For completeness, (B.1) explains why belongs to . For , the Gaussian characteristic-function identity gives
The density in this integral has mass and second moment , so its integral against is at most . Integrating against and applying Tonelli’s theorem gives the integrability condition in (1.1), with Gaussian coefficient . Thus
| (B.2) |
Lemma B.1 (A complete Bernstein kernel).
Let and satisfy . Then
is a complete Bernstein function vanishing at zero.
Proof.
Use principal branches on . If , with , then
Indeed, lies strictly inside the sector between the positive real axis and . It neither vanishes nor meets the negative real axis. Conjugation gives the corresponding statement in the lower half-plane, and the denominator is positive on the positive real axis. The quotient is therefore holomorphic on the slit plane.
The argument of the quotient is . If , it is strictly greater than and at most . If , it equals . Thus the quotient maps the upper half-plane into itself. It is nonnegative on and tends to zero as . The preceding characterization proves the claim. ∎
Proposition B.2 (A single logarithm).
Let , , and . Set . Then
belong to , and for every integer ,
| (B.3) | ||||
| (B.4) |
Proof.
Proposition B.3 (Fixed logarithmic powers).
Fix and an integer . For every and , the function
admits a relative approximation on by a difference of two elements of , with cancellation cost
References
- [1] S. Pettie and D. Wang, Sketching, moment estimation, and the Lévy–Khintchine representation theorem, in 16th Innovations in Theoretical Computer Science Conference (ITCS 2025), LIPIcs 325, 77:1–77:23, 2025. doi:10.4230/LIPIcs.ITCS.2025.77.
- [2] S. Pettie and D. Wang, A unified construction of streaming sketches via the Lévy–Khintchine representation theorem, arXiv:2410.17426v4, 5 April 2026. Expanded manuscript incorporating the ITCS 2025 paper [1] and Universal Perfect Samplers for Incremental Streams (SODA 2025).
- [3] D. Wang, Harmonic decomposition in data sketches, in Proceedings of the 57th Annual ACM Symposium on Theory of Computing (STOC 2025), 383–394, 2025. doi:10.1145/3717823.3718321. Author version: arXiv:2403.15366v3, 2024.
- [4] V. Braverman, S. R. Chestnut, D. P. Woodruff, and L. F. Yang, Streaming space complexity of nearly all functions of one variable on frequency vectors, in Proceedings of the 35th ACM SIGMOD–SIGACT–SIGAI Symposium on Principles of Database Systems (PODS 2016), 261–276, 2016. doi:10.1145/2902251.2902282.
- [5] H. Jowhari, M. Sağlam, and G. Tardos, Tight bounds for samplers, finding duplicates in streams, and related problems, in Proceedings of the 30th ACM SIGMOD–SIGACT–SIGART Symposium on Principles of Database Systems (PODS 2011), 49–58, 2011. doi:10.1145/1989284.1989289.
- [6] G. Cormode and D. Firmani, A unifying framework for -sampling algorithms, Distributed and Parallel Databases 32(3) (2014), 315–335. doi:10.1007/s10619-013-7131-9.
- [7] J. Brillhart, On the Rudin–Shapiro polynomials, Duke Mathematical Journal 40(2) (1973), 335–353.
- [8] R. L. Schilling, R. Song, and Z. Vondraček, Bernstein Functions: Theory and Applications, second revised and extended edition, De Gruyter Studies in Mathematics 37, De Gruyter, 2012. doi:10.1515/9783110269338.