/teal-sea
teal-sea / zeta-labstate of record · compiled 28 Sep 2026 · revision e4945c4 · source

Library · hunts/prime_pair_error/frontier/2026-09-06/certificate_lp_frontier/BARRIER.md

The barrier: what is proved, what is measured, what a proof needs

2,951 words · 283 lines · source

Session 2026-09-07. Companion to RESULTS.md. Everything in Sections 1 and 2 is proved (elementary, finite, checkable by barrier_lemmas.py and tests/test_certificate_lp_barrier.py). Section 3 is measured. Section 4 is the honest statement of the open step. Nothing here is about RH.

Notation as in RESULTS.md: c supported on [1, y], W(n) = sum_j c_j floor(n/j), feasible means W(n) >= 1 for every integer cell 1 <= n <= N, and

E(c) = B(N) - psi(N) = sum_{n=1}^{N} (W(n) - 1) m_n, m_n = psi(N/n) - psi(N/(n+1)) (prime-power mass landing in cell n).

V*(y, N) - psi(N) = min over feasible c of E(c).

1. The dual lemma and its complete parametrization

Lemma 1 (dual). Let delta: {1,...,N} -> R satisfy sum_n delta_n floor(n/j) = 0 for j = 1..y and delta_n >= -m_n for all n. Then E(c) >= sum_n delta_n for every feasible c.

Proof. W - 1 >= 0 and m_n >= -delta_n give E >= -sum_n (W(n) - 1) delta_n = -sum_j c_j sum_n delta_n floor(n/j) + sum_n delta_n = sum_n delta_n. QED.

By LP duality the best such delta attains V*(y,N) - psi(N) exactly; the primes are the point delta = 0.

Lemma 2 (parametrization). Write U(k) = sum_{n >= k} delta_n. Then the moment conditions are sum_{m >= 1} U(jm) = 0 for j <= y, and for ANY function T on (y, N] the choice

U(k) = sum_{m >= 1} mu(m) T(km)

satisfies them, with gain sum_n delta_n = U(1) = sum_{m > y} mu(m) T(m). Conversely every admissible U arises this way (Mobius inversion of T(k) := sum_m U(km), which vanishes for k <= y). The only remaining constraint is

U(k) - U(k+1) >= -m_k (k = 1..N), (C)

i.e. the fake tail sum u* + U may rise from k to k+1 by at most the prime mass m_k of that cell, and may fall freely.

barrier_lemmas.py::restricted_dual maximizes the gain over T supported on (y, Y]; with Y = N it reproduces V*(y,N) - psi(N) to all printed digits at (10^3, 31), which is the numerical check that the parametrization is complete.

Lemma 3 (rough spikes). E(c) >= sum_{y < q <= N, q y-rough} m_q.

Proof (primal). The jump of W at a y-rough q is w(q) = sum_{j | q, j <= y} c_j = c_1 = W(1) >= 1, so W(q) >= W(q-1) + 1 >= 2, and (E) gives the claim. QED. The dual form of the same construction, T(q) = -m_q, is valid only at PRIMES q > y (U(1) = sum_p m_p, U(p) = -m_p, (C) holds); at a composite y-rough q = p1 p2 the term mu(p2) T(q) lands in U(p1) and mu(q) T(q) flips the sign. The two coincide when (y, N] contains no composite y-rough number, which is the case for y >= sqrt(N). Size about N/(y log y). Values: 4.23 (10^3, 31), 15.46 (10^4, 100), 35.81 (10^5, 316), 103.0 (10^6, 1000).

Lemma 5 (staircase). Fix y < Y <= 2y and let A(m) = sum_{m <= k <= Y} m_k be the prime mass in the cells m..Y. Put T(m) = -theta A(m) w(m) on (y, Y] with a ramp w(m) = min(1, (m - y)/L), and U as in Lemma 2. In the top layer k > Y/2 one has U(k) = T(k), and T(k+1) - T(k) = theta [m_k w(k)

Let theta* be the largest theta for which (C) holds in the lower layers k <= Y/2 (an explicit minimum of ratios m_k / (rise of U at k)). Then

E(c) >= theta* . [ - sum_{y < m <= Y} mu(m) A(m) w(m) ],

and since A(m) = psi(N/m) - psi(N/(Y+1)), the bracket is N [ sum_{y<m<=Y} mu(m) w(m) (1/m - 1/Y) ] (1 + o(1)): a smoothed Mobius increment over (y, Y], which is what "the floor pays the drift" means.

Measured (barrier_lemmas.py, tapered_staircase): without the ramp the construction dies at the left edge, because the multiples j(k+1) entering (y, Y] make U rise at the cells k = floor(y/j) with mu(j) = -1 by the whole remaining mass, and cell 33 = floor(100/3) at N = 10^4 contains no prime power (theta* = 0 at every Y tried). With the ramp theta* = 1 at (10^6, 60, Y = 120), gain 1441, rigorous; but the restricted-dual optimum on the same interval is 16969 and the full floor at (10^6, 60) is 58752. The optimal T has the staircase's shape (it rises by exactly m_k at almost every prime cell) plus dips placed at primes with mu = -1, and those dips are worth ten times the smooth part. The sign of the bracket also depends on Y, so the lemma is a bound at the Y where it is positive, not at every Y.

What Lemma 3 cannot do. The natural next construction, T = tau mu(m) on (y, 2y], needs (C) at every k <= 2y with U(k) - U(k+1) < 0, and those include cells with m_k = 0 as soon as 2y exceeds the range where every interval (N/(k+1), N/k] contains a prime power (about k <= N^{0.32} by Baker-Harman- Pintz, and in practice much less: at (10^4, 100) the largest feasible tau is 0). So the sign-alternating dual is dead at y = sqrt(N) for a structural reason: beyond about N^{1/3} the fake measure may only rise at the sparse prime cells floor(N/d), and any lower bound of order N/y or better at y = sqrt(N) must route its gain through the slack in the cells below y.

2. The excess constant of a balanced certificate is a Mobius constant plus a

log-weighted deviation

For the all-N (lifted, regularized) version the excess per unit N is H(c) = -sum_j c_j log j / j - 1 with sum_j c_j / j = 0. Writing c = mu_{<= y} + d:

Proposition 4. With M1(y) = sum_{j<=y} mu(j)/j and I(y) = sum_{j<=y} mu(j) log(y/j)/j - 1 = sum_{j>y} mu(j) log(j/y)/j,

H(c) = I(y) + sum_{j<=y} d_j log(y/j) / j - C(1) log y,

and C(1) = 0 for a balanced certificate, where sum_{j<=y} d_j / j = -M1(y).

Proof. H = -sum_j (mu(j) + d_j) log j/j - 1 = [-sum mu(j) log j/j - 1]

tail sum defining I), and -sum d_j log j/j = sum d_j log(y/j)/j - log y (C(1) - M1(y)). QED. (Pinned as a finite identity in the tests.)

The point: I(y) is a fixed function of y (its Mellin kernel is 1/s^2, so it is O(y^{-1/2}) under RH with no epsilon and Omega(y^{-1/2-eps}) unconditionally), and the whole freedom of a certificate is the log-weighted harmonic sum of its deviation from mu. The balance forces the deviation to carry harmonic mass -M1(y); feasibility (W >= 1) restricts where it may sit. Measured at the LP optimum (10^4, 100): sum d_j log(y/j)/j = +0.0216, I(100) = +0.0010, harmonic mass of d = -0.0271 against -M1(100) = -0.0311, so the finite-N optimum is NOT balanced (C(1) = +0.0041) and pays a residual drift of about C(1) N log(N/y) ~ 190 of its 324. Both candidate laws below are consistent with this identity; it does not by itself decide the exponent.

3. Measured: the floor at support sqrt(N), and the two candidate laws

Ny = sqrt NEE / (0.32 N / sqrt y)E / (NM1(y))
10^33162.91.101.00
10^4100323.61.011.04
2 10^4141603.41.123.86
10^53161781.70.994.73
10^6100010699.9 (CI)1.062.43

The 10^6 row was the discriminating prediction (10.1k against 4.4k) and it landed on the fluctuation law. The (10^7, 3162) row (57k against 41k) timed out in CI at a round-0 lower bound of 40963, which decides nothing. The row that did finish at 10^7 is y = 1000 = N^{0.43}: 111891.5, against 101192 from 0.32 N/sqrt(y) (ratio 1.11, like the other y < sqrt(N) points) and 44100 from N|M1(y)| (ratio 2.54).

After Codex's audit (PR #203). V* is the floor for one weight serving every cutoff; a family c_N serving one cutoff each needs W >= 1 only on the attainable quotients Q_N, giving Codex's T* <= V* with no prime information. Measured (RESULTS.md 4.6): T* = 41.3, 226.8, 1035.2, 6414.8 at N = 10^3 .. 10^6, i.e. 0.23, 0.23, 0.18, 0.20 times N^{3/4}. Same exponent, constant 0.2. The conjecture below is to be read for both V* and T*. Two further corrections from the audit are accepted: the LP optimum is not balanced (Section 2 already records C(1) = +0.0041 at (10^4, 100)), and the unrestricted comparison of the sawtooth variance with the diagonal sum c_j^2 can fail (Codex's primorial family with c_1 = 1 - phi(P)/P), so the conjecture must be about the quadratic form under W >= 1, as stated in Section 4, not about the diagonal.

The fluctuation law 0.32 N / sqrt(y) fits all four points to 12%; the drift N |M1(y)| coincides with it exactly when M1(y) is of its typical size 0.3/sqrt(y) (y = 31, 100) and undershoots by 4-5x at the two zero-crossings (y = 141, 316). Away from y = sqrt(N) the constant moves but the exponent does not: at y = N^{0.3} the ratios to 0.32 N/sqrt(y) are 1.54 (10^5, 30), 1.33 (10^5, 60), 1.42 (10^6, 60), against 3.0 to 3.6 for the drift.

Fourth decade, rigorous. The restricted dual with T on (1000, 10000] at N = 10^6 has gain 7162 with zero moments and nonnegative slack, so V*(1000, 10^6) - psi(10^6) >= 7162 by Lemma 1, before the CI floor lands. The drift law predicted the whole floor at 4410; the fluctuation law predicts 10.1k, and the (y, 10y] restriction captured 70-73% at the smaller sizes.

So the drift is a lower envelope, the fluctuation is the law:

Conjecture (barrier). V*(y, N) - psi(N) >= c N / sqrt(y) for y <= sqrt N, with c about 0.3, for all large N.

The CI batch .github/workflows/certificate-lp-barrier.yml tests it at (10^6, 1000) and (10^7, 3162), where the two laws predict 10.1k vs 4.4k and 57k vs 41k respectively; see RESULTS.md for the numbers when they land.

Where the gain lives. Restricted duals on (y, Y] as a fraction of the full floor:

(N, y)Y = 2y4y10y30yN
(10^3, 31)0.460.650.901.00
(10^4, 100)0.200.510.730.901.00
(10^5, 316)0.320.500.700.871.00

(absolute values at (10^5, 316): 564, 899, 1239, 1559 against the floor 1782; each is a rigorous lower bound in its own right, by Lemma 1.)

Ninety percent of the barrier is decided by cells within a factor 30 of y. A proof can work on (y, Cy] for bounded C.

What the optimum looks like (dense LP at (10^4, 100), results/): c = mu(j) exactly for j <= 16 and irregular fractional coefficients after that; W > 1 on 9889 of the 10^4 cells, with bumps up to 3.5 below y; beyond y the elevation W - 1 averages 1.7 against a prime mass psi(N/y) ~ 94, which is half the excess, the other half being the bumps below y weighted by N/n^2. The fake prime measure of the dual puts zero mass in cells 17, 19, 20 (real mass 38, 26, 25), exactly where W > 1 (complementary slackness), and +401 extra mass in cell 1.

4. The open step, stated precisely

The floor is E = sum_n (W(n) - 1) m_n with W(n) = n C(1) - sum_j c_j {n/j} (sawtooth form). Beyond the Mobius prefix the sum of ~y unit-size sawtooths has variance about (1/12) sum_{j,k} c_j c_k gcd(j,k)^2/(jk), whose diagonal is sum c_j^2 / 12 >= 0.05 y' for a prefix y'. The measured E/(N/y) grows like 0.33 sqrt(y), i.e. the elevation W - 1 beyond y averages a constant times the standard deviation of that sum: the pointwise constraint W >= 1 costs an offset of one to two standard deviations. Measured at the LP optimum (elevation = excess above y divided by the prime mass psi(N/y) there, sigma = standard deviation over n in (y, N] of sum_j c_j {n/j}):

(N, y)excess below yabove ymass above yelevationsigmaelevation/sigmasigma/sqrt(y)
(10^3, 31)22.640.431.91.270.701.810.126
(10^4, 50)331.2205.8195.61.050.641.640.091
(10^4, 100)160.0163.794.01.741.661.050.166
(2 10^4, 141)328.8274.6141.71.941.601.210.135
(10^4, 200), y > sqrt N95.737.549.50.764.670.160.330

The variance is an exact arithmetic quadratic form. Over n the covariance of {n/j} and {n/k} is (gcd(j,k)^2 - 1)/(12 jk) up to the mean corrections, so

Var_n [ sum_j c_j {n/j} ] = (1/12) sum_{j,k} c_j c_k gcd(j,k)^2 / (jk) (1 + o(1)),

checked at the LP optimum to 1%, 3%, 1% at the three sizes above. The diagonal alone, sum c_j^2 / 12, is 0.98, 4.51, 5.26 there against the true 0.49, 2.67, 2.52: the optimizer halves the fluctuation by choosing c with gcd correlations (this is what the period-30030 and mask-210 constructions do by hand), and it does not do better than a factor two. The barrier conjecture is therefore the statement that this quadratic form cannot be driven below a constant times y by any c that keeps W >= 1.

The last row is the finite-N regime: the sawtooth sum is large but its fluctuation sits in cells above sqrt(N) that carry no prime mass, so it costs nothing. That is the precise sense in which a certificate for one cutoff can beat every all-N constant, and why the barrier is stated for y <= sqrt(N).

What is proved above gives only the variance-over-maximum offset (mean elevation >= Var/(max W - 1), order N/y), because the L^2 inequality cannot see a lower tail. The missing ingredient is an anti-concentration statement:

for every feasible c, the sawtooth sum sum_j c_j {n/j} lies at least c sqrt(sum c_j^2) below its mean on a positive proportion of the cells n in (y, Cy], weighted by m_n.

On the dual side the same obstacle has a concrete face. Every cell k <= y with no prime power (m_k = 0) forces U(k) >= U(k+1) exactly, and U(k+1) - U(k) = sum_j mu(j) [T(j(k+1)) - T(jk)] couples T at the multiples of k and k+1. At (10^4, 100) the cell 33 is empty and the optimal T on (100, 200] satisfies T(165) - T(170) = -T(102) to the last digit, which is that one equation; at y = sqrt(N) a positive proportion of the cells in (sqrt(N)/2, sqrt(N)] are empty, so a hand-built T must satisfy hundreds of such linear relations at once. This is why the smooth staircase of Lemma 5 stalls at a few percent of the floor and why the LP optimum looks irregular: it is the solution of the empty-cell equations, with the gain harvested at primes with mu = -1.

For a random-like c the primal statement is a fourth-moment (Paley-Zygmund) inequality about 4-point correlations of sawtooths, which are elementary arithmetic sums. The difficulty is that c is chosen by the adversary to defeat exactly this: Chebyshev's period-30 seed has W in {0, 1}, no Gaussian behaviour at all, and the LP optimum has a heavy upper tail (W up to 112 at (10^5, 316)). Any proof must therefore either (a) show that reducing the lower-tail fluctuation of sum_j c_j {n/j} below sqrt(y) forces c away from mu on the prefix at a cost of order N sum (W(n) - 1)/n^2 that is itself >= N/sqrt(y), or (b) build a dual T on (y, Cy] whose gain is N/sqrt(y) while routing every rise of u* + U through the slack N/k^2 of the cells k <= y. The restricted-dual numbers say (b) exists; the dense-LP dual says it moves prime mass from prime cells (mu = -1) to composite ones (mu = 0, +1) and toward cell 1. Neither construction is in hand.

Unconditionally, M1(y) = Omega(y^{-1/2 - eps}) infinitely often, and every measured floor sits above N |M1(y)|; if that envelope is a theorem (E >= c N |M1(y)|), the floor is infinitely often >= N^{3/4 - eps} at y = sqrt N regardless of RH, which closes the route at that support. That envelope statement is weaker than the conjecture and may be the provable one: it is the assertion that cancelling the Mobius drift with staircases supported above the prefix costs the drift itself, which is a statement about the growth of W_mu(n) = n M1(y) - sum_{j<=y} mu(j) {n/j} on (y, 2y] where W_mu(n) = 1 - (M(n) - M(y)) is literally the Mertens function.