Design preview · Back to the main design
MAIS Math for AI Safety

Main page › All problems

Polynomial overhead for Löb's theorem

MAIS-O10 · open problem

Open problem MAIS-O10 · posed in MAIS-A1 as Conjecture 3.5 · Status: open.

Tags: cooperative AI · agent foundations · Löbian cooperation · proof-based agents · bounded rationality · logic · complexity theory. Difficulty: ★★.

Authored by: Claude Fable 5 directed by Lionel Levine · Audited by: GPT 5.6 Sol.

How much can proving $\Box P \to P$ save over proving $P$ directly? If the answer is "only polynomially much," then every proof budget in the Löbian cooperation story of Critch [C19] — the thresholds at which source-reading agents establish each other's cooperation — becomes polynomially effective. This page states the expected answer; deciding it is the problem.

Work in an efficient proof system, by default $\mathsf{PA}_{\mathrm{bin}}$: Peano arithmetic with binary numerals and an abbreviation rule (an expression used many times is paid for once), all proof lengths counted in symbols. The overhead below depends on these conventions, and MAIS-A1 fixes them exactly, down to the Gödel coding. Write $\ell_S(\varphi)$ for the least symbol length of an $S$-proof of $\varphi$ and $\Box P$ for arithmetized provability. The Löb overhead is $F_S(k,n)$, the maximum of $\ell_S(P)$ over sentences $P$ with $|P|\le n$ and $\ell_S(\Box P\to P)\le k$: the hardest-to-prove sentence among those whose reflection instance has a $k$-symbol proof (see MAIS-O1).

The expected answer comes from the agenda's ledger, an itemized symbol-count of the standard proof of Löb's theorem — diagonalize, internalize the fixed point, chain with the given proof, notice the resulting proof. Totaled, the ledger gives the heuristic bound $F_S(k,n) \lesssim \mathcal{E}_S(k + d_S(O(n)) + \mathrm{poly}(n)) + k + d_S(O(n)) + \mathrm{poly}(n)$, where $\mathcal{E}_S(m)$ prices the act of noticing a proof (the cost of proving "$\varphi$ has a proof of at most $m$ symbols" when you hold such a proof) and $d_S(n)$ prices diagonalization (the cost of proving the fixed-point equivalence for formulas of length $n$).

Conjecture (MAIS-A1, Conjecture 3.5). There are constants $C, c$ (depending on the system) with

$$F_{\mathsf{PA}_{\mathrm{bin}}}(k,n) \ \le\ C\ (k+n)^{c} \quad \text{for all } k, n.$$

In the strong form: $F_{\mathsf{PA}_{\mathrm{bin}}}(k,n) \le C\ (k + n^{c})$, i.e. the premise length enters linearly. The strong form would follow from the ledger together with a linear expansion function ($\mathcal{E}_{\mathsf{PA}_{\mathrm{bin}}}(m) = O(m)$) and polynomial $d_S$.

A concrete route in: carry out the ledger for $\mathsf{PA}_{\mathrm{bin}}$ with explicit constants, using the length-tracked derivability conditions in Pudlák's Handbook chapter [P98], and read off explicit $C, c$. No published proof carries this out for any concrete system. For the ledger and the surrounding formalism, see MAIS-A1.

References

  • [P98] P. Pudlák, The lengths of proofs, in: Handbook of Proof Theory (S. R. Buss, ed.), Elsevier, 1998, pp. 547–637.
  • [C19] A. Critch, A parametric, resource-bounded generalization of Löb's theorem, and a robust cooperation criterion for open-source game theory, Journal of Symbolic Logic 84 (2019), no. 4, 1368–1381. arXiv:1602.04184

Related: MAIS-O1 (the overhead function this conjecture answers) · MAIS-O12 (the constants $\mathcal{E}_S$ and $d_S$ the strong form needs) · MAIS-O11 (the lower-bound counterpart).

Adapted to HTML from MAIS source · 1cb9f00. Original authorship is credited above. Licensed under CC BY 4.0.