Cite

This course has no released version yet: the text at this address may change. Cite a released version when one exists.

/courses/induction-conservation/first-order-parts
@misc{induction-conservation-first-order-parts,
  title = {{First-order parts and conservation}},
  howpublished = {Lesson 3 of \emph{Induction and conservation}, Computability Theory course notes},
  url = {/courses/induction-conservation/first-order-parts},
  note = {Unreleased working version}
}

To cite a single statement, use the # link that appears next to its heading.

Lesson 3 of 4

First-order parts and conservation

Conservative extensions and ω-extensions; ACA₀ is conservative over Peano arithmetic and RCA₀ over IΣ₁ (Friedman), by expanding a model of arithmetic with its definable sets; the Jockusch–Solovay bound on the solutions provided by ACA₀, and the unprovability of ACA₀′.

40 min2 questions
Induction and conservation · lesson 3 of 4
  1. Induction, collection and least numbers
  2. The pigeonhole principle and Σ⁰₂ collection
  3. First-order parts and conservation
  4. Harrington's conservation theorem

A subsystem of second-order arithmetic proves sentences about sets, but also sentences about numbers alone. Its first-order part is the set of sentences of first-order arithmetic that it proves. This lesson identifies the first-order parts of ACA0\mathsf{ACA}_0 and RCA0\mathsf{RCA}_0: they are Peano arithmetic and IΣ1\mathrm I\Sigma_1. The method is model-theoretic: a model of the first-order theory is expanded into a model of the second-order theory with the same numbers, by adding the sets that are definable in it.

3.1 Conservative extensions

The language L1\mathcal L_1 of first-order arithmetic is L2\mathcal L_2 without set variables and without ∈\in. Peano arithmetic PA\mathrm{PA} consists of the basic axioms and the induction scheme for all formulas of L1\mathcal L_1, and IΣn\mathrm I\Sigma_n of the basic axioms and induction for Σn\Sigma_n formulas of L1\mathcal L_1; formulas of L1\mathcal L_1 may contain number parameters only. The results of the first lesson apply to these theories, with the same proofs.

Definition 3.1.#

Let SS and TT be theories, in languages LS⊆LT\mathcal L_S \subseteq \mathcal L_T, and Γ\Gamma a set of sentences of LS\mathcal L_S. The theory TT is Γ\Gamma-conservative over SS if every sentence of Γ\Gamma provable in TT is provable in SS. If TT proves every axiom of SS and is conservative over SS for all sentences of LS\mathcal L_S, then TT is a conservative extension of SS, and the theorems of SS are the first-order part of TT when LS=L1\mathcal L_S = \mathcal L_1.

Definition 3.2.#

An L2\mathcal L_2-structure N\mathcal N is an ω-extension of an L2\mathcal L_2-structure M\mathcal M if both have the same first-order part, with the same operations, and the second-order part of M\mathcal M is included in that of N\mathcal N. An L2\mathcal L_2-structure N\mathcal N is an ω-extension of an L1\mathcal L_1-structure MM if its first-order part is MM.

The name refers to the fact that the numbers are unchanged; an ω-extension need not be an ω-model. Satisfaction of an arithmetic formula, with parameters in the smaller structure, is the same in both structures, since set quantifiers do not occur and number quantifiers range over the same domain.

We use two facts from logic, for countable languages: the completeness theorem, already used in the course on second-order arithmetic, and the fact that a consistent theory has a countable model, which follows from the usual proof of completeness.

Proposition 3.3.#

Let SS be an L1\mathcal L_1-theory and TT an L2\mathcal L_2-theory. If every countable model of SS has an ω-extension that satisfies TT, then TT is L1\mathcal L_1-conservative over SS.

Proof of Proposition 3.3.

Let σ\sigma be an L1\mathcal L_1 sentence not provable in SS. Then S+¬σS + \neg \sigma is consistent, and has a countable model MM. Let N\mathcal N be an ω-extension of MM satisfying TT. Since σ\sigma has no set variables, N⊨¬σ\mathcal N \models \neg \sigma. So T+¬σT + \neg \sigma has a model, and TT does not prove σ\sigma.

3.2 Peano arithmetic and ACA₀

Theorem 3.4 (Friedman).#

ACA0\mathsf{ACA}_0 is a conservative extension of PA\mathrm{PA}.

Proof of Theorem 3.4.

ACA0\mathsf{ACA}_0 proves the induction scheme for arithmetic formulas, in particular for all formulas of L1\mathcal L_1 (Definition 1.1 of “Arithmetic comprehension” and Proposition 1.3 of “The language and models of second-order arithmetic”). Conversely, let MM be a countable model of PA\mathrm{PA}, and let D\mathcal D be the class of subsets of MM definable in MM by a formula of L1\mathcal L_1 with parameters in MM. Let N=(M,D)\mathcal N = (M, \mathcal D). We show N⊨ACA0\mathcal N \models \mathsf{ACA}_0, which proves the theorem by Proposition 3.3.

The basic axioms hold since MM satisfies them. Let φ(n)\varphi(n) be an arithmetic formula with set parameters X1,…,Xk∈DX_1, \dots, X_k \in \mathcal D and number parameters in MM, and let δi(u)\delta_i(u) be an L1\mathcal L_1 formula with parameters defining XiX_i in MM. Replacing every atomic formula t∈Xit \in X_i by δi(t)\delta_i(t) gives an L1\mathcal L_1 formula φ∗\varphi^* with parameters in MM, and for every n∈Mn \in M, N⊨φ(n)\mathcal N \models \varphi(n) if and only if M⊨φ∗(n)M \models \varphi^*(n), by induction on φ\varphi. So the set defined by φ\varphi in N\mathcal N is defined by φ∗\varphi^* in MM, and belongs to D\mathcal D: arithmetic comprehension holds. For the same reason, Σ10\Sigma^0_1 induction in N\mathcal N reduces to induction in MM for φ∗\varphi^*, which holds in PA\mathrm{PA}.

So the arithmetic consequences of arithmetic comprehension are exactly the theorems of Peano arithmetic. The point of the proof is that the sets added are definable from the numbers, so that statements about them translate back into first-order statements.

3.3 IΣ₁ and RCA₀

For RCA0\mathsf{RCA}_0, the analogous class consists of the Δ1\Delta_1-definable sets. A set X⊆MX \subseteq M is Δ1\Delta_1-definable in a model MM of L1\mathcal L_1 if there are a Σ1\Sigma_1 formula φ\varphi and a Π1\Pi_1 formula ψ\psi of L1\mathcal L_1, with parameters in MM, such that X={n:M⊨φ(n)}={n:M⊨ψ(n)}X = \{ n : M \models \varphi(n) \} = \{ n : M \models \psi(n) \}. The same definition applies to Σ10\Sigma^0_1 and Π10\Pi^0_1 formulas of L2\mathcal L_2 with parameters in an L2\mathcal L_2-structure. Substitution is now delicate: replacing t∈Xt \in X by a Σ1\Sigma_1 formula inside a bounded universal quantifier gives a formula that is not Σ1\Sigma_1, and collection is needed to restore the form.

Lemma 3.5.#

Let M\mathcal M be an L2\mathcal L_2-structure satisfying IΔ00+BΣ10\mathsf I\Delta^0_0 + \mathsf B\Sigma^0_1, and X1,…,Xk⊆MX_1, \dots, X_k \subseteq M sets Δ1\Delta_1-definable in M\mathcal M. Let M′\mathcal M' be the ω-extension of M\mathcal M obtained by adding X1,…,XkX_1, \dots, X_k. For every Σ10\Sigma^0_1 formula θ\theta with parameters in M′\mathcal M', there is a Σ10\Sigma^0_1 formula θ∗\theta^* with parameters in M\mathcal M, with the same free variables, such that M′⊨∀xˉ (θ↔θ∗)\mathcal M' \models \forall \bar x\, (\theta \leftrightarrow \theta^*). The same holds for Π10\Pi^0_1 formulas. If M\mathcal M is an L1\mathcal L_1-structure, in which case M′\mathcal M' has X1,…,XkX_1, \dots, X_k as its only sets, θ∗\theta^* is a formula of L1\mathcal L_1.

Proof of Lemma 3.5.

Let φi\varphi_i and ψi\psi_i be Σ10\Sigma^0_1 and Π10\Pi^0_1 formulas with parameters in M\mathcal M defining XiX_i. Write θ=∃y δ\theta = \exists y\, \delta with δ\delta bounded, and put δ\delta in negation normal form, so that negations only apply to atomic formulas. Replace every atomic formula t∈Xit \in X_i by φi(t)\varphi_i(t), and every negated atomic formula t∉Xit \notin X_i by ¬ψi(t)\neg \psi_i(t), a Σ10\Sigma^0_1 formula. The result δ′\delta' has parameters in M\mathcal M, and is equivalent to δ\delta in M′\mathcal M', since the replaced formulas are equivalent there. It is built from Σ10\Sigma^0_1 formulas by ∧\wedge, ∨\vee and bounded quantifiers, so by Lemma 1.3, applied in M\mathcal M, which satisfies BΣ10\mathsf B\Sigma^0_1, it is equivalent in M\mathcal M to a Σ10\Sigma^0_1 formula δ∗\delta^*. The equivalence involves no XiX_i, so it also holds in M′\mathcal M'. Let θ∗=∃y δ∗\theta^* = \exists y\, \delta^*. For a Π10\Pi^0_1 formula, apply the result to its negation. If M\mathcal M has no sets, the formulas φi,ψi\varphi_i, \psi_i and the result are formulas of L1\mathcal L_1.

Theorem 3.6 (Friedman).#

RCA0\mathsf{RCA}_0 is a conservative extension of IΣ1\mathrm I\Sigma_1.

Proof of Theorem 3.6.

RCA0\mathsf{RCA}_0 proves Σ10\Sigma^0_1 induction, in particular for formulas of L1\mathcal L_1. Conversely, let MM be a countable model of IΣ1\mathrm I\Sigma_1, and D\mathcal D the class of sets Δ1\Delta_1-definable in MM. By Theorem 1.5, MM satisfies Σ1\Sigma_1 collection. Let N=(M,D)\mathcal N = (M, \mathcal D). Every formula with parameters in N\mathcal N uses finitely many sets of D\mathcal D, so Lemma 3.5 applies to it.

  • Basic axioms: they hold in MM.
  • Σ10\Sigma^0_1 induction: let θ(x)\theta(x) be Σ10\Sigma^0_1 with parameters in N\mathcal N, and θ∗\theta^* the Σ1\Sigma_1 formula of L1\mathcal L_1 given by the lemma. Induction holds in MM for θ∗\theta^*, hence in N\mathcal N for θ\theta.
  • Δ10\Delta^0_1 comprehension: let φ\varphi be Σ10\Sigma^0_1 and ψ\psi be Π10\Pi^0_1, with parameters in N\mathcal N, such that N⊨∀n (φ(n)↔ψ(n))\mathcal N \models \forall n\, (\varphi(n) \leftrightarrow \psi(n)). The lemma gives φ∗\varphi^* in Σ1\Sigma_1 and ψ∗\psi^* in Π1\Pi_1, both formulas of L1\mathcal L_1 that define the same set XX in MM. So X∈DX \in \mathcal D, and N⊨∀n (n∈X↔φ(n))\mathcal N \models \forall n\, (n \in X \leftrightarrow \varphi(n)).

So N⊨RCA0\mathcal N \models \mathsf{RCA}_0, and Proposition 3.3 concludes.

RCA0\mathsf{RCA}_0 thus proves exactly the arithmetic sentences of IΣ1\mathrm I\Sigma_1, and in particular, by the theorem of Paris and Kirby recalled in the previous lesson, it does not prove BΣ20\mathsf B\Sigma^0_2. Parsons showed that IΣ1\mathrm I\Sigma_1 proves the same Π2\Pi_2 sentences as primitive recursive arithmetic; a Π2\Pi_2 sentence ∀x ∃y φ(x,y)\forall x\, \exists y\, \varphi(x, y), with φ\varphi bounded, provable in RCA0\mathsf{RCA}_0 therefore has a primitive recursive witness function.

3.4 The Jockusch–Solovay bound

ACA0\mathsf{ACA}_0 proves, for each standard kk, that every set has a kk-th jump. The next theorem shows that its theorems of the form “for every instance, there is a solution” always have solutions of bounded arithmetic complexity. We write Y≤TX(k)Y \leq_T X^{(k)} for the formula “there is ZZ coding a sequence Z0,…,ZkZ_0, \dots, Z_k with Z0=XZ_0 = X, Zi+1=Zi′Z_{i+1} = Z_i' for i<ki < k, and Y≤TZkY \leq_T Z_k”; in ACA0\mathsf{ACA}_0 such a ZZ exists and is unique. We use the formalized version of Post’s theorem: ACA0\mathsf{ACA}_0 proves that every set defined by a Σk0\Sigma^0_k formula with set parameter XX is computable in X(k)X^{(k)}. We admit this formalization (Simpson, Section VIII.1).

Theorem 3.7 (Jockusch, Solovay).#

Let F(X)F(X) and G(X,Y)G(X, Y) be arithmetic formulas without other free variables. If ACA0\mathsf{ACA}_0 proves ∀X (F(X)→∃Y G(X,Y))\forall X\, (F(X) \rightarrow \exists Y\, G(X, Y)), then there is k∈Nk \in \nat such that ACA0\mathsf{ACA}_0 proves ∀X (F(X)→∃Y (Y≤TX(k)∧G(X,Y)))\forall X\, (F(X) \rightarrow \exists Y\, (Y \leq_T X^{(k)} \wedge G(X, Y))).

Proof of Theorem 3.7.

Suppose the conclusion fails for every kk. Add a set constant CC to the language, and let γk\gamma_k be the sentence ∀Y (Y≤TC(k)→¬G(C,Y))\forall Y\, (Y \leq_T C^{(k)} \rightarrow \neg G(C, Y)). For each kk, ACA0+F(C)+γk\mathsf{ACA}_0 + F(C) + \gamma_k is consistent. Since ACA0\mathsf{ACA}_0 proves γk+1→γk\gamma_{k+1} \rightarrow \gamma_k, every finite subset of ACA0+F(C)+{γk:k∈N}\mathsf{ACA}_0 + F(C) + \{ \gamma_k : k \in \nat \} is consistent, so the whole theory has a model M=(M,S,C)\mathcal M = (M, \mathcal S, C) by compactness.

Let S′\mathcal S' be the class of sets in S\mathcal S definable in M\mathcal M by an arithmetic formula with set parameter CC and number parameters, and M′=(M,S′)\mathcal M' = (M, \mathcal S'). Then M′⊨ACA0\mathcal M' \models \mathsf{ACA}_0: a set defined by an arithmetic formula with parameters in S′\mathcal S' is, after substitution of their definitions, defined by an arithmetic formula with parameter CC; it exists in S\mathcal S by arithmetic comprehension in M\mathcal M, so it belongs to S′\mathcal S'; induction holds since S′⊆S\mathcal S' \subseteq \mathcal S.

The formula F(C)F(C) is arithmetic and holds in M\mathcal M, so it holds in M′\mathcal M'. Let Y∈S′Y \in \mathcal S', defined by a Σk0\Sigma^0_k formula with parameter CC, for some standard kk. By the formalized Post theorem, M⊨Y≤TC(k)\mathcal M \models Y \leq_T C^{(k)}, so M⊨¬G(C,Y)\mathcal M \models \neg G(C, Y) by γk\gamma_k, and M′⊨¬G(C,Y)\mathcal M' \models \neg G(C, Y). Hence M′⊨F(C)∧∀Y ¬G(C,Y)\mathcal M' \models F(C) \wedge \forall Y\, \neg G(C, Y), and ACA0\mathsf{ACA}_0 does not prove ∀X (F(X)→∃Y G(X,Y))\forall X\, (F(X) \rightarrow \exists Y\, G(X, Y)), contrary to the hypothesis.

Let ACA0′\mathsf{ACA}_0' be RCA0\mathsf{RCA}_0 together with the axiom “for every nn and every XX, there is a sequence Y0,…,YnY_0, \dots, Y_n with Y0=XY_0 = X and Yi+1=Yi′Y_{i+1} = Y_i' for i<ni < n”. Every ω-model of ACA0\mathsf{ACA}_0 satisfies it, since it is closed under the jump and its numbers are standard.

Corollary 3.8.#

ACA0\mathsf{ACA}_0 does not prove ACA0′\mathsf{ACA}_0'.

Proof of Corollary 3.8.

Let F(X)F(X) be “the column X[0]X^{[0]} is non-empty”, and G(X,Y)G(X, Y) be ”YY codes a sequence Y0,…,YnY_0, \dots, Y_n with Y0=X[1]Y_0 = X^{[1]}, Yi+1=Yi′Y_{i+1} = Y_i', where nn is the least element of X[0]X^{[0]}”. Both are arithmetic, and ACA0′\mathsf{ACA}_0' proves ∀X (F(X)→∃Y G(X,Y))\forall X\, (F(X) \rightarrow \exists Y\, G(X, Y)). If ACA0\mathsf{ACA}_0 proved it, then for some kk it would prove the version with Y≤TX(k)Y \leq_T X^{(k)}, and this version would hold in the ω-model P(N)\mathcal P(\nat). Take XX with X[0]={k+1}X^{[0]} = \{ k + 1 \} and X[1]=∅X^{[1]} = \emptyset; then X≡T∅X \equiv_T \emptyset, and a solution YY computes ∅(k+1)\emptyset^{(k+1)} while Y≤TX(k)≡T∅(k)Y \leq_T X^{(k)} \equiv_T \emptyset^{(k)}, which contradicts the jump theorem.

The separation needs non-standard models: in a model of ACA0+¬ACA0′\mathsf{ACA}_0 + \neg \mathsf{ACA}_0', some non-standard nn has no sequence of nn jumps, because the induction needed to iterate the jump nn times is not available.

3.5 Exercises

Exercise 3.9 ★.

Show that WKL0\mathsf{WKL}_0 is not L1\mathcal L_1-conservative over IΣ1\mathrm I\Sigma_1 if and only if it proves an L1\mathcal L_1 sentence that RCA0\mathsf{RCA}_0 does not prove. Deduce from Theorem 3.6 that, to show that WKL0\mathsf{WKL}_0 is a conservative extension of IΣ1\mathrm I\Sigma_1, it suffices to show that every countable model of RCA0\mathsf{RCA}_0 has an ω-extension satisfying WKL0\mathsf{WKL}_0.

Solution

By Theorem 3.6, the L1\mathcal L_1 sentences provable in RCA0\mathsf{RCA}_0 are those provable in IΣ1\mathrm I\Sigma_1, and WKL0\mathsf{WKL}_0 proves all of them; this gives the first statement. Suppose every countable model of RCA0\mathsf{RCA}_0 has an ω-extension satisfying WKL0\mathsf{WKL}_0, and let σ\sigma be an L1\mathcal L_1 sentence not provable in RCA0\mathsf{RCA}_0. A countable model of RCA0+¬σ\mathsf{RCA}_0 + \neg \sigma has an ω-extension satisfying WKL0\mathsf{WKL}_0, in which ¬σ\neg \sigma still holds, so WKL0\mathsf{WKL}_0 does not prove σ\sigma. With the first statement, WKL0\mathsf{WKL}_0 is a conservative extension of IΣ1\mathrm I\Sigma_1.

Exercise 3.10 ★★.

Let MM be a countable model of IΣ1\mathrm I\Sigma_1 and N=(M,D)\mathcal N = (M, \mathcal D) the model of the proof of Theorem 3.6. Show that D\mathcal D is the least second-order part of a model of RCA0\mathsf{RCA}_0 with first-order part MM: every model (M,S)(M, \mathcal S) of RCA0\mathsf{RCA}_0 satisfies D⊆S\mathcal D \subseteq \mathcal S.

Solution

Let X∈DX \in \mathcal D, defined in MM by a Σ1\Sigma_1 formula φ\varphi and a Π1\Pi_1 formula ψ\psi of L1\mathcal L_1. In (M,S)(M, \mathcal S), these formulas have the same meaning, since they contain no set variables, so (M,S)⊨∀n (φ(n)↔ψ(n))(M, \mathcal S) \models \forall n\, (\varphi(n) \leftrightarrow \psi(n)). By Δ10\Delta^0_1 comprehension in (M,S)(M, \mathcal S), there is Y∈SY \in \mathcal S with (M,S)⊨∀n (n∈Y↔φ(n))(M, \mathcal S) \models \forall n\, (n \in Y \leftrightarrow \varphi(n)), that is, Y=XY = X. This is the analogue, for non-standard models, of the fact that the computable sets form the least ω-model of RCA0\mathsf{RCA}_0.

3.6 Notes and references

Friedman announced the conservation results of this lesson in 1976; the proofs are in Simpson’s monograph, Section IX.1. The Jockusch–Solovay theorem was observed independently by both authors; the proof presented here was communicated by Jockusch, and appears in a paper of Wang.

  • H. Friedman, Systems of second order arithmetic with restricted induction I, II (abstracts), Journal of Symbolic Logic 41 (1976), 557–559.
  • S. G. Simpson, Subsystems of Second Order Arithmetic, 2nd edition, Cambridge University Press, 2009, Chapter IX.
  • C. Parsons, On a number theoretic choice schema and its relation to induction, in Intuitionism and Proof Theory, North-Holland, 1970, 459–473.