Cite

This course has no released version yet: the text at this address may change. Cite a released version when one exists.

/courses/martin-lof-randomness/randomness-and-degrees
@misc{martin-lof-randomness-randomness-and-degrees,
  title = {{Randomness and Turing degrees}},
  howpublished = {Lesson 4 of \emph{Martin-Löf randomness}, Computability Theory course notes},
  url = {/courses/martin-lof-randomness/randomness-and-degrees},
  note = {Unreleased working version}
}

To cite a single statement, use the # link that appears next to its heading.

Lesson 4 of 4

Randomness and Turing degrees

Sacks's theorem that upper cones of non-computable sets are null; the Kučera–Gács theorem that every set is computable from a random sequence; random sequences compute DNC functions, and DNC degrees are characterized by complexity.

40 min6 questions
Before this lesson:The Levin–Schnorr theorem · Diagonally non-computable functions (Immunity and growth of functions)
Martin-Löf randomness · lesson 4 of 4
  1. Measure on Cantor space
  2. Martin-Löf tests
  3. The Levin–Schnorr theorem
  4. Randomness and Turing degrees

Random sequences are typical with respect to measure, and one may ask what they can compute. Two results point in opposite directions. Sacks’s theorem says that a non-computable set is computed by a null class of oracles only: a sequence chosen at random computes it with probability 00. The Kučera–Gács theorem says that every set is nevertheless computed by some Martin-Löf random sequence. The lesson ends with a computational property shared by all random sequences: they compute diagonally non-computable functions.

For a string τ\tau, Φeτ(n) ⁣ ⁣↓=i\Phi^\tau_e(n)\converge = i means that the computation of Φe\Phi_e on input nn with oracle τ\tau halts with output ii and only queries the oracle below ∣τ∣|\tau|; by Proposition 1.5 of “Computation relative to an oracle”, it then holds with every oracle extending τ\tau.

4.1 Upper cones are null

Theorem 4.1 (Sacks).#

If YY is not computable, then λ({X:Y≤TX})=0\lambda(\{ X : Y \leq_T X \}) = 0.

Proof of Theorem 4.1.

The class {X:Y≤TX}\{ X : Y \leq_T X \} is the union over ee of the classes Ce={X:ΦeX=Y}\mathcal C_e = \{ X : \Phi^X_e = Y \}. Each Ce\mathcal C_e is Borel: X∈CeX \in \mathcal C_e if and only if for every nn there is a prefix τ\tau of XX with Φeτ(n) ⁣ ⁣↓=Y(n)\Phi^\tau_e(n)\converge = Y(n). By subadditivity, it suffices to show that each Ce\mathcal C_e is null.

Suppose that λ(Ce)>0\lambda(\mathcal C_e) > 0. By the density lemma (Lemma 1.6), there is a string σ\sigma with λ(Ce∣σ)>12\lambda(\mathcal C_e \mid \sigma) > \frac12. For n∈Nn \in \nat and i∈{0,1}i \in \{0, 1\}, let Un,i\mathcal U_{n,i} be the open class generated by the strings τ⪰σ\tau \succeq \sigma with Φeτ(n) ⁣ ⁣↓=i\Phi^\tau_e(n)\converge = i; these classes are uniformly Σ10\Sigma^0_1.

  • Ce∩[σ]⊆Un,Y(n)\mathcal C_e \cap [\sigma] \subseteq \mathcal U_{n, Y(n)}, so λ(Un,Y(n)∣σ)>12\lambda(\mathcal U_{n, Y(n)} \mid \sigma) > \frac12.
  • Un,0\mathcal U_{n,0} and Un,1\mathcal U_{n,1} are disjoint: a sequence in both would have prefixes τ,τ′\tau, \tau' with Φeτ(n) ⁣ ⁣↓=0\Phi^\tau_e(n)\converge = 0 and Φeτ′(n) ⁣ ⁣↓=1\Phi^{\tau'}_e(n)\converge = 1, and by monotonicity the longer of the two would give both outputs. So λ(Un,1−Y(n)∣σ)<12\lambda(\mathcal U_{n, 1 - Y(n)} \mid \sigma) < \frac12.

To compute Y(n)Y(n), enumerate Un,0\mathcal U_{n,0} and Un,1\mathcal U_{n,1} until the measure of the finite part of one of them inside [σ][\sigma] exceeds 2−∣σ∣−12^{-|\sigma| - 1}, and output the corresponding ii. The search terminates by the first item, since the measure of Un,Y(n)∩[σ]\mathcal U_{n, Y(n)} \cap [\sigma] is approached from below, and its output is Y(n)Y(n) by the second. This computes YY, a contradiction.

The proof is a majority vote: if a positive proportion of the oracles compute YY through Φe\Phi_e, the oracles extending σ\sigma agree in their majority with YY, and the majority can be detected effectively. Sacks’s theorem is the measure-theoretic analogue of the fact that upper cones of non-computable sets are meager.

Corollary 4.2.#

For every non-computable YY, almost every sequence fails to compute YY. In particular the class of sequences computing ∅′\emptyset' is null.

This class nevertheless contains random sequences, such as Ω\Omega (Corollary 3.3). Martin-Löf tests capture only effectively null classes, and the null class {X:∅′≤TX}\{ X : \emptyset' \leq_T X \}, which is Σ40\Sigma^0_4, is not contained in any of them.

4.2 Every set is computable from a random sequence

A computable tree in which every node has two incomparable extensions has members of every Turing degree above its own. The tree of a Π10\Pi^0_1 class may have dead ends, and one cannot tell effectively which nodes branch. When the class has positive measure, branching nodes appear at a bounded depth.

Lemma 4.3 (Kučera).#

Let B\mathcal B be a Borel class, σ\sigma a string and k∈Nk \in \nat with λ(B∣σ)≥2−k\lambda(\mathcal B \mid \sigma) \geq 2^{-k}. Then there are at least two strings τ⪰σ\tau \succeq \sigma of length ∣σ∣+k+1|\sigma| + k + 1 with λ(B∣τ)≥2−k−1\lambda(\mathcal B \mid \tau) \geq 2^{-k-1}.

Proof of Lemma 4.3.

λ(B∣σ)\lambda(\mathcal B \mid \sigma) is the average of λ(B∣τ)\lambda(\mathcal B \mid \tau) over the 2k+12^{k+1} strings τ⪰σ\tau \succeq \sigma of length ∣σ∣+k+1|\sigma| + k + 1. If at most one of them had relative measure at least 2−k−12^{-k-1}, this one being at most 11 and the others less than 2−k−12^{-k-1}, the average would be less than

2−k−1(1+(2k+1−1) 2−k−1)=2−k−1+2−k−1−2−2k−2<2−k,2^{-k-1} \left( 1 + (2^{k+1} - 1)\, 2^{-k-1} \right) = 2^{-k-1} + 2^{-k-1} - 2^{-2k-2} < 2^{-k},

a contradiction.

Theorem 4.4 (Kučera, Gács).#

Let P\mathcal P be a Π10\Pi^0_1 class of positive measure. For every set XX, there is Z∈PZ \in \mathcal P with X≤TZX \leq_T Z and Z≤TX⊕∅′Z \leq_T X \oplus \emptyset'. In particular, every set is computable from a Martin-Löf random sequence, and every Turing degree above 0′\obf' contains a random sequence.

Proof of Theorem 4.4.

Let P=[T]\mathcal P = [T] with TT computable, and let cc be such that λ(P)≥2−c\lambda(\mathcal P) \geq 2^{-c}. Let m0=0m_0 = 0 and mn+1=mn+c+n+1m_{n+1} = m_n + c + n + 1. For a string σ\sigma of length mnm_n, let An(σ)A_n(\sigma) be the set of strings τ⪰σ\tau \succeq \sigma of length mn+1m_{n+1} with λ(P∣τ)≥2−c−n−1\lambda(\mathcal P \mid \tau) \geq 2^{-c-n-1}. By Lemma 4.3 with k=c+nk = c + n, if λ(P∣σ)≥2−c−n\lambda(\mathcal P \mid \sigma) \geq 2^{-c-n}, then An(σ)A_n(\sigma) has at least two elements.

Construction. Let σ0\sigma_0 be the empty string; λ(P∣σ0)=λ(P)≥2−c\lambda(\mathcal P \mid \sigma_0) = \lambda(\mathcal P) \geq 2^{-c}. Given σn\sigma_n of length mnm_n with λ(P∣σn)≥2−c−n\lambda(\mathcal P \mid \sigma_n) \geq 2^{-c-n}, let σn+1\sigma_{n+1} be the leftmost element of An(σn)A_n(\sigma_n) if X(n)=0X(n) = 0, and the rightmost one if X(n)=1X(n) = 1, for the lexicographic order. It satisfies λ(P∣σn+1)≥2−c−n−1\lambda(\mathcal P \mid \sigma_{n+1}) \geq 2^{-c-n-1}. Let Z=⋃nσnZ = \bigcup_n \sigma_n. Each [σn][\sigma_n] meets P\mathcal P, since it has positive relative measure, so every prefix of ZZ is extendible in TT and Z∈PZ \in \mathcal P.

Z≤TX⊕∅′Z \leq_T X \oplus \emptyset'. By Proposition 1.3 (2) applied to the Π10\Pi^0_1 class P∩[τ]\mathcal P \cap [\tau], the relative measure λ(P∣τ)\lambda(\mathcal P \mid \tau) is right-c.e., uniformly in τ\tau. So the condition λ(P∣τ)≥q\lambda(\mathcal P \mid \tau) \geq q, for a rational qq, is Π10\Pi^0_1: it fails if and only if some approximation from above falls below qq. With ∅′\emptyset', one computes An(σn)A_n(\sigma_n) from σn\sigma_n, and with XX one chooses σn+1\sigma_{n+1}.

X≤TZX \leq_T Z. The sets An(σ)A_n(\sigma) are co-c.e. uniformly in nn and σ\sigma: there are finite sets An,s(σ)A_{n,s}(\sigma), computable from nn, σ\sigma, ss, decreasing in ss, with intersection An(σ)A_n(\sigma). To compute X(n)X(n), let σ=Z ⁣↾mn=σn\sigma = Z \uh m_n = \sigma_n and τ=Z ⁣↾mn+1=σn+1\tau = Z \uh m_{n+1} = \sigma_{n+1}, and search for a stage ss at which τ\tau is the leftmost or the rightmost element of An,s(σ)A_{n,s}(\sigma); output 00 in the first case and 11 in the second. Suppose X(n)=0X(n) = 0, so that τ\tau is the leftmost element of An(σ)A_n(\sigma). The finitely many strings of length mn+1m_{n+1} to the left of τ\tau are not in An(σ)A_n(\sigma), so they leave An,s(σ)A_{n,s}(\sigma) at some stage, and τ\tau becomes leftmost. On the other hand, An(σ)A_n(\sigma) has an element to the right of τ\tau, which belongs to every An,s(σ)A_{n,s}(\sigma), so τ\tau is never the rightmost element. The search therefore returns 00. The case X(n)=1X(n) = 1 is symmetric.

For the last statements, take for P\mathcal P the Π10\Pi^0_1 class of random sequences of Corollary 2.5 (2), of measure at least 12\frac12. If X≥T∅′X \geq_T \emptyset', then Z≤TX⊕∅′≡TXZ \leq_T X \oplus \emptyset' \equiv_T X, so Z≡TXZ \equiv_T X.

The reduction of XX to ZZ reads only Z ⁣↾mn+1Z \uh m_{n+1} to compute X(n)X(n), a computable bound on the use: it is a weak truth-table reduction. The encoding is not computable, since recognizing the nodes τ\tau with large relative measure requires ∅′\emptyset', but the decoding is: the decoder waits for the competitors of τ\tau to reveal that they have small relative measure.

4.3 Random sequences compute DNC functions

Recall from Definition 3.1 of “Diagonally non-computable functions” that a function ff is diagonally non-computable if f(e)≠Φe(e)f(e) \neq \Phi_e(e) for every ee with Φe(e) ⁣ ⁣↓\Phi_e(e)\converge. Strings are identified with numbers through the length-lexicographic enumeration of Plain Kolmogorov complexity.

Theorem 4.5 (Kjos-Hanssen, Merkle, Stephan).#

A set XX computes a DNC function if and only if XX computes a function f:N→2<Nf : \nat \to \bstr with K(f(n))≥nK(f(n)) \geq n for every nn.

Proof of Theorem 4.5.

(⇒\Rightarrow) Let h≤TXh \leq_T X be as in Theorem 3.4 of “Diagonally non-computable functions” (2): h(e,m)∉Weh(e, m) \notin W_e whenever ∣We∣≤m|W_e| \leq m. Since KK is approximable from above, the set of strings σ\sigma with K(σ)<nK(\sigma) < n is c.e. uniformly in nn, and by SMN there is a total computable function aa such that Wa(n)W_{a(n)} is this set. It has fewer than 2n2^n elements, since distinct strings have distinct shortest descriptions, of length less than nn. Let f(n)=h(a(n),2n)f(n) = h(a(n), 2^n). Then f≤TXf \leq_T X and f(n)∉Wa(n)f(n) \notin W_{a(n)}, that is, K(f(n))≥nK(f(n)) \geq n.

(⇐\Leftarrow) Let f≤TXf \leq_T X with K(f(n))≥nK(f(n)) \geq n for every nn. The machine M(τ)=ΦU(τ)(U(τ))M(\tau) = \Phi_{U(\tau)}(U(\tau)) is prefix-free, since its domain is contained in that of UU, and MM applied to a shortest description of nn gives Φn(n)\Phi_n(n) when it converges. So there is a constant dd with

K(Φn(n))≤K(n)+d≤2log⁡n+d′K(\Phi_n(n)) \leq K(n) + d \leq 2 \log n + d'

for every n≥2n \geq 2 with Φn(n) ⁣ ⁣↓\Phi_n(n)\converge, by Proposition 3.4 of “Prefix-free complexity” (2). Let n0≥2n_0 \geq 2 be such that 2log⁡n+d′<n2 \log n + d' < n for n≥n0n \geq n_0. For n≥n0n \geq n_0 with Φn(n) ⁣ ⁣↓\Phi_n(n)\converge, K(Φn(n))<n≤K(f(n))K(\Phi_n(n)) < n \leq K(f(n)), so f(n)≠Φn(n)f(n) \neq \Phi_n(n). Modify ff on the finitely many n<n0n < n_0, setting g(n)=Φn(n)+1g(n) = \Phi_n(n) + 1 if Φn(n) ⁣ ⁣↓\Phi_n(n)\converge and g(n)=0g(n) = 0 otherwise, and g(n)=f(n)g(n) = f(n) for n≥n0n \geq n_0. The function gg is XX-computable, as a finite modification of ff, and DNC.

Corollary 4.6 (Kučera).#

Every Martin-Löf random sequence computes a DNC function. Consequently, the class of sequences computing a DNC function is conull, and no 1-generic set computes a Martin-Löf random sequence.

Proof of Corollary 4.6.

Let ZZ be random. By Theorem 3.1, there is cc with K(Z ⁣↾m)≥m−cK(Z \uh m) \geq m - c for every mm. The function f(n)=Z ⁣↾(n+c)f(n) = Z \uh (n + c) is ZZ-computable and satisfies K(f(n))≥nK(f(n)) \geq n, so ZZ computes a DNC function by Theorem 4.5. The class MLR is conull (Corollary 2.5). A 1-generic set computes no DNC function, by a theorem of Demuth and Kučera proved in the course on Cohen genericity (Demuth, Kučera); hence it computes no random sequence.

The two notions of typicality, by measure and by category, are thus incompatible in the Turing degrees: no random sequence is computable from a 1-generic set. By Kučera–Gács, every 1-generic set is computable from a random sequence.

The converse fails: there are DNC functions that compute no random sequence (Ambos-Spies, Kjos-Hanssen, Lempp, Slaman, 2004). A set computes a DNC function if and only if it computes an infinite subset of a random sequence, by results of Kjos-Hanssen (2009) and of Greenberg and Miller (2009); this is admitted here. A random sequence computes a {0,1}\{0, 1\}-valued DNC function only if it computes ∅′\emptyset', by a theorem of Stephan (2006), also admitted.

4.4 Exercises

Exercise 4.7 ★.

Show that if a random sequence ZZ is Turing equivalent to a c.e. set AA, then Z≡T∅′Z \equiv_T \emptyset'.

Solution

By Corollary 4.6, ZZ computes a DNC function, hence so does AA. By Arslanov’s completeness criterion (Arslanov's completeness criterion), A≡T∅′A \equiv_T \emptyset'.

Exercise 4.8 ★.

Show that for every n≥1n \geq 1 there is a random sequence Z≡T∅(n)Z \equiv_T \emptyset^{(n)}, and that the class of such sequences is null.

Solution

Apply Theorem 4.4 to X=∅(n)X = \emptyset^{(n)}, which computes ∅′\emptyset': the random sequence ZZ obtained satisfies Z≡T∅(n)Z \equiv_T \emptyset^{(n)}. The class of sequences computing ∅(n)\emptyset^{(n)} is null by Theorem 4.1, and contains the class considered.

Exercise 4.9 ★.

Let P\mathcal P be a Π10\Pi^0_1 class of positive measure. Show that P\mathcal P has a member in every Turing degree above 0′\obf', and a member that is not computably dominated. Compare with the computably dominated basis theorem.

Solution

For X≥T∅′X \geq_T \emptyset', Theorem 4.4 gives Z∈PZ \in \mathcal P with X≤TZ≤TX⊕∅′≡TXX \leq_T Z \leq_T X \oplus \emptyset' \equiv_T X. With X=∅′X = \emptyset', the member Z≡T∅′Z \equiv_T \emptyset' is Δ20\Delta^0_2 and not computable, hence not computably dominated (Definition 3.3 of “Basis theorems”). By Computably dominated basis theorem, P\mathcal P also has a computably dominated member: a Π10\Pi^0_1 class of positive measure has members of both kinds.

4.5 Notes and references

Sacks’s theorem is from his monograph Degrees of Unsolvability (1963); de Leeuw, Moore, Shannon and Shapiro (1956) had proved that a set computed by a positive measure of oracles is computable, in the form of a theorem on probabilistic machines. The Kučera–Gács theorem was proved independently by Kučera (1985) and Gács (1986); Gács obtained a use bounded by n+o(n)n + o(n), and Barmpalias and Lewis-Pye studied the optimal use. Kučera (1985) proved that random sequences compute DNC functions, and Kjos-Hanssen, Merkle and Stephan (2011) the characterization by complexity.

  • G. E. Sacks, Degrees of Unsolvability, Annals of Mathematics Studies 55, Princeton University Press, 1963.
  • A. Kučera, Measure, Π⁰₁-classes and complete extensions of PA, in: Recursion Theory Week, Lecture Notes in Mathematics 1141, Springer, 1985, 245–259.
  • P. Gács, Every sequence is reducible to a random one, Information and Control 70 (1986), 186–192.
  • B. Kjos-Hanssen, W. Merkle and F. Stephan, Kolmogorov complexity and the recursion theorem, Transactions of the American Mathematical Society 363 (2011), 5465–5480.
  • B. Kjos-Hanssen, Infinite subsets of random sets of integers, Mathematical Research Letters 16 (2009), 103–110.
  • N. Greenberg and J. S. Miller, Lowness for Kurtz randomness, Journal of Symbolic Logic 74 (2009), 665–678.
  • F. Stephan, Martin-Löf random and PA-complete sets, in: Logic Colloquium ‘02, Lecture Notes in Logic 27, 2006, 342–348.