Compactness & Contraction Mappings

Compactness converts infinite behavior into finite control, while contraction mappings convert a complete metric space into a convergent iteration with an error bound. This chapter explains both mechanisms and the infinite-dimensional failure of bounded-equals-compact.

Compactness and completeness solve different problems. Completeness prevents a Cauchy approximation from falling out of the space. Compactness guarantees that every infinite sequence has a convergent subsequence and therefore turns many limiting arguments into finite ones. The contraction theorem needs completeness, not compactness; compactness enters other existence arguments.

Equivalent compactness tests in metric spaces #

For a subset KK of a metric space, the following are equivalent:

  • every open cover of KK has a finite subcover;
  • every sequence in KK has a subsequence converging to a point of KK;
  • KK is complete and totally bounded.

Total boundedness means that for every ε>0\varepsilon>0, finitely many ε\varepsilon-balls cover KK. It is stronger than ordinary boundedness. The distinction is invisible in finite-dimensional Euclidean space, where a set is compact exactly when it is closed and bounded.

In an infinite-dimensional normed space, the closed unit ball is not compact. Riesz's lemma constructs unit vectors separated by a fixed positive distance, so the sequence has no Cauchy subsequence. This is why function-space compactness theorems need extra regularity or tail control.

What compactness buys #

If KK is compact and f:K→Rf:K\to\mathbb R is continuous, then f(K)f(K) is compact, so ff is bounded and attains its minimum and maximum. If a continuous map is bijective from compact KK into a Hausdorff space, its inverse is automatically continuous. A continuous function on compact KK is uniformly continuous: one input tolerance works over the whole set.

These conclusions fail when compactness is replaced by boundedness alone. For example, f(x)=1/xf(x)=1/x is continuous but unbounded on the bounded set (0,1)(0,1); the missing endpoint is exactly where compactness fails.

Banach's contraction principle #

Let (X,d)(X,d) be complete and let T:X→XT:X\to X satisfy

d(Tx,Ty)≤qd(x,y),0≤q<1.d(Tx,Ty)\le qd(x,y),\qquad 0\le q<1.

Starting from any x0x_0, define xn+1=Txnx_{n+1}=Tx_n. Repeated contraction gives

d(xn+1,xn)≤qnd(x1,x0).d(x_{n+1},x_n)\le q^n d(x_1,x_0).

Summing the geometric tail shows that (xn)(x_n) is Cauchy:

d(xm,xn)≤qn1−qd(x1,x0),m>n.d(x_m,x_n)\le \frac{q^n}{1-q}d(x_1,x_0),\qquad m>n.

Completeness provides a limit x∗x_*. Continuity of TT gives Tx∗=x∗Tx_*=x_*. If y∗y_* is another fixed point, then d(x∗,y∗)≤qd(x∗,y∗)d(x_*,y_*)\le qd(x_*,y_*), forcing equality to zero. The fixed point is unique.

Two practical error bounds follow:

d(xn,x∗)≤qn1−qd(x1,x0)d(x_n,x_*)\le\frac{q^n}{1-q}d(x_1,x_0)

uses the first step, while

d(xn,x∗)≤q1−qd(xn,xn−1)d(x_n,x_*)\le\frac{q}{1-q}d(x_n,x_{n-1})

uses the most recent step and can be monitored during computation.

Worked example: solving x=cos⁡xx=\cos x #

On X=[0,1]X=[0,1] with the usual metric, T(x)=cos⁡xT(x)=\cos x maps XX into itself and ∣T′(x)∣=∣sin⁡x∣≤sin⁡1<1|T'(x)|=|\sin x|\le\sin1<1. Thus TT is a contraction with q=sin⁡1≈0.8415q=\sin1\approx0.8415. Starting at x0=1x_0=1 gives

1,0.5403,0.8576,0.6543,0.7935,ldots1, 0.5403, 0.8576, 0.6543, 0.7935,ldots

and converges to the unique fixed point x∗≈0.739085x_*\approx0.739085. The alternating appearance does not threaten convergence; the contraction controls distance, not monotonicity.

How fixed-point proofs fail #

  • If q=1q=1, nonexpansiveness alone gives no uniqueness and may give no convergence.
  • If the proposed domain is not invariant, an iterate can leave the region where the derivative bound holds.
  • If the space is incomplete, the Cauchy iterates may converge only in its completion.
  • A local derivative bound proves only a local contraction unless the iterates are shown to stay inside the neighborhood.
  • Floating-point termination should use a derived residual/error criterion, not merely a fixed iteration count.

Sources

  1. bookIntroduction to Functional Analysis: Lecture Notes for 18.102pdfnotes

Searches titles, aliases, headings, summaries, and full text.↑↓ move ↵ open esc close