Compactness & Contraction Mappings
Compactness converts infinite behavior into finite control, while contraction mappings convert a complete metric space into a convergent iteration with an error bound. This chapter explains both mechanisms and the infinite-dimensional failure of bounded-equals-compact.
Compactness and completeness solve different problems. Completeness prevents a Cauchy approximation from falling out of the space. Compactness guarantees that every infinite sequence has a convergent subsequence and therefore turns many limiting arguments into finite ones. The contraction theorem needs completeness, not compactness; compactness enters other existence arguments.
Equivalent compactness tests in metric spaces #
For a subset of a metric space, the following are equivalent:
- every open cover of has a finite subcover;
- every sequence in has a subsequence converging to a point of ;
- is complete and totally bounded.
Total boundedness means that for every , finitely many -balls cover . It is stronger than ordinary boundedness. The distinction is invisible in finite-dimensional Euclidean space, where a set is compact exactly when it is closed and bounded.
In an infinite-dimensional normed space, the closed unit ball is not compact. Riesz's lemma constructs unit vectors separated by a fixed positive distance, so the sequence has no Cauchy subsequence. This is why function-space compactness theorems need extra regularity or tail control.
What compactness buys #
If is compact and is continuous, then is compact, so is bounded and attains its minimum and maximum. If a continuous map is bijective from compact into a Hausdorff space, its inverse is automatically continuous. A continuous function on compact is uniformly continuous: one input tolerance works over the whole set.
These conclusions fail when compactness is replaced by boundedness alone. For example, is continuous but unbounded on the bounded set ; the missing endpoint is exactly where compactness fails.
Banach's contraction principle #
Let be complete and let satisfy
Starting from any , define . Repeated contraction gives
Summing the geometric tail shows that is Cauchy:
Completeness provides a limit . Continuity of gives . If is another fixed point, then , forcing equality to zero. The fixed point is unique.
Two practical error bounds follow:
uses the first step, while
uses the most recent step and can be monitored during computation.
Worked example: solving #
On with the usual metric, maps into itself and . Thus is a contraction with . Starting at gives
and converges to the unique fixed point . The alternating appearance does not threaten convergence; the contraction controls distance, not monotonicity.
How fixed-point proofs fail #
- If , nonexpansiveness alone gives no uniqueness and may give no convergence.
- If the proposed domain is not invariant, an iterate can leave the region where the derivative bound holds.
- If the space is incomplete, the Cauchy iterates may converge only in its completion.
- A local derivative bound proves only a local contraction unless the iterates are shown to stay inside the neighborhood.
- Floating-point termination should use a derived residual/error criterion, not merely a fixed iteration count.