Linear Integral Equations

Linear integral equations place the unknown under an integral operator. This chapter classifies Fredholm and Volterra equations, derives Neumann and resolvent kernels, reduces degenerate kernels to matrices, applies the Fredholm alternative, and explains why first-kind inversion is ill-conditioned.

An integral equation asks for a function whose weighted aggregate values match known data. Writing it as an operator equation exposes the decisive difference: first-kind problems try to invert a smoothing operator directly, while second-kind problems add the identity and are often stably invertible except at isolated spectral parameters.

Classification before solution #

A Fredholm equation integrates over fixed limits:

first kind:∫abk(x,t)φ(t)dt=f(x),\text{first kind:}\quad \int_a^b k(x,t)\varphi(t)dt=f(x),

second kind:φ(x)−λ∫abk(x,t)φ(t)dt=f(x).\text{second kind:}\quad \varphi(x)-\lambda\int_a^b k(x,t)\varphi(t)dt=f(x).

A Volterra equation uses a variable upper limit:

φ(x)−λ∫axk(x,t)φ(t)dt=f(x).\varphi(x)-\lambda\int_a^x k(x,t)\varphi(t)dt=f(x).

With (Kφ)(x)=∫k(x,t)φ(t)dt(K\varphi)(x)=\int k(x,t)\varphi(t)dt, these are Kφ=fK\varphi=f and (I−λK)φ=f(I-\lambda K)\varphi=f. The fixed triangular support a≤t≤xa\le t\le x makes Volterra iteration much better behaved than a general Fredholm kernel.

Three principal classes of linear integral equation Three stacked cards compare first-kind, Fredholm second-kind, and Volterra second-kind equations. Their main mechanisms are noise-amplifying inversion and regularization, isolated Fredholm compatibility obstructions, and factorially convergent triangular iteration. Classify before choosing a solver First kindKφ = fcompact K smooths datainverse amplifies noiseill-posed: regularize data fit with a prior penalty Fredholm second kind(I − λK)φ = fidentity stabilizes most λisolated obstructionat singular λ: test f ⟂ ker(I − λ̄K*) Volterra second kindφ(x) − λ∫ᵃˣk(x,t)φ(t)dt = f(x)triangular historynested volume / n!resolvent iteration converges for every finite λ unbounded inverse · Fredholm alternative · factorial iteration
First kind exposes an unbounded inverse, Fredholm second kind is governed by isolated spectral obstructions, and Volterra triangular iteration gains factorial convergence.

Neumann iteration and resolvent kernel #

If KK is bounded and ∣λ∣∥K∥<1|\lambda|\|K\|<1, then

(I−λK)−1=∑n=0∞λnKn(I-\lambda K)^{-1}=\sum_{n=0}^{\infty}\lambda^nK^n

in operator norm. Picard iteration

φn+1=f+λKφn\varphi_{n+1}=f+\lambda K\varphi_n

is the same geometric series viewed as an algorithm.

Define iterated Fredholm kernels by

k1(x,t)=k(x,t),kn+1(x,t)=∫abk(x,s)kn(s,t)ds.k_1(x,t)=k(x,t),\qquad k_{n+1}(x,t)=\int_a^b k(x,s)k_n(s,t)ds.

Where the series converges, the resolvent kernel is

rλ(x,t)=∑n=1∞λn−1kn(x,t),r_\lambda(x,t)=\sum_{n=1}^{\infty}\lambda^{n-1}k_n(x,t),

and the solution is

φ(x)=f(x)+λ∫abrλ(x,t)f(t)dt.\varphi(x)=f(x)+\lambda\int_a^b r_\lambda(x,t)f(t)dt.

The condition ∣λ∣∥K∥<1|\lambda|\|K\|<1 is sufficient, not necessary. Outside it, spectral/Fredholm analysis may still prove invertibility.

Why Volterra series converges for every parameter #

Suppose ∣k(x,t)∣≤M|k(x,t)|\le M on a≤t≤x≤ba\le t\le x\le b. Nested triangular integration gives a factorial denominator:

∣kn(x,t)∣≤Mn(x−t)n−1(n−1)!.|k_n(x,t)|\le M^n\frac{(x-t)^{n-1}}{(n-1)!}.

Therefore the resolvent-kernel series converges uniformly for every finite λ\lambda. This is stronger than the generic geometric condition. It also explains why the Volterra operator has spectral radius zero even though it is not nilpotent.

For k≡1k\equiv1,

φ(x)=f(x)+λ∫axφ(t)dt.\varphi(x)=f(x)+\lambda\int_a^x\varphi(t)dt.

If ff is differentiable, differentiation gives φ′−λφ=f′\varphi'-\lambda\varphi=f' with φ(a)=f(a)\varphi(a)=f(a). The integral equation already encodes the initial condition.

Degenerate kernels reduce to linear algebra #

If

k(x,t)=∑j=1maj(x)bj(t),k(x,t)=\sum_{j=1}^m a_j(x)b_j(t),

set cj=∫abbj(t)φ(t)dtc_j=\int_a^b b_j(t)\varphi(t)dt. Then

φ(x)=f(x)+λ∑j=1maj(x)cj,\varphi(x)=f(x)+\lambda\sum_{j=1}^m a_j(x)c_j,

and multiplying by each bib_i and integrating produces an m×mm\times m system for cc. The infinite-dimensional equation has finite-rank coupling.

Fredholm solvability #

For a compact KK on a Hilbert space, (I−λK)φ=f(I-\lambda K)\varphi=f is uniquely solvable for every ff unless 1/λ1/\lambda is a nonzero eigenvalue of KK. At a singular parameter, solvability requires

⟨f,ψ⟩=0for every ψ∈ker⁡(I−λ‾K∗).\langle f,\psi\rangle=0 \quad\text{for every }\psi\in \ker(I-\overline\lambda K^*).

For an integral kernel, the adjoint kernel is k∗(x,t)=k(t,x)‾k^*(x,t)=\overline{k(t,x)}. If compatibility holds, solutions differ by a homogeneous solution.

First-kind equations are inverse problems #

A compact integral operator sends high-frequency or localized differences to small outputs. If KK has infinite-dimensional range, its inverse on that range is generally unbounded. Small data noise can therefore create large solution error. A tiny residual ∥Kφ−f∥\|K\varphi-f\| is not evidence that φ\varphi is close to the true solution.

Stable recovery needs additional information, commonly Tikhonov regularization:

min⁡φ ∥Kφ−fδ∥2+α∥Lφ∥2.\min_\varphi\ \|K\varphi-f_\delta\|^2 +\alpha\|L\varphi\|^2.

LL expresses the permitted solution structure, and α\alpha trades data fit against noise amplification. Parameter choice is part of the inference, not a cosmetic numerical option.

Discretization without losing the operator problem #

Nyström methods replace the integral by quadrature; Galerkin methods project the equation onto a finite-dimensional trial/test space; degenerate-kernel methods explicitly approximate KK by finite rank. In every case verify:

  • quadrature/basis convergence in the relevant operator or solution norm;
  • conditioning as resolution grows;
  • the residual in the continuous equation, not only the discrete system;
  • compatibility near a Fredholm singularity;
  • regularization and noise sensitivity for first-kind data.

The matrix is an approximation to the operator problem. Its solvability and condition number must be interpreted through the function spaces and norms from which it came.

Sources

  1. bookIntroduction to Functional Analysis: Lecture Notes for 18.102pdfnotes

Searches titles, aliases, headings, summaries, and full text.↑↓ move ↵ open esc close