InformationTheory.Shannon.GeneralDMC.Extension
General DMC capacity — extension layer #
This file extends InformationTheory/Shannon/GeneralDMC/Basic.lean with three families of
hypothesis-form publish theorems aimed at downstream modules that need
capacity-limit reasoning beyond the memoryless DMC case.
The mathematical objects this layer would concretely discharge (Verdú–Han sup-information rate, informationally stable channels, capacity-region convexity for general DMC) are out of scope: their statements are exposed here as named publish surface, with the characterizing hypothesis taken pass-through.
Main predicates #
IsInformationallyStable W C— the per-letter capacity rate is eventually the constantC. This captures (in a single-rate, statement-level shape) the operational notion of an "informationally stable" channel: the per-block capacity grows asymptotically linearly with slopeC.IsSpectralCapacityForm W C— Verdú–Han 1994 spectral characterization (hypothesis-form): there exists someCtogether with a witnessing per-block sequence converging toC. We take this as a predicate, not as a definition derived from a sup-information rate, so the downstream surface is stable under any future swap-in of the concrete sup-information definition.
Main publish theorems #
capacity_lim_eq_of_informationally_stable— ifWis informationally stable with rateC, thencapacity_lim W = C.informationallyStable_of_memoryless— every memorylessofMemoryless Wis informationally stable with ratecapacity W(concrete instance, fully discharged fromGeneralDMC.capacityRate_ofMemoryless_eventually_const).capacity_lim_eq_memoryless_of_informationally_stable— bridge between the general predicate and the memoryless concrete form.capacity_lim_eq_spectral_via_predicate—IsSpectralCapacityForm W Cpass-through tocapacity_lim W = C(statement-level Verdú–Han identification).spectralCapacityForm_of_memoryless— everyofMemoryless Wadmits the spectral form with ratecapacity W.capacity_lim_convex_combination_le— pass-through "convexity" surface: if two blockwise channelsW₁, W₂are informationally stable with ratesC₁, C₂, and a third channelWhas per-letter rate eventually bounded above byλ * C₁ + (1 - λ) * C₂for some0 ≤ λ ≤ 1, thencapacity_lim W ≤ λ * C₁ + (1 - λ) * C₂.
Design #
This file is intentionally a predicate + pass-through layer: it
introduces no new definitions that would shift the BlockwiseChannel /
capacity_lim API surface. Concrete proofs that a given channel is
informationally stable, or that its spectral and limit characterizations
coincide, remain downstream — once GeneralDMCExtension is in place, every
such downstream theorem can be re-expressed as discharging the
IsInformationallyStable or IsSpectralCapacityForm predicate, rather than
unfolding capacity_lim itself.
References #
InformationTheory/Shannon/GeneralDMC/Basic.lean- Verdú & Han, "A general formula for channel capacity" (IEEE TIT 1994).
Informationally stable channels #
Spectral capacity form (Verdú–Han 1994, predicate pass-through) #
Pass-through "convexity" surface #
Limsup / liminf publish surface (statement-level) #
Where the per-letter sequence does not converge (so neither
IsInformationallyStable nor IsSpectralCapacityForm applies), the
Verdú–Han / Pinsker literature uses limsup and liminf (the
"information-spectrum" upper/lower rates). We expose these in
hypothesis-form for downstream parallelism: they re-state the existence /
sandwich condition and discharge capacity_lim = limit once the user
proves convergence.