InformationTheory.Shannon.EPI.InfiniteVariance.Capstone
Classical entropy power inequality for infinite-variance sums — capstone #
The named theorem entropyPowerExt_add_ge_infinite_variance (the same signature as the original
finite-variance wall, with an explicit h_infvar infinite-variance hypothesis) is proved here
using the conditioning-truncation route headline
entropyPowerExt_add_ge_infinite_variance_truncation.
Implementation notes #
The theorem splits on whether the differential entropy of the sum is finite (hent_sum):
- if it is finite, the truncation-route headline applies directly (
h_infvaris unused); - otherwise the sum density
r := (P.map (X + Y)).rnDeriv volume |>.toRealhas non-integrablenegMulLog. Its negative partB := ∫⁻ ofReal (-(negMulLog r))is finite by the probability-measure negative-part lemma, whileIntegrable g volume ↔ A < ⊤ ∧ B < ⊤(withA := ∫⁻ ofReal (negMulLog r)) forcesA = ⊤, sodifferentialEntropyExt ν = (A : EReal) - (B : EReal) = ⊤, henceentropyPowerExt ν = ⊤and the inequality holds byle_top.
The h_infvar hypothesis is kept only for signature compatibility; it is not load-bearing
(unused in the finite case, and a weakening hypothesis). hX_ent / hY_ent are
per-component finite-differential-entropy regularity preconditions. To avoid an import cycle,
this file is placed downstream of the truncation route and imports only that route.
InformationTheory.Shannon.EPIInfiniteVarianceTruncation.lintegral_conv_kernel_eq
sourceUsed by
InformationTheory.Shannon.EPIInfiniteVarianceTruncation.conv_jensen_bound
sourceUsed by
InformationTheory.Shannon.EPIInfiniteVarianceTruncation.integrable_conv_kernel
sourceUsed by
InformationTheory.Shannon.EPIInfiniteVarianceTruncation.integrable_negPart_negMulLog_map_sum
sourceThe negative part (negMulLog r)⁻ = max (-(negMulLog r)) 0 of negMulLog of the sum density
r := (P.map (X + Y)).rnDeriv volume |>.toReal (the convolution pX ∗ pY) is volume-integrable.
This is the conditioning-free version of integrable_negPart_negMulLog_map_condTrunc_sum. Since
pX · volume = P.map X is a probability measure and t ↦ t log t is convex, the integral form of
Jensen's inequality gives (r z · log r z)⁺ ≤ ∫ x, pX x · (pY (z - x) · log pY (z - x))⁺ dx, and
Tonelli with translation invariance bounds ∫⁻ z (r log r)⁺ by 1 · C < ∞ where
C = ∫ (pY log pY)⁺ < ∞ comes from hY_ent.
@audit:ok
Used by
InformationTheory.Shannon.EPIInfiniteVarianceTruncation.entropyPowerExt_add_ge_infinite_variance
sourceThe classical entropy power inequality Nₑ(X + Y) ≥ Nₑ(X) + Nₑ(Y) for an independent,
absolutely continuous, finite-differential-entropy, infinite-variance sum.
The proof splits on hent_sum: when the sum entropy is finite the truncation-route headline
applies; otherwise the sum entropy is +∞, so entropyPowerExt ν = ⊤ and the inequality holds by
le_top. The h_infvar hypothesis is kept for signature compatibility and is not load-bearing
(unused in the finite case); hX_ent / hY_ent are per-component regularity preconditions.
@audit:ok