InformationTheory

InformationTheory.Shannon.EPI.InfiniteVariance.Capstone

source

Classical entropy power inequality for infinite-variance sums — capstone #

The named theorem entropyPowerExt_add_ge_infinite_variance (the same signature as the original finite-variance wall, with an explicit h_infvar infinite-variance hypothesis) is proved here using the conditioning-truncation route headline entropyPowerExt_add_ge_infinite_variance_truncation.

Implementation notes #

The theorem splits on whether the differential entropy of the sum is finite (hent_sum):

  • if it is finite, the truncation-route headline applies directly (h_infvar is unused);
  • otherwise the sum density r := (P.map (X + Y)).rnDeriv volume |>.toReal has non-integrable negMulLog. Its negative part B := ∫⁻ ofReal (-(negMulLog r)) is finite by the probability-measure negative-part lemma, while Integrable g volume ↔ A < ⊤ ∧ B < ⊤ (with A := ∫⁻ ofReal (negMulLog r)) forces A = ⊤, so differentialEntropyExt ν = (A : EReal) - (B : EReal) = ⊤, hence entropyPowerExt ν = ⊤ and the inequality holds by le_top.

The h_infvar hypothesis is kept only for signature compatibility; it is not load-bearing (unused in the finite case, and a weakening hypothesis). hX_ent / hY_ent are per-component finite-differential-entropy regularity preconditions. To avoid an import cycle, this file is placed downstream of the truncation route and imports only that route.

theorem

InformationTheory.Shannon.EPIInfiniteVarianceTruncation.lintegral_conv_kernel_eq

source
(pX g : ) (hpX_meas : Measurable pX) (hpX_nn : ∀ (x : ), 0 pX x) (hg : Measurable g) (_hg_nn : ∀ (w : ), 0 g w) :
∫⁻ (z : ) (x : ), ENNReal.ofReal (pX x * g (z - x)) = (∫⁻ (x : ), ENNReal.ofReal (pX x)) * ∫⁻ (w : ), ENNReal.ofReal (g w)
Used by
    theorem

    InformationTheory.Shannon.EPIInfiniteVarianceTruncation.conv_jensen_bound

    source
    (pX pY φ r : ) (μX : MeasureTheory.Measure ) (hμX_def : μX = MeasureTheory.volume.withDensity fun (x : ) => ENNReal.ofReal (pX x)) [MeasureTheory.IsProbabilityMeasure μX] (hpX_meas : Measurable pX) (hpX_nn : ∀ (x : ), 0 pX x) (hpY_nn : ∀ (y : ), 0 pY y) (_hφ_meas : Measurable φ) (hφ_convex : ConvexOn (Set.Ici 0) φ) (hφ_cont : ContinuousOn φ (Set.Ici 0)) (z : ) (hz : r z = EPIConvDensity.convDensityAdd pX pY z) (hzpY : MeasureTheory.Integrable (fun (x : ) => pX x * pY (z - x)) MeasureTheory.volume) (hzCq : MeasureTheory.Integrable (fun (x : ) => pX x * max (φ (pY (z - x))) 0) MeasureTheory.volume) (hzCm : MeasureTheory.Integrable (fun (x : ) => pX x * max (-φ (pY (z - x))) 0) MeasureTheory.volume) :
    max (φ (r z)) 0 (x : ), pX x * max (φ (pY (z - x))) 0
    Used by
      theorem

      InformationTheory.Shannon.EPIInfiniteVarianceTruncation.integrable_conv_kernel

      source
      (pX g : ) (hpX_meas : Measurable pX) (hpX_nn : ∀ (x : ), 0 pX x) (hpX_lint : ∫⁻ (x : ), ENNReal.ofReal (pX x) = 1) (hg : Measurable g) (hg_nn : ∀ (w : ), 0 g w) (hg_fin : ∫⁻ (w : ), ENNReal.ofReal (g w) ) :
      Used by
        theorem

        InformationTheory.Shannon.EPIInfiniteVarianceTruncation.integrable_negPart_negMulLog_map_sum

        source

        The negative part (negMulLog r)⁻ = max (-(negMulLog r)) 0 of negMulLog of the sum density r := (P.map (X + Y)).rnDeriv volume |>.toReal (the convolution pX ∗ pY) is volume-integrable.

        This is the conditioning-free version of integrable_negPart_negMulLog_map_condTrunc_sum. Since pX · volume = P.map X is a probability measure and t ↦ t log t is convex, the integral form of Jensen's inequality gives (r z · log r z)⁺ ≤ ∫ x, pX x · (pY (z - x) · log pY (z - x))⁺ dx, and Tonelli with translation invariance bounds ∫⁻ z (r log r)⁺ by 1 · C < ∞ where C = ∫ (pY log pY)⁺ < ∞ comes from hY_ent.

        @audit:ok

        Used by
          theorem

          InformationTheory.Shannon.EPIInfiniteVarianceTruncation.entropyPowerExt_add_ge_infinite_variance

          source

          The classical entropy power inequality Nₑ(X + Y) ≥ Nₑ(X) + Nₑ(Y) for an independent, absolutely continuous, finite-differential-entropy, infinite-variance sum.

          The proof splits on hent_sum: when the sum entropy is finite the truncation-route headline applies; otherwise the sum entropy is +∞, so entropyPowerExt ν = ⊤ and the inequality holds by le_top. The h_infvar hypothesis is kept for signature compatibility and is not load-bearing (unused in the finite case); hX_ent / hY_ent are per-component regularity preconditions. @audit:ok

          Used by