InformationTheory.Shannon.EPI.Blachman.Density
EPI Blachman — explicit density route (S2 + S3, condExp-free) #
Consumes the gateway convDensityAdd_hasDerivAt_of_regular (EPI/Conv/Density.lean)
and builds, without any condExp/condDistrib/disintegration:
condDensityX fX fY z x := fX x * fY (z - x) / convDensityAdd fX fY z— the conditional densityp_{X|Z}(x|z)written as an explicit ratio of Bochner integrands.condDensityX_integral_eq_one— normalization∫ x, p_{X|Z}(x|z) dx = 1.symm_deriv_integral_eq(S2) — symmetric derivative identity∫ x, deriv fX x · fY (z - x) = ∫ x, fX x · deriv fY (z - x)(both= p_Z'(z)), obtained from the gateway applied in both factor orders +convDensityAdd_comm+ the reflection substitution.score_conv_eq_weighted_integral(S3, the Blachman core) — for anyλ, withW_λ(x,z) := λ · logDeriv fX x + (1-λ) · logDeriv fY (z-x),logDeriv (convDensityAdd fX fY) z = ∫ x, W_λ x z · p_{X|Z}(x|z) dx. This is the score-of-convolution representation written as an explicit probability-weighted integral, the substitute for the disintegration bridge.
All bundled hypotheses are regularity preconditions (IsRegularDensityV2,
boundedness of the smooth factor and its derivative, integrability of the score
products, positivity of p_Z). None is a load-bearing bundling of the score
identity itself.
InformationTheory.Shannon.EPIBlachmanDensity.condDensityX
sourceThe conditional density p_{X|Z}(x|z) := fX(x) · fY(z - x) / p_Z(z), where
p_Z = convDensityAdd fX fY. Explicit ratio form (no condDistrib).
Equations
- InformationTheory.Shannon.EPIBlachmanDensity.condDensityX fX fY z x = fX x * fY (z - x) / InformationTheory.Shannon.EPIConvDensity.convDensityAdd fX fY z
Instances For
Used by
InformationTheory.Shannon.EPIBlachmanDensity.scoreWeight
sourceEquations
Instances For
Used by
InformationTheory.Shannon.EPIBlachmanDensity.condDensityX_integral_eq_one
sourceNormalization of the conditional density: ∫ x, p_{X|Z}(x|z) dx = 1.
Numerator ∫ x, fX x · fY (z - x) = convDensityAdd fX fY z = p_Z(z) (by
definition), divided by p_Z(z) > 0.
hpZ is a regularity precondition (positivity of the convolution density at z,
satisfied whenever fX, fY > 0 are integrable).
@audit:ok
Used by
InformationTheory.Shannon.EPIBlachmanDensity.symm_deriv_integral_eq
sourceS2, the symmetric derivative identity of the convolution density:
∫ x, deriv fX x · fY (z - x) = ∫ x, fX x · deriv fY (z - x) (both = p_Z'(z)).
@audit:ok
Used by
InformationTheory.Shannon.EPIBlachmanDensity.score_conv_eq_weighted_integral
sourceS3, the score representation (the Blachman core, condExp-free).
For any λ, with W_λ(x,z) := λ · logDeriv fX x + (1-λ) · logDeriv fY (z - x),
logDeriv (convDensityAdd fX fY) z = ∫ x, W_λ x z · p_{X|Z}(x|z) dx.
Proof skeleton (explicit Bochner integrals + cancellation, NO disintegration):
logDeriv p_Z z = p_Z'(z) / p_Z(z)(gatewayHasDerivAt+logDeriv_apply).∫ W_λ · p_{X|Z} = (1/p_Z) ∫ W_λ · fX(x) fY(z-x).- `W_λ · fX(x) fY(z-x) = λ (logDeriv fX x · fX x) fY(z-x)
- (1-λ) fX x (logDeriv fY(z-x) · fY(z-x))
, andlogDeriv f · f = deriv f` pointwise (positivity).
- (1-λ) fX x (logDeriv fY(z-x) · fY(z-x))
∫ deriv fX(x) fY(z-x) = p_Z'(z)(S2) and∫ fX(x) deriv fY(z-x) = p_Z'(z)(gateway derivative). Numerator= λ p_Z' + (1-λ) p_Z' = p_Z'. Divide byp_Z.
h_int_W is the regularity precondition that the weighted integrand is integrable.
@audit:ok
Used by
Convex Fisher bound (density route) #
This section consumes S2/S3 (above) and assembles the convex Fisher bound
(fisherInfoOfDensity (convDensityAdd fX fY)).toReal ≤ lam² · (fisherInfoOfDensity fX).toReal + (1-lam)² · (fisherInfoOfDensity fY).toReal
for 0 ≤ lam ≤ 1, via:
- atom A (
fisherInfoOfDensity_toReal_eq_integral) — the lintegral↔Bochner bridge(fisherInfoOfDensity f).toReal = ∫ x, (logDeriv f x)² · f x ∂volume(integral_eq_lintegral_of_nonneg_ae+ENNReal.ofReal_mul). - S4 pointwise Cauchy-Schwarz (
score_sq_le_weighted_integral) — probability weighted CS:(logDeriv p_Z z)² ≤ ∫ x, (W_λ x z)² · p_{X|Z}(x|z) dx. - the Tonelli swap + 3-term evaluation (
λ²·J_X + (1-λ)²·J_Y, cross-term= 0).
InformationTheory.Shannon.EPIBlachmanDensity.fisherInfoOfDensity_toReal_eq_integral
sourceAtom A, the lintegral↔Bochner bridge for the Fisher information of a density.
(fisherInfoOfDensity f).toReal = ∫ x, (logDeriv f x)² · f x ∂volume.
fisherInfoOfDensity f = ∫⁻ x, ofReal((logDeriv f x)²) · ofReal(f x) by definition;
ofReal((logDeriv f x)² · f x) = ofReal((logDeriv f x)²) · ofReal(f x) by
ENNReal.ofReal_mul (both factors nonneg), and the integrand
(logDeriv f x)² · f x is nonnegative (hpos), so
integral_eq_lintegral_of_nonneg_ae applies.
hpos (f ≥ 0) and hint (Bochner-integrability of the squared-score density)
are regularity preconditions, satisfied by any probability density with
finite Fisher information; neither bundles the Fisher-info value.
@audit:ok
Used by
InformationTheory.Shannon.EPIBlachmanDensity.score_sq_le_weighted_integral
sourceS4, the probability-weighted pointwise Cauchy-Schwarz of the score.
With W_λ(x,z) := scoreWeight fX fY lam z x and p_{X|Z}(x|z) := condDensityX fX fY z x
(a probability weight: ≥ 0, ∫ = 1), and the S3 representation
logDeriv p_Z z = ∫ x, W_λ · p_{X|Z}, Jensen / Cauchy-Schwarz gives
(logDeriv (convDensityAdd fX fY) z)² ≤ ∫ x, (W_λ x z)² · p_{X|Z}(x|z) dx.
hpZ (positivity of p_Z(z)) is a regularity precondition; the squared-weight
integrability hint_Wsq is a regularity precondition on admissible densities.
None of the hyps bundles the conclusion inequality.
With the probability measure
μ := volume.withDensity (fun x => ENNReal.ofReal (condDensityX fX fY z x))
(IsProbabilityMeasure from 3b condDensityX_integral_eq_one via
ofReal_integral_eq_lintegral_ofReal), S4 is exactly Jensen for the convex (·)²:
Even.convexOn_pow + ConvexOn.map_integral_le
(Mathlib/Analysis/Convex/Integral.lean:199, [IsProbabilityMeasure μ],
g (∫ f ∂μ) ≤ ∫ g∘f ∂μ) composed with the change-of-variables
integral_withDensity_eq_integral_toReal_smul₀
(Bochner/ContinuousLinearMap.lean:310) to rewrite ∫ · ∂μ = ∫ condDensityX·· ∂volume,
and S3 score_conv_eq_weighted_integral to identify ∫ scoreWeight ∂μ with
logDeriv p_Z z. condExp/condDistrib/disintegration absent (density route).
hcond_int (integrability of the conditional density), hint_W (integrability of
the score weight against condDensityX) and hint_Wsq are regularity preconditions
on admissible densities; none bundles the conclusion inequality.
@audit:ok
Used by
Tonelli 3-term evaluation helpers #
These three private lemmas evaluate each of the three terms obtained by expanding
W_λ² = λ²·s_X(x)² + (1-λ)²·s_Y(z-x)² + 2λ(1-λ)·s_X(x)·s_Y(z-x) inside the double
integral ∫_z ∫_x W_λ²·fX(x)·fY(z-x). Each uses integral_integral_swap (Tonelli,
Bochner) to put z innermost, then translation invariance integral_sub_right_eq_self
- the normalizations /
integral_logDeriv_density_eq_zeroto collapse the innerzintegral. The product-measure integrability hypotheses (Integrable (uncurry …)) are honest regularity preconditions (Gaussian-satisfied, load-bearing-free).
InformationTheory.Shannon.EPIBlachmanDensity.convex_fisher_bound
sourceThe convex Fisher bound (density route).
For 0 ≤ lam ≤ 1,
(fisherInfoOfDensity (convDensityAdd fX fY)).toReal ≤ lam² · (fisherInfoOfDensity fX).toReal + (1-lam)² · (fisherInfoOfDensity fY).toReal.
Proof shape (explicit density route, condExp-free):
J_sum = ∫ z, (logDeriv p_Z z)² · p_Z(z) dz(atom A onp_Z = convDensityAdd fX fY).(logDeriv p_Z z)² ≤ ∫ x, W_λ² · p_{X|Z}pointwise (S4score_sq_le_weighted_integral).- integrate against
p_Z, cancelp_{X|Z}·p_Z = fX(x)·fY(z-x), swap order (Tonelli), expandW_λ² = λ²s_X² + (1-λ)²s_Y² + 2λ(1-λ)s_X s_Y: λ²term= λ²·J_X(∫_z fY(z-x) dz = 1by translation invariance + normalization),(1-λ)²term= (1-λ)²·J_Y,- cross term
= 0(∫ logDeriv fX · fX = 0and∫ logDeriv fY · fY = 0,integral_logDeriv_density_eq_zero).
All bundled hypotheses are regularity preconditions (IsRegularDensityV2,
boundedness, integrability side-conditions, normalization ∫ = 1, positivity of
p_Z, and the three product-measure Integrable (uncurry …) Tonelli
preconditions); none bundles the inequality core.
Assembly:
- atom A
fisherInfoOfDensity_toReal_eq_integralrewrites all three Fisher informations to Bochner integrals; - S4
score_sq_le_weighted_integral(@audit:ok, Jensen on awithDensityprobability measure) gives(logDeriv p_Z z)² ≤ ∫ x, W_λ²·p_{X|Z}pointwise, integrated againstp_Z ≥ 0viaintegral_mono_ae; condDensityX·p_Z = fX(x)·fY(z-x)cancellation;- the 3-term Tonelli evaluation
convex_fisher_term1/2/cross(integral_integral_swap
- translation invariance
integral_sub_right_eq_self+ normalization /integral_logDeriv_density_eq_zerofor the cross term) yieldsλ²·J_X + (1-λ)²·J_Y(cross term= 0). @audit:ok
Used by
IsBlachmanConvReady regularity precondition bundle #
convex_fisher_bound requires, beyond IsRegularDensityV2 fX/fY + ∫=1, a set of
regularity preconditions that IsRegularDensityV2 does not imply: boundedness of
f and deriv f, several integrability side-conditions, positivity of the
convolution density p_Z, and the three product-measure (Tonelli) integrabilities.
These are needed for the convolution-Fisher analysis but are not derivable from
"regular density" alone (e.g. Differentiable does not bound deriv f).
They are bundled into a single structure IsBlachmanConvReady fX fY so the Stam
predicates (IsStamCondExpCSHyp / IsStamCauchySchwarz / IsStamCauchySchwarzOptimal)
carry one extra hypothesis rather than many. The lam-dependent integrabilities
(int_W, int_Wsq, int_inner) are quantified over lam ∈ [0,1] because the
consuming predicates conclude an ∀ lam bound.
InformationTheory.Shannon.EPIBlachmanDensity.IsBlachmanConvReady
sourceRegularity precondition bundle for the convolution-Fisher analysis.
All 19 fields are regularity / integrability / boundedness / positivity
preconditions; the bundle is field-for-field the same hypotheses convex_fisher_bound
takes individually (see convex_fisher_bound_of_ready). The
logDeriv (convDensityAdd fX fY)-containing fields (int_fisherZ / int_prod1/2/3)
assert only Integrable (…) of the verbatim integrands, not the value of any
integral nor any inequality, so none bundles the convex Fisher inequality core
(which lives inside convex_fisher_bound's body). A proven Gaussian inhabitant
isBlachmanConvReady_gaussianPDFReal (GaussianDensityRoute.lean, sorryAx-free)
establishes non-vacuousness.
@audit:ok
fXis Lebesgue-integrable.fYis Lebesgue-integrable.fXis bounded.deriv fXis bounded (NOT implied byIsRegularDensityV2).fYis bounded.deriv fYis bounded (NOT implied byIsRegularDensityV2).The convolution density
p_Z = convDensityAdd fX fYis strictly positive.- int_X(z : ℝ) : MeasureTheory.Integrable (fun (x : ℝ) => deriv fX x * fY (z - x)) MeasureTheory.volume
Per-
zintegrability ofderiv fX · fY(z - ·). - int_Y(z : ℝ) : MeasureTheory.Integrable (fun (x : ℝ) => fX x * deriv fY (z - x)) MeasureTheory.volume
Per-
zintegrability offX · deriv fY(z - ·). Per-
zintegrability of the conditional density.- int_W(lam : ℝ) : 0 ≤ lam → lam ≤ 1 → ∀ (z : ℝ), MeasureTheory.Integrable (fun (x : ℝ) => scoreWeight fX fY lam z x * condDensityX fX fY z x) MeasureTheory.volume
Per-
(lam, z)integrability ofscoreWeight · condDensityX. - int_Wsq(lam : ℝ) : 0 ≤ lam → lam ≤ 1 → ∀ (z : ℝ), MeasureTheory.Integrable (fun (x : ℝ) => scoreWeight fX fY lam z x ^ 2 * condDensityX fX fY z x) MeasureTheory.volume
Per-
(lam, z)integrability ofscoreWeight² · condDensityX. - int_inner(lam : ℝ) : 0 ≤ lam → lam ≤ 1 → MeasureTheory.Integrable (fun (z : ℝ) => (∫ (x : ℝ), scoreWeight fX fY lam z x ^ 2 * condDensityX fX fY z x) * EPIConvDensity.convDensityAdd fX fY z) MeasureTheory.volume
Per-
lamintegrability of the inner-weighted convolution density. - int_fisherX : MeasureTheory.Integrable (fun (x : ℝ) => logDeriv fX x ^ 2 * fX x) MeasureTheory.volume
Integrability of the
fX-Fisher integrand. - int_fisherY : MeasureTheory.Integrable (fun (x : ℝ) => logDeriv fY x ^ 2 * fY x) MeasureTheory.volume
Integrability of the
fY-Fisher integrand. - int_fisherZ : MeasureTheory.Integrable (fun (z : ℝ) => logDeriv (EPIConvDensity.convDensityAdd fX fY) z ^ 2 * EPIConvDensity.convDensityAdd fX fY z) MeasureTheory.volume
Integrability of the
p_Z-Fisher integrand. - int_prod1 : MeasureTheory.Integrable (Function.uncurry fun (z x : ℝ) => logDeriv fX x ^ 2 * fX x * fY (z - x)) (MeasureTheory.volume.prod MeasureTheory.volume)
Product-measure integrability of the first expanded Tonelli term.
- int_prod2 : MeasureTheory.Integrable (Function.uncurry fun (z x : ℝ) => logDeriv fY (z - x) ^ 2 * fX x * fY (z - x)) (MeasureTheory.volume.prod MeasureTheory.volume)
Product-measure integrability of the second expanded Tonelli term.
- int_prod3 : MeasureTheory.Integrable (Function.uncurry fun (z x : ℝ) => logDeriv fX x * fX x * (logDeriv fY (z - x) * fY (z - x))) (MeasureTheory.volume.prod MeasureTheory.volume)
Product-measure integrability of the cross Tonelli term.
Instances For
Used by
InformationTheory.Shannon.EPIBlachmanDensity.isBlachmanConvReady_symm
sourceSymmetry of the regularity bundle under the X ↔ Y swap.
IsBlachmanConvReady is symmetric: convDensityAdd is commutative
(convDensityAdd_comm) and each integrability / boundedness field transports across
the reflection substitution x ↦ z - x (volume-preserving) together with the marginal
swap on the product-measure fields. All 19 fields are constructed:
int_fX/int_fY/bdd_*/int_fisherX/int_fisherY— directX ↔ Yprojection ofh.pos_pZ/int_fisherZ—convDensityAdd_commrewrite of the correspondinghfield.int_X/int_Y/cond_int— reflection (Integrable.comp_sub_left) of the swappedhfield, then a pointwisemul_comm.int_W/int_Wsq— reflection ofh.int_W (1-lam)/h.int_Wsq (1-lam)(thelam ↔ 1-lamrelabelling is exactly the X↔Y swap underx ↦ z - x).int_inner—z-pointwise congruence withh.int_inner (1-lam), the innerx-integral being reflection-invariant (integral_sub_left_eq_self).int_prod1/int_prod2— separable rebuild fromhFisher/integrability fields, sheared bymeasurePreserving_prod_sub_swap((z,x) ↦ (x, z-x)).int_prod3— transport ofh.int_prod3by the skew map(z,x) ↦ (z, z-x)(MeasurePreserving.skew_productwith thex ↦ z - xreflection on the 2nd coord).
Consumed only by the (unused) API-completeness lemmas
isStamCauchySchwarz_symm / isStamCondExpCSHyp_symm.
@audit:ok
Used by
InformationTheory.Shannon.EPIBlachmanDensity.convex_fisher_bound_of_ready
sourceThe convex Fisher bound from the regularity bundle. Applies convex_fisher_bound
by projecting the integrability / boundedness / positivity preconditions out of the
IsBlachmanConvReady bundle. Pure plumbing — no analytic content beyond
convex_fisher_bound.
@audit:ok