InformationTheory.Shannon.HypercubeEdge.BoundarySharp
Hypercube edge-boundary entropy-sharp inequality #
The entropy-sharp isoperimetric inequality for the edge boundary on the Boolean cube
Fin n → Bool:
|A| · (n − log₂ |A|) ≤ |∂_e A|,
which is sharper than the AM-GM form edgeBoundary_ge_AMGM.
Main statements #
condEntropy_coord_eq— the direction-iconditional entropy onμ_A := uniformOn Aequals(2 (|A| − |π_{≠i}(A)|) / |A|) · log 2.sum_condEntropy_le_log_card—∑ i, H(Xᵢ | X_{≠i}) ≤ log |A|, from the chain rule and conditioning monotonicity.edgeBoundary_entropy_sharp— the entropy-sharp bound|A| · (n − log₂ |A|) ≤ |∂_e A|.
Implementation notes #
The conditional entropy condEntropy_coord_eq is computed via the chain rule
H(X_{≠i}, Xᵢ) = H(X_{≠i}) + H(Xᵢ | X_{≠i}), evaluating H(X_{≠i}) directly from the
projection fibre masses, which avoids a pointwise condDistrib Bernoulli computation.
Uniform measure on A #
The conditional entropy condEntropy_coord_eq #
The direction-i conditional entropy is computed via the chain rule
H(X_{≠i}, Xᵢ) = H(X_{≠i}) + H(Xᵢ | X_{≠i}): the joint entropy is log |A|, and H(X_{≠i})
is computed directly from the projection fibre masses c_i(y) / |A|.
InformationTheory.Shannon.condEntropy_coord_eq
sourceThe direction-i conditional entropy under μ_A:
condEntropy μ_A (Xs i) X_{≠i} = (2 (|A| − |π_{≠i}(A)|) / |A|) · log 2.
Used by
Chain rule and conditioning monotonicity #
InformationTheory.Shannon.sum_condEntropy_le_log_card
sourceThe sum of the direction-wise conditional entropies is bounded by log |A|:
∑ i, H(Xᵢ | X_{≠i}) ≤ log |A|.
Used by
Main theorem #
InformationTheory.Shannon.edgeBoundary_entropy_sharp
sourceThe entropy-sharp edge-isoperimetric inequality: for nonempty A ⊆ Fin n → Bool,
|A| · (n − log₂ |A|) ≤ |∂_e A|.