InformationTheory.Shannon.Han.DAverage
Han's inequality — subset average chain #
The normalized average subset entropy Hₖ := (k · C(n,k))⁻¹ · ∑_{|S|=k} H(X_S) is
nonincreasing in k.
Main statements #
averageSubsetEntropy μ Xs k— the normalized averageHₖ.subset_sum_step—k · S_{k+1} ≤ (n − k) · S_k, obtained by summinghan_inequality_subsetover|S| = k + 1and reindexing the double sum.subset_average_anti—H_{k+1} ≤ Hₖ.subset_average_chain—H_{k₂} ≤ H_{k₁}for1 ≤ k₁ ≤ k₂ ≤ n.