InformationTheory

InformationTheory.Shannon.Han.DAverage

source

Han's inequality — subset average chain #

The normalized average subset entropy Hₖ := (k · C(n,k))⁻¹ · ∑_{|S|=k} H(X_S) is nonincreasing in k.

Main statements #

  • averageSubsetEntropy μ Xs k — the normalized average Hₖ.
  • subset_sum_stepk · S_{k+1} ≤ (n − k) · S_k, obtained by summing han_inequality_subset over |S| = k + 1 and reindexing the double sum.
  • subset_average_antiH_{k+1} ≤ Hₖ.
  • subset_average_chainH_{k₂} ≤ H_{k₁} for 1 ≤ k₁ ≤ k₂ ≤ n.