InformationTheory.Shannon.AWGN.AchievabilityTypicalDecoder
Joint-typicality decoder and the random-coding union bound #
The decoder side of AWGN achievability (Cover–Thomas): the joint-typicality
decoder, the measurability plumbing for the per-message error event, and the
random-coding union bound culminating in awgn_avg_error_union_bound.
Main definitions #
jointTypicalDecoder A codebook— decodes a received vector to the smallest codeword index whose pair lies in the typical setA.
Main statements #
awgn_random_coding_union_bound— the codebook-average per-message error probability is≤ 2εpast a rate-dependent threshold, given the two AEP bounds.awgn_avg_error_union_bound— closes the union bound against the AEP-supplied typical set.
Continuous AEP for the n-dimensional Gaussian #
The continuous AEP is the lemma continuousAepGaussian_holds in
InformationTheory/Shannon/AWGN/KLCapacityAndAEP.lean. Consumers in this file call that
lemma directly instead of taking a predicate hypothesis.
Joint typical decoder and union bound #
InformationTheory.Shannon.AWGN.jointTypicalDecoder
sourceThe joint-typicality decoder (Cover–Thomas). Given a typical set
A ⊆ (Fin n → ℝ) × (Fin n → ℝ) and a candidate codebook, it maps each received
vector y to the smallest codeword index m with (codebook m, y) ∈ A; if no
such m exists it returns the default ⟨0, …⟩ : Fin M (well-defined under
[NeZero M]).
The set A is a parameter so that callers can plug in the AEP-supplied typical
set directly.
Equations
Instances For
Used by
InformationTheory.Shannon.AWGN.jointTypicalDecoder_measurable
sourceThe joint-typicality decoder is measurable for any measurable typical set
A.
Used by
Measurability plumbing for the per-message error #
Private helpers that discharge the AE-measurability of
c ↦ (Measure.pi (W ∘ c m)) (errorEvent c m) inside
isAwgnTypicalityHypothesis: the joint measurability of the decoder, the
codebook kernel, and the kernel-section measurability.
InformationTheory.Shannon.AWGN.jointTypicalDecoder_joint_measurable
sourceJoint measurability in (codebook, y) of jointTypicalDecoder.
Used by
InformationTheory.Shannon.AWGN.awgnCodebookKernel
sourceBundle c ↦ Measure.pi (fun i => awgnChannel N h_meas (c m i)) as a
genuine kernel. Each fibre is a probability measure (so the kernel is Markov,
hence s-finite), which lets us feed it to
Kernel.measurable_kernel_prodMk_left.
Equations
- One or more equations did not get rendered due to their size.
Instances For
Used by
InformationTheory.Shannon.AWGN.awgnCodebookKernel.instIsMarkovKernel
sourceUsed by
InformationTheory.Shannon.AWGN.measurable_measurePi_awgnChannel
sourceUsed by
InformationTheory.Shannon.AWGN.map_add_prod_pi_gaussianReal_eq_pi_gaussianReal
sourceUsed by
InformationTheory.Shannon.AWGN.measurePi_awgnChannel_eq_pi_gaussianReal_map_add
sourceUsed by
InformationTheory.Shannon.AWGN.lintegral_measurePi_awgnChannel_eq_pi_gaussianReal
sourceUsed by
InformationTheory.Shannon.AWGN.awgn_unionBound_trueCodeword_term_le
sourceUsed by
InformationTheory.Shannon.AWGN.awgn_unionBound_aliasCodeword_sum_eq
sourceUsed by
InformationTheory.Shannon.AWGN.awgn_unionBound_aliasMass_decay
sourceUsed by
Random-coding union bound #
InformationTheory.Shannon.AWGN.awgn_random_coding_union_bound
sourceThe random-coding union bound (Cover–Thomas, with the typicality slack
δ separated from the error target ε). With the codebook drawn from the
two-stage Gaussian product law and the decoder fixed to the joint-typicality
decoder against A, there is a threshold N₀ such that for every n ≥ N₀,
every codebook size M ≤ ⌈exp(nR)⌉, and every measurable typical set A
satisfying the two AEP bounds at slack δ, the average per-message error
probability is ≤ 2ε:
hA_mass— the joint codebook+noise law puts mass≥ 1−εonA.hA_indep— the independent-pair product law puts mass≤ exp(−(klDiv_n − 3nδ))onA.
The slack assumption hslack : R + 3δ < (1/2) log(1 + P/N) is what makes the
alias term decay: with the typicality margin g = I − R − 3δ > 0 and
klDiv_n = n·I, the alias mass is bounded by exp(−ng)·(…) → 0, hence ≤ ε
past N₀. The preconditions hP : 0 < P and hN : (N:ℝ) ≠ 0 exclude the
degenerate corner 1 + P/N < 0, where P.toNNReal = 0 collapses klDiv to 0
and the alias term no longer decays; under 0 < P and 0 < N we have
1 + P/N > 1 > 0. They are regularity preconditions, not a bundled proof core.
@audit:ok
Used by
InformationTheory.Shannon.AWGN.awgn_avg_error_union_bound
sourceThe random-coding union bound closed against the AEP-supplied typical set.
Under the random Gaussian codebook and AWGN channel, the average per-message
error probability (using jointTypicalDecoder against the AEP-supplied typical
set) is ≤ 2ε for all M ≤ ⌈exp(n R)⌉ once n is large enough, given the
typicality margin R + 3δ < (1/2) log(1 + P/N) with δ separate from ε.
A modular composition of continuousAepGaussian_holds + awgn_random_coding_union_bound;
hP/hN are passed through to the union bound at the call site.
@audit:ok