InformationTheory

InformationTheory.Shannon.BroadcastChannel.OuterBoundUV.Bridge

source

Broadcast channel — from a block code to its ambient law #

The canonical ambient probability measure attached to a broadcast block code: a uniform message pair is passed through the per-letter product channel, and the messages and the two receiver outputs are read off the resulting measure as coordinate projections.

Read off that measure are the structural hypotheses of the message-level bound bc_uv_converse — memorylessness and the two Markov chains — together with the identification of the ambient decode error with the code's average error probability; instantiating bc_uv_converse there gives the headline bc_uv_converse_from_code. Two further sections re-encode the per-letter auxiliary variable onto a single alphabet, for an arbitrary ambient measure, and then read the letter-i five-tuple law off the ambient of a code and identify each summand of the bound with an information slot of that law.

Main definitions #

Main statements #

Implementation notes #

The output block lives on Fin n → β₁ × β₂, a sequence of output pairs, rather than on a pair of sequences. With that choice the message-to-output kernel is literally BroadcastCode.blockOutputLaw, so the product structure over letters is available to the structural lemmas and the same-letter pair (Y_{1,i}, Y_{2,i}) is never split; the two per-receiver output sequences are recovered as further projections.

The alphabet of uvAux … i depends on the letter i, so different letters produce auxiliary variables of different types. uvAuxPad moves all of them onto one alphabet by padding the prefix and the suffix with a default value and keeping i as a first component; keeping i is what makes the padding invertible, and invertibility is what turns the data processing inequality into an equality of informations.

Together with the uniformity and independence statements the four structural lemmas discharge the structural preconditions of the message-level converse bc_uv_converse. The encoder is measurable for free because the message pair ranges over a finite type, so the only hypotheses bc_uv_converse_from_code keeps are 2 ≤ M₁ and 2 ≤ M₂.

The five-tuple carries both auxiliaries, because the four information slots split two and two between them; keeping them in one law is what lets a single distribution witness all four inequalities. uvInfoSum₂ and uvInfoSum₁ take [IsFiniteMeasure ν] since condMutualInfo does, while the two corner slots need nothing beyond measurability. The four are declared in the field order of InBCOuterRegionUV (bound₁, bound₂, sumBound₂, sumBound₁) rather than by subscript, so that an instantiation reads down the structure. uvInfoJoint comes after them because it mentions neither auxiliary and so answers to no field of that structure.

The ambient measure of a broadcast code #

The input law, the channel kernel and the ambient #

noncomputable def

InformationTheory.Shannon.BroadcastChannel.bcConverseInput

source
(M₁ M₂ : ) :

Uniform input law on the message pair: the product of the two uniform message laws.

Equations
Instances For
    Used by
      instance

      InformationTheory.Shannon.BroadcastChannel.bcConverseInput_isProbabilityMeasure

      source
      {M₁ M₂ : } [NeZero M₁] [NeZero M₂] :
      Used by
        noncomputable def

        InformationTheory.Shannon.BroadcastChannel.bcConverseKernel

        source
        {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) :
        ProbabilityTheory.Kernel (Fin M₁ × Fin M₂) (Fin nβ₁ × β₂)

        Per-letter product-channel kernel: given the message pair m, the output law is the product over the n letters of the broadcast channel W applied to the encoded letter encoder m i. Each letter contributes an output pair, so the two receivers stay coupled within a letter.

        Equations
        • One or more equations did not get rendered due to their size.
        Instances For
          Used by
            instance

            InformationTheory.Shannon.BroadcastChannel.bcConverseKernel_isMarkovKernel

            source
            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] :
            Used by
              theorem

              InformationTheory.Shannon.BroadcastChannel.bcConverseKernel_apply

              source
              {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) (m : Fin M₁ × Fin M₂) :
              Used by
                noncomputable def

                InformationTheory.Shannon.BroadcastChannel.bcConverseAmbient

                source
                {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) :
                MeasureTheory.Measure ((Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂))

                Canonical ambient measure for the broadcast converse: a uniform message pair passed through the per-letter product channel.

                Equations
                • One or more equations did not get rendered due to their size.
                Instances For
                  Used by
                    instance

                    InformationTheory.Shannon.BroadcastChannel.bcConverseAmbient_isProbabilityMeasure

                    source
                    {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                    Used by

                      Projections #

                      def

                      InformationTheory.Shannon.BroadcastChannel.bcConverseMsg₁

                      source
                      {β₁ : Type u_2} {β₂ : Type u_3} {M₁ M₂ n : } :
                      (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)Fin M₁

                      Message-1 projection ω ↦ ω.1.1.

                      Equations
                      Instances For
                        Used by
                          def

                          InformationTheory.Shannon.BroadcastChannel.bcConverseMsg₂

                          source
                          {β₁ : Type u_2} {β₂ : Type u_3} {M₁ M₂ n : } :
                          (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)Fin M₂

                          Message-2 projection ω ↦ ω.1.2.

                          Equations
                          Instances For
                            Used by
                              def

                              InformationTheory.Shannon.BroadcastChannel.bcConverseYs

                              source
                              {β₁ : Type u_2} {β₂ : Type u_3} {M₁ M₂ n : } :
                              Fin n(Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)β₁ × β₂

                              Output-pair projection i ↦ ω ↦ ω.2 i.

                              Equations
                              Instances For
                                Used by
                                  def

                                  InformationTheory.Shannon.BroadcastChannel.bcConverseY₁s

                                  source
                                  {β₁ : Type u_2} {β₂ : Type u_3} {M₁ M₂ n : } :
                                  Fin n(Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)β₁

                                  Receiver-1 output projection i ↦ ω ↦ (ω.2 i).1.

                                  Equations
                                  Instances For
                                    Used by
                                      def

                                      InformationTheory.Shannon.BroadcastChannel.bcConverseY₂s

                                      source
                                      {β₁ : Type u_2} {β₂ : Type u_3} {M₁ M₂ n : } :
                                      Fin n(Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)β₂

                                      Receiver-2 output projection i ↦ ω ↦ (ω.2 i).2.

                                      Equations
                                      Instances For
                                        Used by
                                          theorem

                                          InformationTheory.Shannon.BroadcastChannel.measurable_bcConverseMsg₁

                                          source
                                          {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } :
                                          Used by
                                            theorem

                                            InformationTheory.Shannon.BroadcastChannel.measurable_bcConverseMsg₂

                                            source
                                            {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } :
                                            Used by
                                              theorem

                                              InformationTheory.Shannon.BroadcastChannel.measurable_bcConverseYs

                                              source
                                              {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (i : Fin n) :
                                              Used by
                                                theorem

                                                InformationTheory.Shannon.BroadcastChannel.measurable_bcConverseY₁s

                                                source
                                                {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (i : Fin n) :
                                                Used by
                                                  theorem

                                                  InformationTheory.Shannon.BroadcastChannel.measurable_bcConverseY₂s

                                                  source
                                                  {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (i : Fin n) :
                                                  Used by

                                                    Uniformity and independence of the messages #

                                                    theorem

                                                    InformationTheory.Shannon.BroadcastChannel.bcConverseInput_map_fst

                                                    source
                                                    Used by
                                                      theorem

                                                      InformationTheory.Shannon.BroadcastChannel.bcConverseInput_map_snd

                                                      source
                                                      Used by
                                                        theorem

                                                        InformationTheory.Shannon.BroadcastChannel.bcConverseInput_eq

                                                        source
                                                        {M₁ M₂ : } :
                                                        Used by
                                                          theorem

                                                          InformationTheory.Shannon.BroadcastChannel.bcConverse_msgPair_eq_fst

                                                          source
                                                          {β₁ : Type u_2} {β₂ : Type u_3} {M₁ M₂ n : } :
                                                          (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₁ ω, bcConverseMsg₂ ω)) = Prod.fst
                                                          Used by
                                                            theorem

                                                            InformationTheory.Shannon.BroadcastChannel.bcConverseMsg₁_uniform

                                                            source
                                                            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                            Used by
                                                              theorem

                                                              InformationTheory.Shannon.BroadcastChannel.bcConverseMsg₂_uniform

                                                              source
                                                              {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                              Used by
                                                                theorem

                                                                InformationTheory.Shannon.BroadcastChannel.bcConverse_mutualInfo_eq_zero

                                                                source
                                                                {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                                Used by

                                                                  The codeword kernel #

                                                                  noncomputable def

                                                                  InformationTheory.Shannon.BroadcastChannel.bcConverseCodeKernel

                                                                  source
                                                                  {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } [Fintype α] [MeasurableSingletonClass α] (W : BCChannel α β₁ β₂) :
                                                                  ProbabilityTheory.Kernel (Fin nα) (Fin nβ₁ × β₂)

                                                                  Codeword → output-block kernel: given an input codeword x, the output law is the per-letter product ∏ᵢ W (x i) of the broadcast channel.

                                                                  Equations
                                                                  Instances For
                                                                    Used by
                                                                      instance

                                                                      InformationTheory.Shannon.BroadcastChannel.bcConverseCodeKernel_isMarkovKernel

                                                                      source
                                                                      Used by

                                                                        Structural hypotheses of the message-level converse #

                                                                        theorem

                                                                        InformationTheory.Shannon.BroadcastChannel.bcConverse_memoryless₁

                                                                        source
                                                                        {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [StandardBorelSpace α] [Nonempty α] [StandardBorelSpace β₁] [Nonempty β₁] [StandardBorelSpace β₂] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :
                                                                        IsMarkovChain (bcConverseAmbient c W) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₂ ω, fun (j : { j : Fin n // j i }) => c.encoder ω.1 j, fun (j : { j : Fin n // j i }) => bcConverseY₁s (↑j) ω, fun (j : { j : Fin n // j i }) => bcConverseY₂s (↑j) ω)) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => c.encoder ω.1 i) (bcConverseY₁s i)

                                                                        Joint-output memorylessness at receiver 1, read off the ambient: the letter-i output of receiver 1 is conditionally independent of message 2, of the other input letters and of all the other output letters of both receivers, given the input letter encoder m i. The same-letter pair of outputs is never decoupled, so the two receivers stay arbitrarily correlated within a letter. This is the hypothesis h_memo₁ of bc_uv_converse at bcConverseAmbient. @audit:ok

                                                                        Used by
                                                                          theorem

                                                                          InformationTheory.Shannon.BroadcastChannel.bcConverse_memoryless₂

                                                                          source
                                                                          {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [StandardBorelSpace α] [Nonempty α] [StandardBorelSpace β₁] [Nonempty β₁] [StandardBorelSpace β₂] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :
                                                                          IsMarkovChain (bcConverseAmbient c W) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₁ ω, fun (j : { j : Fin n // j i }) => c.encoder ω.1 j, fun (j : { j : Fin n // j i }) => bcConverseY₁s (↑j) ω, fun (j : { j : Fin n // j i }) => bcConverseY₂s (↑j) ω)) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => c.encoder ω.1 i) (bcConverseY₂s i)

                                                                          Joint-output memorylessness at receiver 2, the mirror of bcConverse_memoryless₁: the letter-i output of receiver 2 is conditionally independent of message 1, of the other input letters and of all the other output letters of both receivers, given the input letter encoder m i. This is the hypothesis h_memo₂ of bc_uv_converse at bcConverseAmbient. @audit:ok

                                                                          Used by
                                                                            theorem

                                                                            InformationTheory.Shannon.BroadcastChannel.bcConverse_isMarkovChain₁

                                                                            source
                                                                            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Fintype α] [MeasurableSingletonClass α] [StandardBorelSpace β₁] [Nonempty β₁] [StandardBorelSpace β₂] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                                            IsMarkovChain (bcConverseAmbient c W) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₂ ω, bcConverseMsg₁ ω)) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₂ ω, fun (j : Fin n) => c.encoder ω.1 j)) fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) (j : Fin n) => bcConverseY₁s j ω

                                                                            The messages act on receiver 1's output block only through the codeword: (W₂, W₁) → (W₂, Xⁿ) → Y₁ⁿ under the ambient. This is the hypothesis hmarkov₁ of bc_uv_converse at bcConverseAmbient. @audit:ok

                                                                            Used by
                                                                              theorem

                                                                              InformationTheory.Shannon.BroadcastChannel.bcConverse_isMarkovChain₂

                                                                              source
                                                                              {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Fintype α] [MeasurableSingletonClass α] [StandardBorelSpace β₁] [Nonempty β₁] [StandardBorelSpace β₂] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                                              IsMarkovChain (bcConverseAmbient c W) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₁ ω, bcConverseMsg₂ ω)) (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) => (bcConverseMsg₁ ω, fun (j : Fin n) => c.encoder ω.1 j)) fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) (j : Fin n) => bcConverseY₂s j ω

                                                                              The mirror of bcConverse_isMarkovChain₁ at receiver 2: (W₁, W₂) → (W₁, Xⁿ) → Y₂ⁿ under the ambient. This is the hypothesis hmarkov₂ of bc_uv_converse at bcConverseAmbient. @audit:ok

                                                                              Used by

                                                                                Code-level converse and rate extraction #

                                                                                theorem

                                                                                InformationTheory.Shannon.BroadcastChannel.bcConverse_errorProb₁_eq

                                                                                source
                                                                                {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Fintype β₁] [MeasurableSingletonClass β₁] [Fintype β₂] [MeasurableSingletonClass β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                                                MeasureFano.errorProb (bcConverseAmbient c W) bcConverseMsg₁ (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) (i : Fin n) => bcConverseY₁s i ω) c.decoder₁ = (c.averageErrorProb₁ W).toReal
                                                                                Used by
                                                                                  theorem

                                                                                  InformationTheory.Shannon.BroadcastChannel.bcConverse_errorProb₂_eq

                                                                                  source
                                                                                  {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Fintype β₁] [MeasurableSingletonClass β₁] [Fintype β₂] [MeasurableSingletonClass β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] :
                                                                                  MeasureFano.errorProb (bcConverseAmbient c W) bcConverseMsg₂ (fun (ω : (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂)) (i : Fin n) => bcConverseY₂s i ω) c.decoder₂ = (c.averageErrorProb₂ W).toReal
                                                                                  Used by
                                                                                    noncomputable def

                                                                                    InformationTheory.Shannon.BroadcastChannel.bcConverseFanoSlack₁

                                                                                    source
                                                                                    {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) :

                                                                                    Receiver-1 Fano slack of a broadcast code: the binary entropy of the ambient decode error at receiver 1 together with that error probability scaled by log (M₁ - 1). This is the additive term by which the message-level converse exceeds the per-letter information sum, and it tends to zero with the error probability. @audit:ok

                                                                                    Equations
                                                                                    • One or more equations did not get rendered due to their size.
                                                                                    Instances For
                                                                                      Used by
                                                                                        noncomputable def

                                                                                        InformationTheory.Shannon.BroadcastChannel.bcConverseFanoSlack₂

                                                                                        source
                                                                                        {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) :

                                                                                        Receiver-2 Fano slack of a broadcast code, the mirror of bcConverseFanoSlack₁. @audit:ok

                                                                                        Equations
                                                                                        • One or more equations did not get rendered due to their size.
                                                                                        Instances For
                                                                                          Used by
                                                                                            theorem

                                                                                            InformationTheory.Shannon.BroadcastChannel.bc_uv_converse_from_code

                                                                                            source
                                                                                            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Fintype β₁] [MeasurableSingletonClass β₁] [Fintype β₂] [MeasurableSingletonClass β₂] [Fintype α] [MeasurableSingletonClass α] [StandardBorelSpace α] [Nonempty α] [StandardBorelSpace β₁] [Nonempty β₁] [StandardBorelSpace β₂] [Nonempty β₂] [NeZero M₁] [NeZero M₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] (hcard₁ : 2 M₁) (hcard₂ : 2 M₂) :

                                                                                            The UV outer bound instantiated at a bare broadcast code: for any two-receiver block code c and Markov channel W, the canonical ambient measure bcConverseAmbient c W discharges every hypothesis of the message-level converse bc_uv_converse, so the rate pair (log M₁, log M₂) lies in the Nair–El Gamal region determined by the per-letter auxiliaries. No degradedness is assumed. The Fano slack is still carried here; it vanishes only in the n → ∞ limit. @audit:ok

                                                                                            Used by

                                                                                              Fixed-alphabet form of the auxiliary variable #

                                                                                              noncomputable def

                                                                                              InformationTheory.Shannon.BroadcastChannel.uvPadMap

                                                                                              source
                                                                                              {β₁ : Type u_2} {β₂ : Type u_3} {n : } {ξ : Type u_5} [Nonempty β₁] [Nonempty β₂] (i : Fin n) :
                                                                                              ξ × (Fin iβ₁) × ({ j : Fin n // i < j }β₂)Fin n × ξ × (Fin nβ₁) × (Fin nβ₂)

                                                                                              Re-encoding of the letter-i auxiliary alphabet into one that does not depend on i: the receiver-1 prefix and the receiver-2 suffix are extended to full-length sequences by a default value, and the letter index is kept as a first component so that the extension can be undone.

                                                                                              Equations
                                                                                              • One or more equations did not get rendered due to their size.
                                                                                              Instances For
                                                                                                Used by
                                                                                                  def

                                                                                                  InformationTheory.Shannon.BroadcastChannel.uvUnpadMap

                                                                                                  source
                                                                                                  {β₁ : Type u_2} {β₂ : Type u_3} {n : } {ξ : Type u_5} (i : Fin n) :
                                                                                                  Fin n × ξ × (Fin nβ₁) × (Fin nβ₂)ξ × (Fin iβ₁) × ({ j : Fin n // i < j }β₂)

                                                                                                  Left inverse of uvPadMap i: restrict the two full-length sequences back to the receiver-1 prefix Y₁^{<i} and the receiver-2 suffix Y₂^{>i}.

                                                                                                  Equations
                                                                                                  Instances For
                                                                                                    Used by
                                                                                                      noncomputable def

                                                                                                      InformationTheory.Shannon.BroadcastChannel.uvAuxPad

                                                                                                      source
                                                                                                      {β₁ : Type u_2} {β₂ : Type u_3} {n : } {Ω : Type u_4} {ξ : Type u_5} [Nonempty β₁] [Nonempty β₂] (W : Ωξ) (Y₁s : Fin nΩβ₁) (Y₂s : Fin nΩβ₂) (i : Fin n) :
                                                                                                      ΩFin n × ξ × (Fin nβ₁) × (Fin nβ₂)

                                                                                                      The letter-i auxiliary variable of the UV outer bound, re-encoded into the fixed alphabet Fin n × ξ × (Fin n → β₁) × (Fin n → β₂), which no longer depends on i.

                                                                                                      Equations
                                                                                                      Instances For
                                                                                                        Used by
                                                                                                          theorem

                                                                                                          InformationTheory.Shannon.BroadcastChannel.uvUnpadMap_uvPadMap

                                                                                                          source
                                                                                                          {β₁ : Type u_2} {β₂ : Type u_3} {n : } {ξ : Type u_5} [Nonempty β₁] [Nonempty β₂] (i : Fin n) (p : ξ × (Fin iβ₁) × ({ j : Fin n // i < j }β₂)) :
                                                                                                          Used by
                                                                                                            theorem

                                                                                                            InformationTheory.Shannon.BroadcastChannel.measurable_uvPadMap

                                                                                                            source
                                                                                                            {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } {ξ : Type u_5} [MeasurableSpace ξ] [Nonempty β₁] [Nonempty β₂] (i : Fin n) :
                                                                                                            Used by
                                                                                                              theorem

                                                                                                              InformationTheory.Shannon.BroadcastChannel.measurable_uvUnpadMap

                                                                                                              source
                                                                                                              {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } {ξ : Type u_5} [MeasurableSpace ξ] (i : Fin n) :
                                                                                                              Used by
                                                                                                                theorem

                                                                                                                InformationTheory.Shannon.BroadcastChannel.measurable_uvAuxPad

                                                                                                                source
                                                                                                                {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } {Ω : Type u_4} [MeasurableSpace Ω] {ξ : Type u_5} [MeasurableSpace ξ] [Nonempty β₁] [Nonempty β₂] (W : Ωξ) (Y₁s : Fin nΩβ₁) (Y₂s : Fin nΩβ₂) (hW : Measurable W) (hY₁s : ∀ (i : Fin n), Measurable (Y₁s i)) (hY₂s : ∀ (i : Fin n), Measurable (Y₂s i)) (i : Fin n) :
                                                                                                                Measurable (uvAuxPad W Y₁s Y₂s i)
                                                                                                                Used by
                                                                                                                  theorem

                                                                                                                  InformationTheory.Shannon.BroadcastChannel.uvAux_pad_mutualInfo_eq

                                                                                                                  source
                                                                                                                  {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } {Ω : Type u_4} [MeasurableSpace Ω] {ξ : Type u_5} [MeasurableSpace ξ] {γ : Type u_6} [MeasurableSpace γ] [Nonempty β₁] [Nonempty β₂] (μ : MeasureTheory.Measure Ω) [MeasureTheory.IsFiniteMeasure μ] (W : Ωξ) (Y₁s : Fin nΩβ₁) (Y₂s : Fin nΩβ₂) (Yo : Ωγ) (hW : Measurable W) (hY₁s : ∀ (i : Fin n), Measurable (Y₁s i)) (hY₂s : ∀ (i : Fin n), Measurable (Y₂s i)) (hYo : Measurable Yo) (i : Fin n) :
                                                                                                                  mutualInfo μ (uvAuxPad W Y₁s Y₂s i) Yo = mutualInfo μ (uvAux W Y₁s Y₂s i) Yo
                                                                                                                  Used by
                                                                                                                    theorem

                                                                                                                    InformationTheory.Shannon.BroadcastChannel.uvAux_pad_mutualInfo_prod_eq

                                                                                                                    source
                                                                                                                    {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } {Ω : Type u_4} [MeasurableSpace Ω] {ξ : Type u_5} [MeasurableSpace ξ] {γ : Type u_6} [MeasurableSpace γ] [Nonempty β₁] [Nonempty β₂] (μ : MeasureTheory.Measure Ω) [MeasureTheory.IsFiniteMeasure μ] (W : Ωξ) (Y₁s : Fin nΩβ₁) (Y₂s : Fin nΩβ₂) (Xs : Ωα) (Yo : Ωγ) (hW : Measurable W) (hY₁s : ∀ (i : Fin n), Measurable (Y₁s i)) (hY₂s : ∀ (i : Fin n), Measurable (Y₂s i)) (hXs : Measurable Xs) (hYo : Measurable Yo) (i : Fin n) :
                                                                                                                    mutualInfo μ (fun (ω : Ω) => (uvAuxPad W Y₁s Y₂s i ω, Xs ω)) Yo = mutualInfo μ (fun (ω : Ω) => (uvAux W Y₁s Y₂s i ω, Xs ω)) Yo
                                                                                                                    Used by
                                                                                                                      theorem

                                                                                                                      InformationTheory.Shannon.BroadcastChannel.uvAux_pad_condMutualInfo_eq

                                                                                                                      source
                                                                                                                      {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {n : } {Ω : Type u_4} [MeasurableSpace Ω] {ξ : Type u_5} [MeasurableSpace ξ] {γ : Type u_6} [MeasurableSpace γ] [Nonempty β₁] [Nonempty β₂] [Fintype ξ] [MeasurableSingletonClass ξ] [Fintype β₁] [MeasurableSingletonClass β₁] [Fintype β₂] [MeasurableSingletonClass β₂] [Fintype γ] [MeasurableSingletonClass γ] [StandardBorelSpace γ] [Nonempty γ] [StandardBorelSpace α] [Nonempty α] (μ : MeasureTheory.Measure Ω) [MeasureTheory.IsProbabilityMeasure μ] (W : Ωξ) (Y₁s : Fin nΩβ₁) (Y₂s : Fin nΩβ₂) (Xs : Ωα) (Yo : Ωγ) (hW : Measurable W) (hY₁s : ∀ (i : Fin n), Measurable (Y₁s i)) (hY₂s : ∀ (i : Fin n), Measurable (Y₂s i)) (hXs : Measurable Xs) (hYo : Measurable Yo) (i : Fin n) :
                                                                                                                      condMutualInfo μ Xs Yo (uvAuxPad W Y₁s Y₂s i) = condMutualInfo μ Xs Yo (uvAux W Y₁s Y₂s i)
                                                                                                                      Used by

                                                                                                                        Per-letter joint law and its information slots #

                                                                                                                        The information slots of a five-tuple law #

                                                                                                                        noncomputable def

                                                                                                                        InformationTheory.Shannon.BroadcastChannel.uvInfo₁

                                                                                                                        source
                                                                                                                        {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {U : Type u_4} {V : Type u_5} [MeasurableSpace U] [MeasurableSpace V] (ν : MeasureTheory.Measure (U × V × α × β₁ × β₂)) :

                                                                                                                        Receiver-1 corner information I(V; Y₁) of a five-tuple law (U, V, X, Y₁, Y₂). @audit:ok

                                                                                                                        Equations
                                                                                                                        Instances For
                                                                                                                          Used by
                                                                                                                            noncomputable def

                                                                                                                            InformationTheory.Shannon.BroadcastChannel.uvInfo₂

                                                                                                                            source
                                                                                                                            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {U : Type u_4} {V : Type u_5} [MeasurableSpace U] [MeasurableSpace V] (ν : MeasureTheory.Measure (U × V × α × β₁ × β₂)) :

                                                                                                                            Receiver-2 corner information I(U; Y₂) of a five-tuple law (U, V, X, Y₁, Y₂). @audit:ok

                                                                                                                            Equations
                                                                                                                            Instances For
                                                                                                                              Used by
                                                                                                                                noncomputable def

                                                                                                                                InformationTheory.Shannon.BroadcastChannel.uvInfoSum₂

                                                                                                                                source
                                                                                                                                {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {U : Type u_4} {V : Type u_5} [MeasurableSpace U] [MeasurableSpace V] [StandardBorelSpace α] [Nonempty α] [StandardBorelSpace β₁] [Nonempty β₁] (ν : MeasureTheory.Measure (U × V × α × β₁ × β₂)) [MeasureTheory.IsFiniteMeasure ν] :

                                                                                                                                Sum-rate information I(U; Y₂) + I(X; Y₁ | U) with the receiver-2 auxiliary leading. @audit:ok

                                                                                                                                Equations
                                                                                                                                • One or more equations did not get rendered due to their size.
                                                                                                                                Instances For
                                                                                                                                  Used by
                                                                                                                                    noncomputable def

                                                                                                                                    InformationTheory.Shannon.BroadcastChannel.uvInfoSum₁

                                                                                                                                    source
                                                                                                                                    {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {U : Type u_4} {V : Type u_5} [MeasurableSpace U] [MeasurableSpace V] [StandardBorelSpace α] [Nonempty α] [StandardBorelSpace β₂] [Nonempty β₂] (ν : MeasureTheory.Measure (U × V × α × β₁ × β₂)) [MeasureTheory.IsFiniteMeasure ν] :

                                                                                                                                    Sum-rate information I(V; Y₁) + I(X; Y₂ | V) with the receiver-1 auxiliary leading. @audit:ok

                                                                                                                                    Equations
                                                                                                                                    • One or more equations did not get rendered due to their size.
                                                                                                                                    Instances For
                                                                                                                                      Used by
                                                                                                                                        noncomputable def

                                                                                                                                        InformationTheory.Shannon.BroadcastChannel.uvInfoJoint

                                                                                                                                        source
                                                                                                                                        {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {U : Type u_4} {V : Type u_5} [MeasurableSpace U] [MeasurableSpace V] (ν : MeasureTheory.Measure (U × V × α × β₁ × β₂)) :

                                                                                                                                        The input-output information I(X; Y₁) of a five-tuple law (U, V, X, Y₁, Y₂).

                                                                                                                                        Equations
                                                                                                                                        Instances For
                                                                                                                                          Used by
                                                                                                                                            theorem

                                                                                                                                            InformationTheory.Shannon.BroadcastChannel.mutualInfo_pair_out₁_eq_uvInfoJoint

                                                                                                                                            source
                                                                                                                                            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {U : Type u_4} {V : Type u_5} [MeasurableSpace U] [MeasurableSpace V] [StandardBorelSpace β₁] [Nonempty β₁] {A : Type u_6} [MeasurableSpace A] [StandardBorelSpace A] [Nonempty A] (ν : MeasureTheory.Measure (U × V × α × β₁ × β₂)) [MeasureTheory.IsProbabilityMeasure ν] (Aux : U × V × α × β₁ × β₂A) (hAux : Measurable Aux) (hmk : IsMarkovChain ν Aux (fun (q : U × V × α × β₁ × β₂) => q.2.2.1) fun (q : U × V × α × β₁ × β₂) => q.2.2.2.1) :
                                                                                                                                            (mutualInfo ν (fun (q : U × V × α × β₁ × β₂) => (Aux q, q.2.2.1)) fun (q : U × V × α × β₁ × β₂) => q.2.2.2.1) = uvInfoJoint ν
                                                                                                                                            Used by

                                                                                                                                              The per-letter law read off the ambient #

                                                                                                                                              noncomputable def

                                                                                                                                              InformationTheory.Shannon.BroadcastChannel.bcUVTuple

                                                                                                                                              source
                                                                                                                                              {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Nonempty β₁] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (i : Fin n) :
                                                                                                                                              (Fin M₁ × Fin M₂) × (Fin nβ₁ × β₂) → (Fin n × Fin M₂ × (Fin nβ₁) × (Fin nβ₂)) × (Fin n × Fin M₁ × (Fin nβ₁) × (Fin nβ₂)) × α × β₁ × β₂

                                                                                                                                              The letter-i five-tuple of the UV outer bound, read off the ambient: the receiver-2 auxiliary, the receiver-1 auxiliary — both in the fixed alphabet of uvAuxPad — the input letter and the two output letters. @audit:ok

                                                                                                                                              Equations
                                                                                                                                              • One or more equations did not get rendered due to their size.
                                                                                                                                              Instances For
                                                                                                                                                Used by
                                                                                                                                                  theorem

                                                                                                                                                  InformationTheory.Shannon.BroadcastChannel.measurable_bcUVTuple

                                                                                                                                                  source
                                                                                                                                                  {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Nonempty β₁] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (i : Fin n) :
                                                                                                                                                  Used by
                                                                                                                                                    noncomputable def

                                                                                                                                                    InformationTheory.Shannon.BroadcastChannel.bcUVJointDistribution

                                                                                                                                                    source
                                                                                                                                                    {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Nonempty β₁] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) (i : Fin n) :
                                                                                                                                                    MeasureTheory.Measure ((Fin n × Fin M₂ × (Fin nβ₁) × (Fin nβ₂)) × (Fin n × Fin M₁ × (Fin nβ₁) × (Fin nβ₂)) × α × β₁ × β₂)

                                                                                                                                                    The joint law of the letter-i five-tuple under the ambient measure of a broadcast code: the two auxiliaries, the input letter and the two output letters, all pushed forward from bcConverseAmbient. @audit:ok

                                                                                                                                                    Equations
                                                                                                                                                    • One or more equations did not get rendered due to their size.
                                                                                                                                                    Instances For
                                                                                                                                                      Used by
                                                                                                                                                        instance

                                                                                                                                                        InformationTheory.Shannon.BroadcastChannel.bcUVJointDistribution_isProbabilityMeasure

                                                                                                                                                        source
                                                                                                                                                        {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Nonempty β₁] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :
                                                                                                                                                        Used by
                                                                                                                                                          theorem

                                                                                                                                                          InformationTheory.Shannon.BroadcastChannel.bc_uv_mutualInfo_eq_uvInfo₁_at

                                                                                                                                                          source
                                                                                                                                                          {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Nonempty β₁] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :

                                                                                                                                                          @audit:ok

                                                                                                                                                          Used by
                                                                                                                                                            theorem

                                                                                                                                                            InformationTheory.Shannon.BroadcastChannel.bc_uv_mutualInfo_eq_uvInfo₂_at

                                                                                                                                                            source
                                                                                                                                                            {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [Nonempty β₁] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :

                                                                                                                                                            @audit:ok

                                                                                                                                                            Used by
                                                                                                                                                              theorem

                                                                                                                                                              InformationTheory.Shannon.BroadcastChannel.bc_uv_sum_eq_uvInfoSum₂_at

                                                                                                                                                              source
                                                                                                                                                              {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [StandardBorelSpace α] [Nonempty α] [Fintype β₁] [MeasurableSingletonClass β₁] [StandardBorelSpace β₁] [Nonempty β₁] [Fintype β₂] [MeasurableSingletonClass β₂] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :

                                                                                                                                                              @audit:ok

                                                                                                                                                              Used by
                                                                                                                                                                theorem

                                                                                                                                                                InformationTheory.Shannon.BroadcastChannel.bc_uv_sum_eq_uvInfoSum₁_at

                                                                                                                                                                source
                                                                                                                                                                {α : Type u_1} [MeasurableSpace α] {β₁ : Type u_2} [MeasurableSpace β₁] {β₂ : Type u_3} [MeasurableSpace β₂] {M₁ M₂ n : } [StandardBorelSpace α] [Nonempty α] [Fintype β₁] [MeasurableSingletonClass β₁] [Nonempty β₁] [Fintype β₂] [MeasurableSingletonClass β₂] [StandardBorelSpace β₂] [Nonempty β₂] (c : BroadcastCode M₁ M₂ n α β₁ β₂) (W : BCChannel α β₁ β₂) [ProbabilityTheory.IsMarkovKernel W] [NeZero M₁] [NeZero M₂] (i : Fin n) :

                                                                                                                                                                @audit:ok

                                                                                                                                                                Used by