InformationTheory.Shannon.Stationary.Basic
Stationary processes #
Lean encoding of a stationary (resp. ergodic) discrete-time process via a
MeasurePreserving (resp. Ergodic) shift T : Ω → Ω together with a
single observable X : Ω → α. Time-i observation is X ∘ T^[i], the
block (X_0, …, X_{n-1}) is blockRV n : Ω → (Fin n → α).
These definitions are the foundation for the entropy rate, Birkhoff's ergodic theorem, the log-likelihood chain rule, and the Shannon–McMillan–Breiman theorem.
Main definitions #
StationaryProcess— bundlesT,X,MeasurePreserving T μ μ,Measurable X.StationaryProcess.obs i— the time-iobservationX ∘ T^[i].StationaryProcess.blockRV n— joint(X_0, …, X_{n-1}) : Ω → (Fin n → α).ErgodicProcess— extendsStationaryProcesswithErgodic T μ.
Main statements #
StationaryProcess.measurable_obs— eachobs iis measurable.StationaryProcess.measurable_blockRV—blockRV nis measurable.StationaryProcess.identDistrib_obs_zero—obs ihas the same law asobs 0(stationarity, derived fromMeasurePreserving.iterate).
InformationTheory.Shannon.StationaryProcess
sourceA stationary process: a measure-preserving transformation T : Ω → Ω on
(Ω, μ) together with a measurable observable X : Ω → α. The time-i
observation is X ∘ T^[i].
- T : Ω → Ω
The shift / time-evolution map.
- X : Ω → α
The single observable; later samples are obtained by composing with
T^[i]. Tpreservesμ.The observable is measurable.
Instances For
Used by
InformationTheory.Shannon.StationaryProcess.obs
sourceTime-i observation X_i := X ∘ T^[i].
Instances For
Used by
InformationTheory.Shannon.StationaryProcess.measurable_T
sourceThe shift map is measurable (it preserves μ, in particular it is measurable).
Used by
InformationTheory.Shannon.StationaryProcess.measurable_iterate
sourceT^[i] is measurable for any i.
Used by
InformationTheory.Shannon.StationaryProcess.measurable_obs
sourceEach time-i observation is measurable.
Used by
InformationTheory.Shannon.StationaryProcess.blockRV
sourceBlock joint observation (X_0, X_1, …, X_{n-1}) : Ω → (Fin n → α).
Instances For
Used by
InformationTheory.Shannon.StationaryProcess.measurable_blockRV
sourceThe block random variable is measurable.
Used by
InformationTheory.Shannon.ErgodicProcess
sourceAn ergodic stationary process: a StationaryProcess whose shift is moreover
ergodic. The toStationaryProcess coercion is auto-generated by extends.
Tis ergodic forμ.