File Download
Supplementary

postgraduate thesis: Some results for special families of channels with memory

TitleSome results for special families of channels with memory
Authors
Issue Date2015
PublisherThe University of Hong Kong (Pokfulam, Hong Kong)
Citation
Li, Y. [李永龙]. (2015). Some results for special families of channels with memory. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. Retrieved from http://dx.doi.org/10.5353/th_b5699932
AbstractThe main concerns of this thesis are some special families of channels with memory, which are of great importance both in theory and in practical applications. Unlike discrete memoryless channels, the capacity of channels with memory generally admits no single-letter characterization and it is difficult to numerically evaluate the channel capacity. As prominent examples of channels with memory, finite-state channels have attracted much interest. However, the numerical computation of the channel capacity of a finite-state channel is still an open problem. Recently, two algorithms have been proposed to numerically compute the channel capacity for a special family of finite-state channels with Markovian inputs. One sufficient condition for the convergence of the proposed algorithms is the concavity of mutual information rate with respect to some chosen parameters of the input Markov chains. In this thesis, under mild positivity conditions, concavity is proved at the high signal-to-noise ratio and counterexamples are given to show that concavity may fail in general. The input-constrained discrete erasure channels are examples of channels with memory and the channel capacity is unknown and has been a long-standing open problem in information theory. In this thesis, an \explicit" formula of the mutual information rate for a discrete erasure channel with a Markovian input is derived. Moreover, if the input Markov chain is of first-order and supported on the (1; ∞)- run length limited constraint, the mutual information rate is shown to be strictly concave with respect to the transition probability of the input Markov chain. By comparing the asymptotics in the high SNR regime, feedback capacity is shown to be strictly larger than the non-feedback capacity, which disproves a statement of Shannon. The other example of channels with memory is the recently proposed ash memory channel model, which possesses both input and output memory. In this thesis, the ash memory channels are shown to be indecomposable under rather weak conditions. Then the channel capacity is shown to be achievable by a stationary process and consequently, as its order tends to infinity, the Markov capacity converges to the real channel capacity. This result suggests that it is highly possible to apply the ideas and techniques in the computation of the capacity of finite-state channels, which are relatively better explored, to that of the capacity of ash memory channels.
DegreeDoctor of Philosophy
SubjectDigital communications - Mathematics
Dept/ProgramMathematics
Persistent Identifierhttp://hdl.handle.net/10722/223041

 

DC FieldValueLanguage
dc.contributor.authorLi, Yonglong-
dc.contributor.author李永龙-
dc.date.accessioned2016-02-17T23:14:38Z-
dc.date.available2016-02-17T23:14:38Z-
dc.date.issued2015-
dc.identifier.citationLi, Y. [李永龙]. (2015). Some results for special families of channels with memory. (Thesis). University of Hong Kong, Pokfulam, Hong Kong SAR. Retrieved from http://dx.doi.org/10.5353/th_b5699932-
dc.identifier.urihttp://hdl.handle.net/10722/223041-
dc.description.abstractThe main concerns of this thesis are some special families of channels with memory, which are of great importance both in theory and in practical applications. Unlike discrete memoryless channels, the capacity of channels with memory generally admits no single-letter characterization and it is difficult to numerically evaluate the channel capacity. As prominent examples of channels with memory, finite-state channels have attracted much interest. However, the numerical computation of the channel capacity of a finite-state channel is still an open problem. Recently, two algorithms have been proposed to numerically compute the channel capacity for a special family of finite-state channels with Markovian inputs. One sufficient condition for the convergence of the proposed algorithms is the concavity of mutual information rate with respect to some chosen parameters of the input Markov chains. In this thesis, under mild positivity conditions, concavity is proved at the high signal-to-noise ratio and counterexamples are given to show that concavity may fail in general. The input-constrained discrete erasure channels are examples of channels with memory and the channel capacity is unknown and has been a long-standing open problem in information theory. In this thesis, an \explicit" formula of the mutual information rate for a discrete erasure channel with a Markovian input is derived. Moreover, if the input Markov chain is of first-order and supported on the (1; ∞)- run length limited constraint, the mutual information rate is shown to be strictly concave with respect to the transition probability of the input Markov chain. By comparing the asymptotics in the high SNR regime, feedback capacity is shown to be strictly larger than the non-feedback capacity, which disproves a statement of Shannon. The other example of channels with memory is the recently proposed ash memory channel model, which possesses both input and output memory. In this thesis, the ash memory channels are shown to be indecomposable under rather weak conditions. Then the channel capacity is shown to be achievable by a stationary process and consequently, as its order tends to infinity, the Markov capacity converges to the real channel capacity. This result suggests that it is highly possible to apply the ideas and techniques in the computation of the capacity of finite-state channels, which are relatively better explored, to that of the capacity of ash memory channels.-
dc.languageeng-
dc.publisherThe University of Hong Kong (Pokfulam, Hong Kong)-
dc.relation.ispartofHKU Theses Online (HKUTO)-
dc.rightsThe author retains all proprietary rights, (such as patent rights) and the right to use in future works.-
dc.rightsCreative Commons: Attribution 3.0 Hong Kong License-
dc.subject.lcshDigital communications - Mathematics-
dc.titleSome results for special families of channels with memory-
dc.typePG_Thesis-
dc.identifier.hkulb5699932-
dc.description.thesisnameDoctor of Philosophy-
dc.description.thesislevelDoctoral-
dc.description.thesisdisciplineMathematics-
dc.description.naturepublished_or_final_version-

Export via OAI-PMH Interface in XML Formats


OR


Export to Other Non-XML Formats