A connection between good rate-distortion codes and backward DMCs

Curt Schieler, Paul Cuff

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

Let Xn Xn be a sequence drawn from a discrete memoryless source, and let Yn yn be the corresponding reconstruction sequence that is output by a good rate-distortion code. This paper establishes a property of the joint distribution of (Xn, Y n). It is shown that for D > 0, the input-output statistics of a R(D)-achieving rate-distortion code converge (in normalized relative entropy) to the output-input statistics of a discrete memoryless channel (dmc). The dmc is 'backward' in that it is a channel from the reconstruction space yn to source space Xn. It is also shown that the property does not necessarily hold when normalized relative entropy is replaced by variational distance.

Original languageEnglish (US)
Title of host publication2013 IEEE Information Theory Workshop, ITW 2013
DOIs
StatePublished - Dec 1 2013
Event2013 IEEE Information Theory Workshop, ITW 2013 - Seville, Spain
Duration: Sep 9 2013Sep 13 2013

Publication series

Name2013 IEEE Information Theory Workshop, ITW 2013

Other

Other2013 IEEE Information Theory Workshop, ITW 2013
CountrySpain
CitySeville
Period9/9/139/13/13

All Science Journal Classification (ASJC) codes

  • Information Systems

Fingerprint Dive into the research topics of 'A connection between good rate-distortion codes and backward DMCs'. Together they form a unique fingerprint.

  • Cite this

    Schieler, C., & Cuff, P. (2013). A connection between good rate-distortion codes and backward DMCs. In 2013 IEEE Information Theory Workshop, ITW 2013 [6691321] (2013 IEEE Information Theory Workshop, ITW 2013). https://doi.org/10.1109/ITW.2013.6691321