Book contents
- Frontmatter
- Contents
- Preface
- Acknowledgments
- 1 Motivation
- 2 Book overview
- 3 Principles of lossless compression
- 4 Entropy coding techniques
- 5 Lossy compression of scalar sources
- 6 Coding of sources with memory
- 7 Mathematical transformations
- 8 Rate control in transform coding systems
- 9 Transform coding systems
- 10 Set partition coding
- 11 Subband/wavelet coding systems
- 12 Methods for lossless compression of images
- 13 Color and multi-component image and video coding
- 14 Distributed source coding
- Index
- References
14 - Distributed source coding
Published online by Cambridge University Press: 05 June 2012
- Frontmatter
- Contents
- Preface
- Acknowledgments
- 1 Motivation
- 2 Book overview
- 3 Principles of lossless compression
- 4 Entropy coding techniques
- 5 Lossy compression of scalar sources
- 6 Coding of sources with memory
- 7 Mathematical transformations
- 8 Rate control in transform coding systems
- 9 Transform coding systems
- 10 Set partition coding
- 11 Subband/wavelet coding systems
- 12 Methods for lossless compression of images
- 13 Color and multi-component image and video coding
- 14 Distributed source coding
- Index
- References
Summary
In this chapter, we introduce the concept that correlated sources need not be encoded jointly to achieve greater efficiency than encoding them independently. In fact, if they are encoded independently and decoded jointly, it is theoretically possible under certain conditions to achieve the same efficiency as when encoded jointly. Such a method for coding correlated sources is called distributed source coding (DSC). Figure 14.1 depicts the paradigm of DSC with independent encoding and joint decoding. In certain applications, such as sensor networks and mobile communications, circuit complexity and power drain are too burdensome to be tolerated at the transmission side. DSC shifts complexity and power consumption from the transmission side to the receiver side, where it can be more easily handled and tolerated. The content of this chapter presents the conditions under which DSC is ideally efficient and discusses some practical schemes that attempt to realize rate savings in the DSC paradigm. There has been a plethora of recent work on this subject, so an encyclopedic account is impractical and ill-advised in a textbook. The goal here is to explain the principles clearly and elucidate them with a few examples.
Slepian–Wolf coding for lossless compression
Consider two correlated, discrete scalar sources X and Y. Theoretically, these sources can be encoded independently without loss using H(X) and H(Y) bits, respectively, where H(X) and H(Y) are the entropies of these sources. However, if encoded jointly, both these sources can be reconstructed perfectly using only H(X, Y) bits, the joint entropy of these sources.
- Type
- Chapter
- Information
- Digital Signal CompressionPrinciples and Practice, pp. 398 - 413Publisher: Cambridge University PressPrint publication year: 2011