General Information Edit

Fundamental limits and practical algorithms for data compression. Entropy and other information measures. Variable and fixed-length lossless and lossy source codes. Universal compression. Single-source and network configurations. Applications to text and multimedia compression.

Prerequisites Edit

ECE 4110

Topics Covered Edit

1. Information measures: entropy, mutual information, relative entropy, and their properties.

2. Optimal lossless compression and the entropy limit

3. Universal compression of sources with memory

4. Algorithms for universal compression: arithmetic coding and Lempel-Ziv algorithms

5. Rate-distortion theory: the rate-distortion function; Gaussian sources and reverse waterpouring

6. Practical compression of multimedia sources: entropy- and trellis-coded quantization, transform and subband coding

7. Multimedia compression standards: MPEG, AAC, etc.

8. Network extensions: Slepian-Wolf, Wyner-Ziv.

Workload Edit

Moderate (Sp 18)

  • 7 Problem Sets - biweekly
  • Exams - 1 final exam
  • Projects: 1 lossless compression programming (Python) project, 1 open-ended final research project

Related Courses Edit

  • ECE 5630 - Fundamentals of Information Transmssion

Past Offerings Edit




Median Grade

Fall 2018

MW 8:40-9:55

Aaron Wagner