18-753: Information Theory and Coding

Units: 12

The first half of the course comprises of the concepts of entropy, mutual information, the Asymptotic Equipartition property, applications to source coding (data compression), applications to channel capacity (channel coding), differential entropy and its application to waveform channel capacities, and a subset of advanced topics such as network information theory, or rate-distortion theory, as time permits. The second half of the course comprises finite-field algebra, Hamming codes, cyclic codes (CRC and BCH codes), a brief introduction to Reed-Solomon codes, and perhaps universal codes (Lempel-Ziv coding).

Prerequisites: 36-217 and senior or graduate standing.


Areas:

Signals and Systems, Signal Processing and Communications

Last modified on 2006-03-27

Past semesters:

S14, S12, S10, S08, S06, S05, S04, S03, F02, F01