George Mason University
George Mason University Mason
George Mason University

ECE 751: Information Theory

Instructor Information

Section Information

Introduces information theory, which is mathematical theory of communication systems. Topics include measures of information such as entropy, relative entropy, and mutual information; Shannon-McMillan-Breiman theorem and applications to data compression; entropy rate and source coding theorem; Huffman, arithmetic and Lempel-Ziv codes; method of types, channel capacity, and channel-coding theorem; joint source-channel coding theorem; differential entropy; Gaussian channel; rate distortion theory; and vector quantization.

Course Information from University Catalog

Credits: 3

Prerequisites:

Instructor Information
Expertise