Information Theory

Catalog description

An overview of Shannon's theory of information, which establishes fundamental limits on the performance of data compression and quantization algorithms, communication systems, and detection and estimation algorithms. Topics include information measures and their properties, information source models, lossless data compression, channel coding and capacity, information theory and statistics, and rate-distortion theory. Applications of information theory will also be discussed, including Lempel-Ziv data compression, vector quantization, error-correcting codes, satellite communications and high-speed modems.