Information Theory

Catalog description

How to measure, represent, and communicate information effectively. Why bits have become the universal currency for information exchange. How information theory bears on the design and operation of modern-day communication systems. The role of entropy and mutual information in data compression, communication, and inference. Practical compressors, error detecting codes, and error correcting codes. The information theoretic way of thinking. Relations and applications to machine learning, biological and artificial neural networks, genomics, quantum information, and blockchains. Prerequisites: Computer and Information Science 2210 and 3130 and an undergraduate class in probability or statistics.