Principle of Information Theory and Coding

Catalog description

Communication and information play a major role in modern day to day life. This course offers an introduction to the intriguing fields of Information and Coding Theory, providing the mathematical foundation for the study of communication. It explores the concept of “information” and “communication” through the lens of probability theory. Key topics include the notions of entropy and mutual information; communication in the presence of errors and methods for error correction; data compression; differential entropy; and rate-distortion theory. The analytical tools acquired in this course have broad applications across various scientific disciplines, including Electrical Engineering, Mathematics, Computer Science, Physics, Biology, Chemistry, Economics, Machine Learning, Artificial Intelligence, Data Analysis, and more.