Information Theory. 3 credits

Catalog description

Information theory is the mathematical theory of communications. It was developed in 1948 by Claude E. Shannon. Information Theory sets bounds on achievable performance and communication rates of any communication system. The basic theory is summarized in a set of source and channel coding theorems, which are expressed in terms of information measures such as entropy, channel capacity and rate-distortion. In this course we introduce these fundamental concepts, we present and prove basic coding theorems, and provide some practical insight on implementation of these theorems. Non-ECE students are welcome. Offered by Electrical & Comp. Engineering . May not be repeated for credit.