CMSI 6280 Information Theory

4 semester hours

Introduction to the concepts of information measures, data compression, and channel capacity. Applications of Shannon theory to evaluate the effectiveness of practical communication links. Error correction coding and its application in reliable communications. Entropy, relative entropy, asymptotic equipartition, entropy of stochastic processes, and differential entropy.