2023-2024 Graduate and Professional Program Catalog 
    
    Jun 28, 2025  
2023-2024 Graduate and Professional Program Catalog [ARCHIVED CATALOG]

Add to Portfolio (opens a new window)

ENEM 743 Information Theory

Credit 3
Introduction to information theory. Information measures: entropy, mutual information, relative entropy and differential entropy. These topics are connected to practical problems in communications, compression, and inference, including lossless data compression, Huffman coding, asymptotic equipartition property, channel capacity, Gaussian channels, rate distortion theory, and Fisher information.  



Add to Portfolio (opens a new window)