2024-2025 Graduate and Professional Program Catalog 
    
    Jun 27, 2025  
2024-2025 Graduate and Professional Program Catalog [ARCHIVED CATALOG]

Add to Portfolio (opens a new window)

ENEM 743 Information Theory

Credit 3
Introduction to information theory. Information measures: entropy, mutual information, relative entropy and differential entropy. These topics are connected to practical problems in communications, compression, and inference, including lossless data compression, Huffman coding, asymptotic equipartition property, channel capacity, Gaussian channels, rate distortion theory, and Fisher information.  



Add to Portfolio (opens a new window)