2025-2026 Graduate and Professional Program Catalog 
    
    Jun 07, 2025  
HELP
2025-2026 Graduate and Professional Program Catalog
Facebook this Page (opens a new window)
Tweet this Page (opens a new window)
Add to Portfolio (opens a new window)

ENEM 743 Information Theory

Credit 3
Introduction to information theory. Information measures: entropy, mutual information, relative entropy and differential entropy. These topics are connected to practical problems in communications, compression, and inference, including lossless data compression, Huffman coding, asymptotic equipartition property, channel capacity, Gaussian channels, rate distortion theory, and Fisher information.  


Facebook this Page (opens a new window)
Tweet this Page (opens a new window)
Add to Portfolio (opens a new window)
Catalog Navigation
  Catalog Home
  Officials
  Disclaimer
  The University, Campus, and Environment
  Graduate Studies General Information
  Admission to Graduate School
  Application Instructions
  Registration, Credits, and Grades
  Degree Requirements
  Selected Student Services Available to Graduate Students
  Graduate Research & Instruction Resources
  Graduate Degree Programs by School and Department
  Programs of Study
  Course Descriptions
  Graduate Teaching Faculty
  My Portfolio