Information Theory
Download as PDF
Overview
Subject area
ELE
Catalog Number
652
Course Title
Information Theory
Department(s)
Description
Information measures, Law of large numbers and the asymptotic equipartition property. Lossless data compression: Huffman codes, Krafts inequality, bounds on optimal code length. Channel capacity: joint typicality, channel coding theorem, Fano’s inequality and the converse to the channel coding theorem. Differential entropy. Gaussian channels. Introduction to rate distortion theory.
Typically Offered
Fall, Spring
Academic Career
Graduate
Liberal Arts
No
Credits
Minimum Units
3
Maximum Units
3
Academic Progress Units
3
Repeat For Credit
No
Components
Name
Lecture
Hours
3
Requisites
030163