Announcements


Course Description

Extreme points of communication theory: data compression to the entropy limit, and communication at the channel capacity limit. Shannon entropy. Rate distortion theory. Huffman coding. Kolmogorov complexity. Unified treatment based on the asymptotic equipartition theorem.

Lectures

380-380C, TTh 11-12:15pm, 3 Units.

The Course Outline shows what Professor Cover will cover in each lecture ths quarter.

Exams

Teaching Staff

Instructor:
Professor Thomas Cover
Office: Packard 254
Email: cover@stanford.edu
Phone: 650-723-4505
Teaching Assistants:
Office Hours:
  • Professor Thomas Cover
    Time: W 2-3 PM
    Place: Packard 254
    Generally available mid-afternoons.
  • William Wu
    Time: W 4-5 PM
    Place: Packard 277
    (If not there, check Packard 268.)
Administrative Associate:
Denise Murphy
Office: Packard 267
Tel: 650-723-4731
Fax: 650-724-6487
Email: denise@ee.stanford.edu

Textbook

elements of information theory cover

Elements of Information Theory by Cover and Thomas, 2nd Edition, New York: Wiley, 2006.

Prerequisites

You should have seen some probability at the level of EE 178 or STAT 116 or equivalent.