Introduction to Information theory, Coding, Mutual Information; Properties of mutual information; typical sequences;Entropy and stochastic processes; Noisy channels; Channel capacity;Rate distortion theory; Large deviations and the method of types;Information theory and statistical physics.
