References
T.M. Cover and J.A. Thomas, “Elements of Information Theory,” John Wiley & Sons, Inc., New York.
Topics from Cover and Thomas, 2nd edition:
| Chapter | Suggested Reading | Example Problem |
| 2 | 2.1 - 2.8 | 2.14 |
| 3 | 3.1 - 3.2 | 3.2 |
| 4 | 4.1 - 4.2 | 4.13 |
| 5 | 5.1 - 5.9 | 5.30 |
| 8 | 8.1 - 8.6 | 8.9 |
| 12 | 12.1 - 12.2 | |
| 13 | 13.3 |
W.B. Kleijn, “A Basis for Source Coding,” KTH Stockholm.
D.S. Taubman and M.W. Marcellin, “JPEG2000 Image Compression Fundamentals, Standards and Practice,” KluwerAcademic Publishers, Boston, 2004.
R.M. Gray, "Toeplitz and Circulant Matrices: A review," Stanford University, 2009. Available online:
Toeplitz and Circulant Matrices: A review Links to an external site.
G. Chechik, A. Globerson, N. Tishby, Y. Weiss, Information Bottleneck for Gaussian Variables, Journal of Machine Learning Research, no. 6, 2005.
Additional reading:
Y. Polyanskiy Links to an external site. and Y. Wu, Information Theory: From Coding to Learning, Cambridge University Press, 2025. https://doi.org/10.1017/9781108966351 Links to an external site.
For the exam preparation, the final exam from the previous year will be published here.