MAT330/681 LECTURE 25 (5/4/2022): CODING AND SHANNON ENTROPY





Announcements: Please remember that the last homework assignment, HW12, is due tonight via Blackboard; solutions will be posted shortly. As per the day-by-day schedule, next class will be remote asynchronous, and then the following (and last) 2 lectures of the semester will be in-person review sessions, during which we will solve a list of review problems that will be posted on the website shortly.


• Video 1: How to quantify "surprise": Download file or watch below


• Video 2: Definition of Shannon entropy: Download file or watch below


• Video 3: Encoding information efficiently and unambiguously: Download file or watch below


• Video 4: Working towards some answers: Download file or watch below


• Video 5: Shannon's noiseless Coding Theorem: Download file or watch below





• Lecture Notes (static file from above videos): PDF file





Last updated: May 4, 2022, 2:00pm EST