Claude Shannon, the father of information theory, used to play an interesting game at cocktail parties. He'd grab a book, open it to a random page, and cover up all but the first letter on the page, then ask someone to guess the next letter. If the person couldn't guess, he'd uncover the letter, then ask the person to guess the next letter. (Suppose the first two letters are 'th'. A reasonable gue
![Information Theory in Three Minutes](https://cdn-ak-scissors.b.st-hatena.com/image/square/322165d098bfd123e474e069dbd1c6f6e9d5b363/height=288;version=1;width=512/https%3A%2F%2F4.bp.blogspot.com%2F-iEQwIr0YbO8%2FUZemgsX5NrI%2FAAAAAAAABqY%2FBqgFk0JMi9E%2Fw1200-h630-p-k-no-nu%2FClaude_Elwood_Shannon_%281916-2001%29.jpg)