Thread

I heard a lecture based on Cover & Thomas's Information Theory book and it was some of the most interesting lectures I heard. So many surprising insights! Proofs by random codes for example. twitter.com/serene99/statu…

IIRC, it went like this: They claim asymptotically that you can transmit a certain bit rate over a noisy/power restricted/etc. channel. Proof: let's sample points at random and use these as code words. Law of large numbers shows this achieves the bit rate 🤯