Just launched! Get 30% off Rails Revisited Have a Look

Encoding and Lossless Compression

Buy or Subscribe

You can access this course in just a minute, and support my efforts to rid the world of crappy online courses!

Buy Standalone  Subscribe

We're getting deep into the theory now, aren't we! Al this talk about entropy and surprise... what good does it actually do us! Turns out - a lot!

Claude Shannon (yes, him again!) recognized the connection between entropy, surprise, redundancy (extra useless information) and efficiency. In this video we get into the math to show how you can restructure your message encoding using simple math and a very clever probability equation to perform lossless compression - that means stripping out needless 1s and 0s without losing any part of your message.