But what is cross-entropy? | Compression is Intelligence Part 2
But what is cross-entropy? | Compression is Intelligence Part 2
The hidden math fueling AI models.
3Blue1Brown
Information theory
Measuring the entropy of English
Measuring the entropy of English
The hidden limit of our language.
3Blue1Brown
What's the perfect encoding? How do you know?
What's the perfect encoding? How do you know?
Master the logic of bit compression.
3Blue1Brown
Reinventing Entropy | Compression & Intelligence Part 1
Reinventing Entropy | Compression & Intelligence Part 1
Your AI is a text compressor.
3Blue1Brown
You are all caught up.