How Is Compression Prediction?
SMRTR summary
The popular claim that "compression is prediction" is mathematically true, but only under specific conditions. When an encoder and decoder share an agreed model, a probability assigned to each symbol directly determines its ideal code length, making log-loss and compression the same optimization problem. However, this equivalence only applies after key decisions are already made, including what objects are being represented, what information is shared, and what operations the decoder must perform.
SMRTR provides this summary for quick context. The original article belongs to Lobsters.
Read the original article