Sunday, June 28, 2026

I am currently fascinated by Shannon's information theory and how it gave us the loss function. I have also been learning the Bayes' theorem and the breakdown of posterior, likelihood and prior is making sense finally thanks to repeated query to LLM. I have a write up in progress. I am now at a stage to learn more about KL divergence and how it is used in RLHF #blogs #statistics #information-theory

• #blogs
• #information-theory
• #statistics