2 paragraphs
Sunday, June 28, 2026
I am currently fascinated by Shannon's information theory and how it gave us the loss function. I have also been learning the Bayes' theorem and the breakdown of posterior, likelihood and prior is making sense finally thanks to repeated query to LLM. I have a write up in progress. I am now at a stage to learn more about KL divergence and how it is used in RLHF #blogs #statistics #information-theory
Sunday, June 7, 2026
#diary Setting up diary in production. A big red flag in how secrets are setup in kamaji, not in terms of security but ease of making changes. A few duplicate sources of secrets need to be cleaned up. I setup the #blogs project to hold the diary schema and migrations. The docker compose not spins up the postgres and blogs repo to store and setup the diary entries.