in progress
Bits and Surprise — The Two Faces of Entropy
Same equation. Two perspectives.
· Information Theory· Bayesian Inference· Kaggle
Projects
Repos and experiments worth pointing at. Some are research artifacts from work, others are side projects I picked up to understand something I couldn't crack just by reading.
Currently on the desk
research
Tackling the Reversal Curse in LLMs — Multi-View Training
A → B works. B → A doesn't. Until you train with multiple views.
· LLM Research· Pre-training· Reversal Curse