research
lab notebook. running notes and results from my interpretability research.
-
What a Size Ladder Can Identify
why the scaling exponents optimizer benchmarks fit measure the experimental design, not the optimizer
-
Reconstructing ROME
how we converged on ROME, from a new direction
-
Playing with VPD
what I discovered when playing with VPD
-
Engineering Notebook Entry
I reinvented ROME & pivot
-
Engineering Notebook Entry
working with a toy model
-
Engineering Notebook Entry
exploring new techniques