<- Back
Comments (12)
- _jayhack_Shocking to me how little interest the general public has in mechinterp given the alien capabilities demonstrated by LLMs - this and the subsequent transformer-circuits.pub publications will be seen as classic, foundational work in a few years
- myself248Nothing about B-H curves or magnetization current, must be that other kind of transformer, in that other kind of circuit.
- amelius> A previous project, the Distill Circuits thread, has attempted to reverse engineer vision models, but so far there hasn’t been a comparable project for transformers or language models.How successful was that?
- oofbeyI’ve tried reading this many times. But it’s sooooo long. Is it worth it?