Linear probes tell you where quantization will hurt
Probing where a capability lives in the residual stream predicts which layers survive low-bit quantization and which ones you can't touch.
LessWrong
Aniket Ghosh · Writing
EverythingIwrite,inoneplace.
Two things, mostly: what's actually going on inside neural networks, and whatever else I've been chewing on. It lands in a few different places. This page pulls it back together.