See [here](https://transformer-circuits.pub/2023/monosemantic-features#:~:text=Specific%20metrics%20from,is%20too%20low.) To do: - [ ] Consider the best way to calculate these - [ ] Log these to wandb (either via wandb histogram or plotly) - [ ] Also log number of dead features There's a few technical details here that could matter but any solution here would be a good start.
See here
To do:
There's a few technical details here that could matter but any solution here would be a good start.