Twitch Plays: Interpretability of Bonsai-8B

(lesswrong.com)

1 points | by mordymoop 10 hours ago ago

1 comments

  • mordymoop 10 hours ago ago

    Let's Play Interpretability is a Twitch livestream where you can help Claude semi-autonomously interpret the neurons, connections and circuits in the Bonsai-8B LLM.

    Your help comes in at various stages in the interpretation pipeline. The audience and the agent collaborate to:

    Pick the neuron to work on Suggest sentences on which to test activations Explicitly test various hypotheses, and attempt to falsify them Branch out to nearby (upstream and downstream) neurons whose ablation most impacts the activation, to better solidify the interpretation ... and more.