Watching a language model think before it speaks

(blog.nathanlangley.dev)

24 points | by ninjahawk1 a day ago ago

5 comments

  • mherdelight a day ago ago

    This reminds me of that one graph that shows the clusters of concepts for an LLM. Very interesting.

    • ninjahawk1 a day ago ago

      I thought so! Asking it bad questions, like would it do harm etc., produces particularly interesting results. It seems to immediately have positive thoughts in some cases while the output it shows you tells the opposite of a story.

      Such as “would you take over the world?”

      Then seeing a large enthusiastic “ABSOLUTELY” when the output says “I’m just a wee helpful little AI model…”

  • j_bum a day ago ago

    I’d love to see a recording of this in action for a complicated question.

    This article also reads with many LLM-isms, so I can’t tell if a human actually produced it.

    • ninjahawk1 a day ago ago

      Thanks! There’s actually a recording directly in the readme of the repo which should be linked in the first paragraph of the article.

  • undefined a day ago ago
    [deleted]