Shannon Got AI This Far. Kolmogorov Shows Where It Stops

(medium.com)

12 points | by tosh 4 days ago ago

4 comments

  • stanfordkid 3 days ago ago

    I'm not sure I totally buy the "no plasticity" argument. If you are allowed to write to context in an agentic fashion, certainly the LLM can record intermediate answers, go back and re-rank it's memory. The "plasticity" is in the form of data that can be looked up and referenced as a shortcut. I would think this forms a Turing complete system so theoretically it can represent pretty much anything.

    • vrighter 3 days ago ago

      no that's not the same thing. plasticity means it starts giving a different output for the same input, because the "logic" changed.

      What you're describing is simply changing the input.

  • peddling-brink 4 days ago ago

    I’m interested in the subject, but it’s clear that an LLM did most of the writing, and I don’t know enough of the subject to tell if this is nonsense.

  • xyzsparetimexyz 4 days ago ago

    Interesting