The Decoherence Trap

(maevyn.codes)

4 points | by eikenberry 12 hours ago ago

2 comments

  • PaulHoule 12 hours ago ago

    It's a hypothesis, it might be true, but I don't see the evidence to prove it.

    • pzuraq 12 hours ago ago

      That's also true of the predictions of superintelligence, and the models behind them. The core of the essay is actually just extending the data bottlenecks argument that the rationalists have already conceded, to software and math: https://www.lesswrong.com/posts/icykbWYmdLFYxgvqY/data-bottl...

      The logic behind the intelligence explosions models is also not based on evidence, so extending and demonstrating flaws in that logic does not require evidence.