Benchmarks Are Dead (For Us)

(poetiq.ai)

10 points | by oliversisson 16 hours ago ago

1 comments

  • oliversisson 16 hours ago ago

    Poetiq's RSI loop now automatically builds its own benchmark harnesses with zero human intervention — and has hit SOTA on six diverse benchmarks including doubling the previous best on a long-horizon planning task, and a 2M-token retrieval benchmark using a model that doesn't even appear on the base leaderboard.