The Evaluation-Industrial Complex

(twitter.com)

1 points | by nlpnerd 7 hours ago ago

1 comments

  • nlpnerd 7 hours ago ago

    RLVR was a shortcut that has turned into a tarpit.

    Many knowledge work has subjective/contextual quality measures that are usually not self-verifiable or easily measured by a rubrics.

    This is why despite recent frontier models acing the most popular benchmarks out there, the real world performance still feels very inadequate.