more likely there's some pressure on GPU vs CPU compute resources while the AI company tries to scale out a new model, leading to some type of degradation.
Was hoping to understand if anyone has done any research on it. I could only really find one research paper on the topic [1], but it seems less focused on this specific issue.
I figure it's because limited compute, must redirect some for latest product
Reminds me of a similar effect around iPhone releases (https://www.statista.com/chart/2514/iphone-releases/, many others). Can’t say I’ve noticed any change.
more likely there's some pressure on GPU vs CPU compute resources while the AI company tries to scale out a new model, leading to some type of degradation.
Assuming it's not apple like fraud.
yes, when they come with 5.5
5.3 becomes 5.4
and optimization and improvement to 5.4 are provided as new 5.5
this gives boost effect via anchor/decoy.
Yes, this is already a widely circulated unproven LLM conspiracy theory.
Was hoping to understand if anyone has done any research on it. I could only really find one research paper on the topic [1], but it seems less focused on this specific issue.
[1] https://arxiv.org/abs/2307.09009
tbh doesn't it depend on the service provider entirely, its their choice if they want to make it dumber or not
open source models winning is the only deliberate solution to this