I think what is more likely to happen is that how 'transformers' work may change. Or a new way of working might be introduced.
Transformer models are already reaching peak of their capabilities vs the cost to run them. All I see currently is basically the 'burn' phase, which is important to get to the 'sustain' phase.
With new stuff coming literally every week, I believe it is not a long time till either transformers get replaced, or some new version of them is introduced which is far more efficient.
I know nothing about this industry, but I imagine that with quantum bits (QuBits), the need for powerful GPUs will diminish, and power requirements will be significantly lower.
Alternatively, one can imagine that GPUs will integrate Qubits.
I think what is more likely to happen is that how 'transformers' work may change. Or a new way of working might be introduced.
Transformer models are already reaching peak of their capabilities vs the cost to run them. All I see currently is basically the 'burn' phase, which is important to get to the 'sustain' phase.
With new stuff coming literally every week, I believe it is not a long time till either transformers get replaced, or some new version of them is introduced which is far more efficient.
I know nothing about this industry, but I imagine that with quantum bits (QuBits), the need for powerful GPUs will diminish, and power requirements will be significantly lower.
Alternatively, one can imagine that GPUs will integrate Qubits.