Beyond Floating Point: Next-Generation Computer Arithmetic

(web.stanford.edu)

16 points | by Bluestein 8 hours ago ago

5 comments

  • Panzerschrek an hour ago ago

    For any bit width, they have a larger dynamic range, higher accuracy

    Isn't it a contradiction? One can't increase range without sacrificing accuracy.

  • 0xcoffee 5 hours ago ago

    Somewhat related, Anger Fog has a document about improving the IEEE 754 standard: https://www.agner.org/optimize/nan_propagation.pdf

  • AlotOfReading 4 hours ago ago

    Gustafson's arguments haven't held up well to further development, in my opinion. As originally designed they aren't faster, they don't "solve" numerical analysis, and a lot of the issues people have with floats don't go away.

    They get a few things right like eliminating NaNs, but the reality is just so underwhelming compared to Gustafson's grandiose claims.

    • nextaccountic 2 hours ago ago

      > further development,

      Can you cite them?

      • AlotOfReading 23 minutes ago ago

        Sure, here's a review article from last year [0]

            Regarding delay, area, and power, under the same precision the posit arithmetic units are not competitive against their floating-point counterparts.
        
        That paper was followed by a paper [1] published this year finally showing a posit variant implementation somewhat competitive with a mediocre float implementation, hurray. In order to achieve that, it had to give up most of the properties that Gustafson liked about posits and it only maintains a better precision than floats up to 2^10, at the cost of absolute relative precision.

        We even have systems that improve upon posits at the things they're good for, like takums [2]. And just for fun, a couple of papers comparing floats and posits:

            On the other hand, 32-bit posit are not exhibiting spectacular improvements in terms of efficiency over FP32. While they achieve the same or higher accuracy and can speedup the execution when the program has multiplications and divisions, they need around 30% more FPGA resources and use 6% more power compared to FP32. [3]
        
            The results confirm posit arithmetic’s strong performance at low precision, with takum following closely behind. Posits show stability issues at higher precisions, while OFP8 formats are unsuitable and bfloat16 underperforms compared to float16 and takum. [4]
        
        [0] https://dl.acm.org/doi/pdf/10.1145/3772284

        [1] https://arxiv.org/pdf/2603.01615

        [2] https://arxiv.org/pdf/2404.18603

        [3] https://arxiv.org/pdf/2109.08225

        [4] https://arxiv.org/pdf/2504.21197