25 points | by guanming0717 2 days ago ago
4 comments
Really impressive speedups. Curious how much of the gain comes from the runtime optimizations vs the few-step distillation in real-world robotics workloads.
Runtime optimizations alone provide a 2–7× speedup with bitwise-exact outputs. SFew-step distillation provides another 4–5× speedup
ayy cool! i spoke to you at yc sus this year :)
ayyy was great to meet you :)
Really impressive speedups. Curious how much of the gain comes from the runtime optimizations vs the few-step distillation in real-world robotics workloads.
Runtime optimizations alone provide a 2–7× speedup with bitwise-exact outputs. SFew-step distillation provides another 4–5× speedup
ayy cool! i spoke to you at yc sus this year :)
ayyy was great to meet you :)