QuantumLeap: 2.3× faster MoE inference with intelligent expert caching

 (github.com)

1 points | by ikharoz 4 hours ago

0 comments