J
Joe Fioti
4 things Joe uses or recommends, from 1 episode.
All 4 of Joe's picks
- PyTorch Uses it "We use a lot of tools that PyTorch provides where they're really nice about tagging the high level ops, and then we kind of track that metadata as it flows through our compiler. We use a lot of the standard PyTorch profiler to go and work out bottlenecks and issues." Only Joe
- SGLang Uses it "Then we live inside of the great inference engines of vLLM and SGLang. And so, the great solutions they already provide for speculative decoding, we're able to just go and directly piggyback on them." Only Joe
- egglog Uses it "Specifically, how we use the egglog engine, which powers our equality saturation." Only Joe
- vLLM Uses it "Then we live inside of the great inference engines of vLLM and SGLang. And so, the great solutions they already provide for speculative decoding, we're able to just go and directly piggyback on them." Only Joe