SGLang

software

A fast serving framework for large language models and vision language models with efficient memory management.

Topics

ai serving llm inference

Casual references without a clear endorsement

Sebastian Raschka mentioned "even Transformers, the library, is not used in production. People use SGLang or vLLM, and it adds..." ▶ 2:01:07