attention

SGLang is a high-performance serving framework for large language models and multimodal models.

Build your own high performance LLM inference engine in C++ and CUDA - a smaller version of vLLM