SGLang is a fast serving framework for large language models and vision language models.
Materials for learning SGLang
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
SGLang is a fast serving framework for large language models and vision language models.
sgl-project/sglang’s past year of commit activityTrain speculative decoding models effortlessly and port them smoothly to SGLang serving.
sgl-project/SpecForge’s past year of commit activityOME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
sgl-project/ome’s past year of commit activityKernel Library Wheel for SGLang
sgl-project/whl’s past year of commit activity HTML 11 MIT 2 1 0 Updated Aug 15, 2025Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
sgl-project/genai-bench’s past year of commit activityLoading…
You can’t perform that action at this time.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4