sgl-project/sglang-omni
High Performance Serving Runtime For Interactive Super Intelligence System
- Stars1754
- LanguagePython
- LicenseApache-2.0
High Performance Serving Runtime For Interactive Super Intelligence System
High Performance Serving Runtime For Interactive Super Intelligence System
SGLang-Omni is a multi-stage serving runtime for omni, speech, and TTS models. Its design target is multi-stage decoding: generation split across heterogeneous stages with different compute patterns, dependency structures, and resource needs. SGLang-Omni owns the pipeline topology, stage lifecycle, inter-stage transport, model-family integration layer, and OpenAI-compatible serving surface, while composing with…
Additional model guides, including experimental and research-oriented paths, are available in the Cookbook.
Description and README excerpt from sgl-project/sglang-omni on GitHub ↗.
sgl-project/sglang-omni was first seen on GitHub · Trending Python today on Nov 11, 2026. Since then it has appeared in 8 checks on 2 different days. Its best position was #5 of 17, reached on Nov 11, 11:25 UTC. It dropped off the list after Nov 12, 08:25 UTC.
Position on GitHub · Trending Python today at every check (lower is better).
Best rank per day (UTC).
Platform metric as reported by GitHub.
Archived daily, weekly and monthly lists that include this entry.
Not at the moment. It was last on the list on Nov 12, 08:25 UTC, after 2 days of trending.
#5 on GitHub · Trending Python today, on Nov 11, 11:25 UTC. Trendoday checks this list every 180 minutes.
It was first seen on Nov 11, 2026 and has been on the list on 2 days (8 checks) since.
Mostly Python; it is licensed under Apache-2.0. It has 1754 stars and 719 forks.