Posts tagged “sglang”
SGLang 0.5.17 Gives Agent Sessions a Vote in GPU Memory
SGLang 0.5.17 adds session-aware KV caching, faster recovery, Rust ingress, and frontier-model paths—shifting serving toward agent runtime policy.
SGLang 0.5.17 adds session-aware KV caching, faster recovery, Rust ingress, and frontier-model paths—shifting serving toward agent runtime policy.