Posts tagged “sglang”

• SGLang 0.5.21: Prefill–Decode Role-Switch Acceptance Checklist

  An operator checklist for SGLang 0.5.21 role switching: qualify support, drain traffic, check graph headroom, verify execution and plan cache recovery.

• SGLang 0.5.17 Gives Agent Sessions a Vote in GPU Memory

  SGLang 0.5.17 adds session-aware KV caching, faster recovery, Rust ingress, and frontier-model paths—shifting serving toward agent runtime policy.

← Back to blog