Posts tagged “llama-cpp”

• llama.cpp b11390: CUDA MoE Memory-Fault Fix and Upgrade Guide

  llama.cpp b11390 corrects CUDA MoE buffer padding. Identify relevant deployments, pin the fix and validate real workloads without assuming a speedup.

• llama.cpp b11387: N-Gram Speculative Decoding Upgrade Guide

  Check whether llama.cpp’s n-gram regression affects your deployment, what b11387 fixes, and how to validate acceptance and latency before upgrading.

• llama.cpp OpenVINO 2026.4.1 Update: Intel MoE Upgrade Guide

  What llama.cpp b11374 changes for Intel OpenVINO users, how to interpret the Gemma MoE benchmark, and what to validate before a production upgrade.

• llama.cpp /v1/systemone: Running Typed Decision Models Locally

  Serve local routing and classification models with llama.cpp’s new endpoint, choose a checkpoint, and check compatibility before replacing a hosted API.

← Back to blog