Posts tagged “speculative-decoding”

• llama.cpp b11404: How to Test Metal Speculative-Decoding Gains

  Test llama.cpp b11404 on Apple Silicon: Metal kernel eligibility, reported DFlash2 gains, and a four-run comparison of serial and speculative decoding.

• llama.cpp b11387: N-Gram Speculative Decoding Upgrade Guide

  Check whether llama.cpp’s n-gram regression affects your deployment, what b11387 fixes, and how to validate acceptance and latency before upgrading.

← Back to blog