Posts tagged “cuda”

• llama.cpp b11405: CUDA Lightning-Indexer Upgrade Guide

  Test CUDA prefill gains on Qwen4Exp-style four-head lightning-indexer workloads, with depth-aware benchmarks and a check for missing baseline cases.

• llama.cpp b11402: How to Evaluate Long-Context Prefill on DGX Spark

  A DGX Spark test plan for llama.cpp b11402: check FlashAttention eligibility, compare microbatches and validate real-server latency before upgrading.

• llama.cpp b11390: CUDA MoE Memory-Fault Fix and Upgrade Guide

  llama.cpp b11390 corrects CUDA MoE buffer padding. Identify relevant deployments, pin the fix and validate real workloads without assuming a speedup.

← Back to blog