LLM inference
1 RohitAI article on LLM inference: news, explainers and practical guides, newest first.
llama.cpp b11402: How to Evaluate Long-Context Prefill on DGX Spark
A DGX Spark test plan for llama.cpp b11402: check FlashAttention eligibility, compare microbatches and validate real-server latency before upgrading.