Posts tagged “inference”

• JoyAI-Video-Edit Hits 30 FPS. The Stream Still Runs on Five Clocks.

  JD’s open-weight JoyAI-Video-Edit reports 30 FPS on one B200. Here’s what latency, stream state, and single-session serving mean for builders.

• LG’s K-EXAONE 2.0 Makes Open Weights a Cluster Procurement Decision

  LG’s 750B K-EXAONE 2.0 is Apache 2.0, agent-ready, and built for eight H200s. Here is what its open-weight economics mean for builders.

• vLLM 0.26.0 Makes KV Tiering an Infrastructure Contract

  vLLM 0.26.0 matures KV tiering with storage identity, cache events, model-specific execution, API controls, and a wider security boundary.

• Thinking Machines Inkling: Open Weights Built to Be Fine-Tuned

  Inkling is a 975B open-weight multimodal model built for customization through Tinker—but self-hosting still demands institution-scale GPUs.

• OpenAI Jalapeño: Why Its First Inference Chip Is Bigger Than an Nvidia Alternative

  OpenAI Jalapeño is not just a custom AI chip. It is OpenAI’s move toward full-stack inference economics, agent latency, and compute control.

← Back to blog