Tags · #inference

Cerebras hikes IPO range to $125–$135 as orders hit ~$10B against $3.5B on offer

Cerebras hikes IPO range to $125–$135 as orders hit ~$10B vs $3.5B on offer. Implied valuation comfortably above $26.6B; CBRS prices May 13.

08 MAY 3 MIN READ Practitioner note cerebras ipo ai-hardware inference

DeepSeek V4, Kimi K2.6, GLM-5.1, MiniMax M2.7: frontier-tier coding at 5–25× lower cost

Four Chinese labs shipped frontier coding models in 12 days. GLM-5.1 MIT license ties Kimi K2.6 on SWE-Bench Pro at 58.4%. Cost gap is 5–25× vs Western APIs.

07 MAY 3 MIN READ Practitioner note open-weights deepseek llm coding-models

Cloudflare Infire — disaggregated LLM inference beats vLLM by 20%, Unweight cuts model size 22%

Cloudflare Infire (Rust) uses disaggregated prefill/decode to beat vLLM 0.10 by 20% on H100s. Unweight achieves 15–22% lossless model weight compression.

04 MAY 3 MIN READ Practitioner note inference open-source nvidia release

vLLM v0.20.0 ships DeepSeek V4 + PyTorch 2.11 + FlashAttention 4

vLLM v0.20.0: 752 commits, 320 contributors. CUDA 13, PyTorch 2.11, Transformers v5, Python 3.14, FlashAttention 4 default, 2-bit KV cache.

27 APR 3 MIN READ Practitioner note vllm inference open-source release