Tech things that interest me. I founded QuantCDN.

Writing

• 01 Sept 2026
  One guard, 110× off the verify step. Speculative decoding on MLA models in MLX.Every MLA model in mlx-lm only used its fast attention path when there was exactly one query, which made speculative decoding slower than not speculating. Here is what the fix is and what it measured at.