https://sudonull.com/turboquant-6x-compression-of-llm-kv-cache
Break down Google's TurboQuant: PolarQuant + QJL for 6x KV-cache compression without accuracy loss. Inference acceleration up to 8x. Benchmarks, principle of operation for LLM developers.