Search Articles — Sudonull

Search Results

In this project

TurboQuant: 6x compression of LLM KV-cache

https://sudonull.com/turboquant-6x-compression-of-llm-kv-cache

Break down Google's TurboQuant: PolarQuant + QJL for 6x KV-cache compression without accuracy loss. Inference acceleration up to 8x. Benchmarks, principle of operation for LLM developers.

TurboQuant: 3-bit KV-cache for LLM without losses

https://sudonull.com/turboquant-3-bit-kv-cache-for-llm-without-losses

Learn how Google TurboQuant compresses key-value cache of LLM to 3 bits, speeding up inference 8x. Benchmarks on Gemma/Mistral, application in RAG. For developers.

TurboQuant: lossless KV-cache compression for AI

https://sudonull.com/turboquant-lossless-kv-cache-compression-for-ai

Learn how Google's TurboQuant compresses transformer memory down to 3 bits with PolarQuant and QJL. Benchmarks on Gemma, Mistral. Optimization for AI developers.

Boring Meeting 2.0: turbo model and 32 languages

https://sudonull.com/boring-meeting-2-0-turbo-model-and-32-languages

New version of macOS app for meeting recording: large-v3 turbo speeds up transcription by 50%, added 32 languages and UX improvements. Locally, without cloud. Download and test on your town halls.

GLM-5V-Turbo generates code from design

https://sudonull.com/glm-5v-turbo-generates-code-from-design

Multimodal GLM-5V-Turbo turns mockups into frontend code. Benchmarks, CogViT architecture, 10 Skills. Test for free in chat.z.ai for IT development.

From other projects

Jokic makes history: 40 points and 13 assists without turnovers

https://lrivo.com/jokic-makes-history-40-points-and-13-assists-without-turnovers

Nikola Jokic delivered a unique game in the NBA playoffs: 40 points and 13 assists without a single turnover. A historic record that saved Denver. Find out the details!

Chelsea's 7-0 FA Cup Win: Hato Starts Rout Amidst Turmoil

https://lrivo.com/chelsea-s-7-0-fa-cup-win-hato-starts-rout-amidst-turmoil

Chelsea thrashes Port Vale 7-0 in the FA Cup quarter-finals, advancing despite internal controversies and a player ban. Get the full match report and analysis.

Cunningham's triple-double didn't save Detroit in Cleveland

https://lrivo.com/cunningham-s-triple-double-didn-t-save-detroit-in-cleveland

Cade Cunningham recorded a triple-double, but 8 turnovers and Donovan Mitchell's heroics helped Cleveland defeat Detroit 116:109. Analysis of Game 3 of the NBA playoff series.

Trending Now