Search Articles — Sudonull

Search Results

In this project

Compression of GLM-5.1 on 16 GB VRAM: GQA hacks

https://sudonull.com/compression-of-glm-5-1-on-16-gb-vram-gqa-hacks

Breakdown of compressing 744B MoE model GLM-5.1 to 388 MB for T4. Fix GQA errors, config code, inference. For middle/senior dev — repeat on your hardware.

Text compression Brentwick-7 to 50 tokens

https://sudonull.com/text-compression-brentwick-7-to-50-tokens

Learn how Cambridge compresses texts to prompts with 98% accuracy. Brentwick-7 method for developers: latent reduction, embeddings, markets. Test it yourself.

TurboQuant: 6x compression of LLM KV-cache

https://sudonull.com/turboquant-6x-compression-of-llm-kv-cache

Break down Google's TurboQuant: PolarQuant + QJL for 6x KV-cache compression without accuracy loss. Inference acceleration up to 8x. Benchmarks, principle of operation for LLM developers.

LLM Hallucinations: Data Compression Artifacts

https://sudonull.com/llm-hallucinations-data-compression-artifacts

Breaking down LLM hallucinations through lossy compression: why they occur, how to minimize with RAG and fine-tuning. For developers: Shannon's theory and examples. Learn how to work with artifacts.

TurboQuant: lossless KV-cache compression for AI

https://sudonull.com/turboquant-lossless-kv-cache-compression-for-ai

Learn how Google's TurboQuant compresses transformer memory down to 3 bits with PolarQuant and QJL. Benchmarks on Gemma, Mistral. Optimization for AI developers.

From other projects

Rarity of heart cancer: mechanical force of contractions

https://ymaho.com/rarity-of-heart-cancer-mechanical-force-of-contractions

Science reveals centuries-old mystery: why the heart does not get cancer. Compression suppresses proliferation through Nesprin-2. Learn about a new class of drugs.

Inflation in Russia 5.47%: why this is not a reason for joy

https://ymaho.com/inflation-in-russia-5-47-why-this-is-not-a-reason-for-joy

Annual inflation slowed to 5.47%, but behind the statistics lies stagflation and demand compression. Find out what will happen to the Central Bank rate and the OFZ market. Risk analysis.

Trending Now