https://sudonull.com/rugpt3xl-with-8k-context-sparse-attention
Expansion of ruGPT3XL to 8k tokens via sparse attention and fine-tuning. PPL 13.00 on gazeta, Triton/SDPA optimization ×1.85. Instructions for developers.
Search Articles — Sudonull
Search Results
In this project
https://sudonull.com/mergetree-in-clickhouse-granules-parts-and-sparse-index
MergeTree structure using a bids table example: part, granule, mark, merge of parts, ORDER BY vs PRIMARY KEY, partitioning, EXPLAIN indexes, partition management.
https://sudonull.com/architecture-for-9-trillion-records-on-a-server
Learn how to store trillions of Milky Way stars in sparse files with Z-encoding. Scalable system without indexes for middle/senior dev. Implement it yourself.
https://sudonull.com/speeding-up-regex-search-with-trigrams-in-cursor
Local indexing of trigrams and sparse n-grams speeds up code search for AI agents. Reducing time from 15s to milliseconds in large repositories. More details for developers.
https://sudonull.com/order-by-and-primary-key-in-clickhouse-index-selection
How to correctly choose ORDER BY in ClickHouse: sparse index, column cardinality, equality vs range, verification via EXPLAIN. Rules and examples for gambling.
Trending Now
Starlink Launch in Japan: Direct Smartphone Communication via Satellite
SpaceX and KDDI launched satellite communication for smartphones in Japan. Learn how Starlink Direct-to-Cell works, who can access it, and what hidden geopolitical goals this project pursues.
How Netflix Scales Its Streaming Infrastructure: Cloud & CDN
Learn how Netflix scales its streaming infrastructure with AWS, Open Connect CDN, and chaos engineering. Discover the tech behind 270M subscribers and sub-100ms latency.
How to Set Up CI/CD Pipeline with GitHub Actions – Guide
Learn how to set up CI/CD pipeline with GitHub Actions. Step-by-step guide with YAML examples for automated testing, Docker builds, and deployment.
what is the difference between vpn and proxy: Key Privacy Tips
Learn what is the difference between vpn and proxy, from encryption to scope. Discover which tool fits your privacy needs with our expert comparison.
What Is Kubernetes and How It Works: Complete Guide
Learn what is Kubernetes and how it works. Understand its architecture, self-healing, scaling benefits, and real-world impact. Start mastering container orchestration today.
How to Build an AI Agent with LangChain: Step-by-Step Guide
Learn how to build an AI agent with LangChain in this step-by-step tutorial. Set up tools, integrate LLMs, and create autonomous agents with memory.
How to Reduce Hallucination in LLMs: 7 Proven Techniques
Learn how to reduce hallucination in LLMs with 7 proven techniques from peer-reviewed research. Boost accuracy and reliability in your AI applications today.
How to Design RESTful APIs for Web Applications: Best Practices
Learn how to design RESTful APIs for web applications with best practices on URIs, HTTP methods, versioning, and documentation. Build scalable, intuitive APIs that developers love.
What Is Infrastructure as Code? Benefits, Tools & Best Practices
Learn what is infrastructure as code and why use it. Discover key benefits, essential tools, and best practices to automate and secure your cloud infrastructure.
CERN quantum internet: 50 km test between Geneva and Lausanne
CERN successfully transmitted entangled photons over 50 km in a real urban network. Learn how White Rabbit technology is changing the quantum communications market and who benefits from this breakthrough.