https://sudonull.com/rugpt3xl-with-8k-context-sparse-attention
Expansion of ruGPT3XL to 8k tokens via sparse attention and fine-tuning. PPL 13.00 on gazeta, Triton/SDPA optimization ×1.85. Instructions for developers.
Search Articles — Sudonull
Search Results
In this project
https://sudonull.com/kimi-k2-6-code-optimization-by-ai-agent-185
How open-source model Kimi K2.6 rewrote the exchange engine in 13 hours and increased throughput by 185%. Analysis of architecture, benchmarks, and practical cases.
From other projects
https://ymaho.com/cerebras-ipo-at-185-betting-on-inference-against-nvidia
Cerebras raised IPO price to $185 amid 20x oversubscription. Find out why investors are betting on AI inference chips and what the risk is. Analysis.
Trending Now
REST API vs GraphQL: Key Differences & How to Choose
Compare REST API vs GraphQL side-by-side. Learn which architecture fits your project with data on performance, caching, cost, and scalability. Make the right choice.
CERN quantum internet: 50 km test between Geneva and Lausanne
CERN successfully transmitted entangled photons over 50 km in a real urban network. Learn how White Rabbit technology is changing the quantum communications market and who benefits from this breakthrough.
How to Choose a Database for Your System: Expert Guide
Learn how to choose a database for your system with this evidence-based framework. Compare SQL, NoSQL, graph, and time-series databases to make the right decision.
What Is a Vector Database? Beginner's Guide to AI Search
What is a vector database? Learn how vector databases power AI search, RAG, and recommendations. Discover key concepts and when to use them. Start here.
OWASP Top 10 Explained: What It Is & Why It Matters
Learn what is the OWASP Top 10 and why does it matter for secure coding. A developer's guide to web app vulnerabilities, risks, and practical defense strategies.
JavaScript vs Python Which Is Better: Full 2026 Guide
JavaScript vs Python which is better for you? Compare ease of learning, salaries, use cases, and career paths to choose the right first language in 2026. Start now.
Figure 02: new humanoid robot with AI interface from Figure AI
Figure AI introduced the humanoid robot Figure 02 with physical AI and OpenAI language model. The robot passed tests at BMW factories. Learn how humanoid robots are changing manufacturing.
Nvidia capitalization $5.4 trillion: surpassed Europe
Nvidia reached $5.4 trillion capitalization, outpacing the 10 largest companies in Europe. Analysis of growth reasons, overheating risks, and forecasts for the AI chip market. Read the review.
What Is React Used For? UI Development Guide
What is React used for? Learn how this JavaScript library builds fast, scalable UIs with components and Virtual DOM. Discover its real-world uses and benefits.
How to Design RESTful APIs for Web Applications: Best Practices
Learn how to design RESTful APIs for web applications with best practices on URIs, HTTP methods, versioning, and documentation. Build scalable, intuitive APIs that developers love.