Search Articles — Sudonull

Search Results

In this project

PyTorch Hooks for audio from LLM activations

https://sudonull.com/pytorch-hooks-for-audio-from-llm-activations

Learn how to intercept Qwen activations via forward hooks and generate ambient. Monkey patching MusicGen for vision-to-audio. Code and details for middle/senior dev.

GPU acceleration of the Game of Life: CUDA Triton benchmarks

https://sudonull.com/gpu-acceleration-of-the-game-of-life-cuda-triton-benchmarks

Comparison of PyTorch, CUDA, Triton for the cellular automaton "Game of Life" on A40. Results 22.5 ms, kernel code. Study optimizations for memory-bound tasks. Read the analysis.

DiffQuant: Sharpe optimization in a differentiable simulator

https://sudonull.com/diffquant-sharpe-optimization-in-a-differentiable-simulator

Learn how DiffQuant optimizes Sharpe ratio directly through PyTorch graph taking costs into account. iTransformer, hybrid loss, mirror augmentation. Results on BTC: Sharpe +1.73 OOS. For ML engineers in trading.

Self-attention and multi-head in transformers

https://sudonull.com/self-attention-and-multi-head-in-transformers

Breakdown of attention mechanisms: self-attention, cross-attention, multi-head with examples and PyTorch code. Theory, mathematics, practice for AI developers. Study scaled dot-product attention.

ML Courses 2026: top for junior

https://sudonull.com/ml-courses-2026-top-for-junior

Choose a machine learning course to start in IT. Comparison of 6 programs: prices, durations, Python/PyTorch skills, MLOps. Salaries from 130k rub. Start learning and enter the profession.

Trending Now