Hitting 1,000 tokens per second on a single RTX 5090
Aggressive decode optimizations for Qwen3-0.6B on an RTX 5090 GPU
Optimization
SentencePiece with ARM64 SIMD
Implementing Google’s SentencePiece in C with aggressive optimizations
Understanding the CUDA Compiler & PTX with a Top-K Kernel
A step-by-step tutorial on building a production Top-K CUDA kernel.