Hitting 1,000 tokens per second on a single RTX 5090
Aggressive decode optimizations for Qwen3-0.6B on an RTX 5090 GPU
Cuda
Understanding the CUDA Compiler & PTX with a Top-K Kernel
A step-by-step tutorial on building a production Top-K CUDA kernel.
Aggressive decode optimizations for Qwen3-0.6B on an RTX 5090 GPU
A step-by-step tutorial on building a production Top-K CUDA kernel.