● RESEARCH & SYSTEMS PUBLICATIONS

Systems, Shaders & Craft.

Deep technical investigations into GPU memory architectures, OpenAI Triton kernels, high-throughput LLM serving, and tactile mathematical UI.

GPU Systems // 02
Featured Physical MonographHardcover Edition

Dissecting Memory Bandwidth & SRAM Tiling in Triton: From GEMM to FlashAttention-3

Why LLM inference is strictly memory-bound in decoding, how HBM3e vs SRAM bandwidth dictates latency, and writing a fused Triton kernel with online softmax.

Target Silicon

H100 SXM5

Bandwidth

3.35 TB/s (98%)

Compiler

Triton 3.0

SRAM Tiling

-93.6% DRAM

Nov 11, 2026·7 min read
Read Full Monograph