#systemprogramming

Articles tagged with #systemprogramming

INT8 Quantization the Second Time Around
I quantized my inference engine's weights to int8 — and almost led with the wrong number before the process itself caught a real bug.
Sep 3, 20266 min read3
What Actually Happens Inside a Transformer Forward Pass
I built an LLM inference engine from scratch in C++.
Aug 31, 202610 min read19