#llm

Articles tagged with #llm

Essential Math & Concepts for LLM Inference
Back of the envelope calculations to estimate model's GPU memory requirements & insights into HW/SW optimizations
May 31, 202412 min read1.6K
CPU & GPU - The Basics
A digestible high-level overview of what happens in The Die
Apr 8, 202416 min read623