A primer on key AI LLM concepts — KV cache, weights, quantization, and how inference actually works

How do AI models work? This primer explains crucial concepts to understand how LLMs work, with definitions and explanations for all of AI's new nomenclature.