← AI Simplified
Inference
How trained models make predictions — model serving, quantization, latency optimization, and batching strategies.
0 / 4 lessons
0%
01
How Inference Works
This lesson covers how inference works in AI systems, including the challenges and techniques used to optimize model per...
02
Model Serving Architectures
This lesson covers the basics of Model Serving Architectures, including the simplest architecture and progressive additi...
03
Quantization & Optimization
This lesson covers the basics of quantization and optimization in AI systems, specifically how to reduce model size and ...
04
Batching, Caching & Latency
This lesson covers strategies to improve the performance of large language models (LLMs) in real-world applications. We'...