All courses
AI path · course 336 of 422
Training vs Inference: Two Different Hardware Problems
Intermediate · 3 lessons · 0 complete
Training workload shape, inference phases (prefill and decode), batching and latency, memory-bound decoding, cost per token, and why specialised inference chips and software have appeared.
