AI

Data parallel, tensor parallel, pipeline parallel and sharded optimisers are the vocabulary of every serious AI infrastructure interview, and they are also what determines whether a training run finishes. This course covers the parallelism strategies, the memory arithmetic behind them, and the interview questions that separate readers from practitioners.

Lesson 1 is free. Subscribe to unlock every course.

Secured checkout

$7.65/mo

cancel anytime

Every course on the platform, 350+ and growing

Quizzes, certificates, and your rank on the leaderboard

New courses added every week at no extra cost

Already have All Access? This is included, no need to subscribe separately.

Subscribe

Have a promo code?

USDC & USDT