FDEBench Join us live

Q
124 / 159

Serving & inference

Design a large-scale AI model deployment system: how would you serve a GPT-4-class model to millions of concurrent users?

prep-guide DesignGurus - OpenAI System Design Questions Source

01
Open

No reference answer yet

This question is in the bank but has no rubric written for it. It can be read and practised, but not scored.

—