FDEBench Join us live

Q
129 / 159

Serving & inference

What is a KV cache, and how does it help LLM inference?

candidate-reports IGotAnOffer - GenAI System Design Interview Source

01
Open

No reference answer yet

This question is in the bank but has no rubric written for it. It can be read and practised, but not scored.

—