How do you measure LLM latency in a chat app, and which percentile matters?

youtube Keerti Purswani - 20 Agentic AI System Design Questions Source

01
Open

No reference answer yet

This question is in the bank but has no rubric written for it. It can be read and practised, but not scored.

—