Skip to main content

Throughput vs Latency

developer

Throughput is how much work a system completes per second; latency is how long one unit of work takes. Systems can have high throughput and still feel slow if individual requests wait in long queues.

Set both targets explicitly: p95 latency for user experience, throughput for capacity planning.

Related topics