recall

← recall

throughput term

rate of work completed per unit time

Latency's tradeoff partner. Optimizing for throughput often means batching, which hurts latency. Always specify both.

aliases: rps, qps, tps

topics: metrics, performance

references: