throughput term
rate of work completed per unit time
Latency's tradeoff partner. Optimizing for throughput often means batching, which hurts latency. Always specify both.
rate of work completed per unit time
Latency's tradeoff partner. Optimizing for throughput often means batching, which hurts latency. Always specify both.