Throughput vs Latency Trade-offs

Select task concurrency strategies based on whether the goal is total throughput or per-request latency.