Async Throughput vs Latency Tuning

Balance the trade-offs between batching for throughput and immediate processing for lowest latency.