When to Use Async for ML Inference