Toolkit now supports async tool functions and automatically selects them when an agent runs in an async context. This delivers lower latency and higher throughput for concurrent workloads, while removing boilerplate required to manage sync/async paths manually.
Details:
- Automatic selection of async tools in async runs; no code changes required
- Improves responsiveness and resource efficiency under load
- Works alongside existing tools without migration
Who this is for: Teams building high-concurrency agents, streaming experiences, or serverless workloads that benefit from end-to-end async execution.