- Chain agents with task-specific prompts
- Enable parallel agent execution with shared memory
- Call external tools from within agent trees
The beta includes support for function calling and shared context across agents.
Fuse is available for Pro and Enterprise plans.
📦 New: GPU Auto-Scaling (for Inference APIs)
Our API now supports automatic GPU scaling based on real-time traffic.
This helps reduce cold starts and ensures low-latency inference even during usage spikes.
- Support added for NVIDIA A100, H100
- Billing adjusts dynamically based on load
- Requires no configuration — just deploy your model
🧠 Improved: Model Updates
- Upgraded our default CodeGen-7B endpoint to v2.1 — better accuracy, fewer hallucinations