Intelligent Fallbacks & Automatic Rerouting

Debugging distributed AI requests in production just got an enterprise-grade upgrade. We’ve launched a centralized logging system that securely records every LLM interaction with exact timestamps, complete payload metadata, and precise cost breakdowns.

Additionally, you can now securely store, rotate, and manage all your third-party vendor API keys inside an encrypted, unified dashboard. This allows developer teams to quickly pinpoint failed requests, trace slow tokens, and audit system performance.

Alongside this, we have introduced a hardened API Key Vault. You can now securely store, rotate, and manage all your third-party vendor credentials inside a single, encrypted, and compliance-ready interface, completely eliminating the security risk of scattered .env files across your engineering teams.

Create a free website with Framer, the website builder loved by startups, designers and agencies.