The fastest LLM gateway in the world

Madhu Shantan

Cloudflare Workers AI Is Now a Built-In Provider in Bifrost

Cloudflare Workers AI Is Now a Built-In Provider in Bifrost

Cloudflare Workers AI is now available as a first class provider directly in Bifrost. Add your Cloudflare credentials, choose a Workers AI model, and send requests through the same payload you use for your other providers. Setup starts with selecting Cloudflare in the dashboard. Configure an account ID on each

Bifrost's /v1/decisions: one API for decision models across eight providers

Bifrost's /v1/decisions: one API for decision models across eight providers

Bifrost added /v1/decisions with TypeSafe's Jev in September. With v2.3.1, the same endpoint now serves decision models from eight providers, plus any self-hosted decision model you add as a custom provider. Decision models score defined outcomes and return probabilities directly, rather than generating free

Jev: A Decision Model That Classifies Without Generating Text

Jev: A Decision Model That Classifies Without Generating Text

Jev is a decision model from TypeSafe that takes context and typed questions and returns probabilities over allowed answers instead of writing text. This post covers its Choice, Score, and Noul questions, speed and cost, confidence scores, known limits, and how it works with Bifrost.

MCP Guardrails in Bifrost

MCP Guardrails in Bifrost

Introduction MCP gives AI applications something more powerful than a prompt and a response. It gives them access to tools. An agent can search internal systems, create tickets, query databases, send messages, and work with third-party services. That is useful, but it also changes the security problem. The risk

LLM Cost Optimization in Bifrost: Part 1

LLM Cost Optimization in Bifrost: Part 1

Introduction AI costs at enterprises can become expensive quickly. Recent examples show this clearly - Uber reportedly exhausted its annual AI budget only four months into 2026, while Pylon’s CEO said the company’s Anthropic bill was set to jump from $400K to $1.4M a year after crossing 150

Guardrails at the Gateway: What Bifrost Ships and What It Integrates

Guardrails at the Gateway: What Bifrost Ships and What It Integrates

Introduction Every team running LLMs in production runs into the same surface area sooner or later. Prompt injection. PII leaking into a model provider's training pipeline. Credentials pasted into a chat by accident. Toxic or off-policy responses going back to a user. Hallucinated content quoted as fact.

Beyond latency-based routing: Adaptive load balancing in Bifrost

Beyond latency-based routing: Adaptive load balancing in Bifrost

Most teams running multi-provider LLM stacks have moved past pure round-robin for traffic distribution across providers and API keys. They've adopted latency-based routing: measure response times, penalise slow backends, shift traffic toward the fast ones. The approach is reasonable, but it has a failure mode