Section
News
What happened in AI this week: model releases, funding, policy, and the people behind them.
LiteLLM's Rust gateway benchmark, checked against LiteLLM's own data
LiteLLM says its Rust gateway has about 7x lower overhead, 9x less memory and 4.5x more requests per dollar than the next-closest gateway. LiteLLM's own benchmark files show a latency and throughput near-tie, a mislabeled widest-pair memory chart, a modeled cost and a config gap, plus Rust leads on CPU and memory.
GPT-6.1 Terra brings a specialised pitch to computer work
Terra targets visual reasoning and screen-based tasks. Its release makes the model, action environment and saved-result checks separate questions.
Bifrost adds an Agent Gateway that proxies A2A agents beside model and MCP traffic
The open-source gateway's v2.3.0 release, out October 13, registers A2A agents by their agent cards, rewrites those cards to gateway endpoints, bridges transports, relays push notifications and gates every call on virtual-key grants. A v2.3.1 follow-up tightened destination and credential rules.
How to use Jev: where a System One model fits next to an LLM
TypeSafe's Jev returns typed answers with probabilities instead of text. Its documentation, the first developer reports and early independent papers show where it fits in a pipeline, what the published price works out to, and why its probabilities need checking on your own data.
Bifrost CLI v1.0 launches coding agents through the gateway and manages it from the terminal
Maxim AI has published Bifrost CLI v1.0, a launcher that starts four terminal coding agents already routed through its open-source gateway, scoped to one process. It also signs developers in, shows their models and budget, and exposes the gateway's admin API to scripts and CI.
TypeSafe launches Jev, a model that returns decisions instead of text
TypeSafe AI came out of stealth on September 15 with $40 million in seed funding and Jev, a model that answers typed questions about a block of text with probabilities instead of prose. The pricing is unusual, the speed claims are large, and the first independent tests are mixed.
Bifrost Edge brings AI gateway governance to every company laptop
Maxim AI's endpoint agent for the Bifrost gateway gained per-app capture controls, version reporting and a stateless MCP inspection path in Bifrost Enterprise v2.3.0. How Edge works, what it governs, how it rolls out through MDM, and where it sits next to CASB and DLP tooling.
The reasoning-model era has a cost problem
Models that think before they answer are billed for every token of that thinking, whether or not you see it. The controls have moved from token budgets to effort levels, and the price of a request now depends on how hard the question is.
Bifrost reworks /v1/decisions into one OpenAI-shaped API for decision models
Decision models from TypeSafe, OpenAI, Perplexity, Cloudflare, Microsoft, Databricks and Ollama return typed answers with probabilities, in two request dialects. Bifrost v2.3.0 gives them one endpoint, stops silently answering decisions with chat models, and prices decisions on their own rates.
Bifrost adds Warp, a read-only agent that answers questions about gateway telemetry
Warp, formerly called Odin, puts a tool-calling agent inside the Bifrost gateway's own dashboard. It reads logs, metrics and governance settings through a fixed set of read-only tools, searches logged conversations by meaning, and sees only the rows the person asking could already see.