AI 模型和平台
Baseten 发布网格到路由和Govern Entertainment AI编码
在 Google 上的首选来源中添加 Unite.AI
Baseten 宣布 Grid于2026年11月4日开通了其路由,网关和护栏层的公开预览,用于企业AI编码。 该公司报告称,Baseten路由器在最初的基准测试中实现了每项任务成本的近70%的节省,与Opus 5.5进行了0.9%的质量权衡;早期接入通过一个等待名单处理。
超越按键价格的运行
Grid 自动化了开发者在其它情况下自己做出的选择:哪个得到批准的模型应该处理每个编码任务。 对于每一项请求,Baseten路由器都评价该组织核准的开放和封闭源码选项,并权衡可能的任务业绩与成本。
路由器并非仅以象征性价格对模型进行排名,而是包含了重试、失败的工具呼叫和不完整的答案等费用。 其目的是在满足小组质量和业绩要求的同时,减少完成任务的费用。 自动路线可以强调成本,智能或两者的平衡。
组织也可以选择共享痕迹,可用于培训自定义路由器,以达到Pareto特定工作量的效率。 基数称精确的节省会随着工作量的形态和客户在成本和质量之间所期望的平衡而变化,使得基准测试表明潜在的而不是普遍减少。
Chintan Parikh),Opendoor的工程负责人,称 Grid将知名度整合为内部AI支出,并自动减少支出,同时降低质量损失。 几乎所有Opendoor的员工都使用AI,大多数员工不愿决定选择哪个模式。
中央访问而不改变开发者工具
网格网关提供行政层。 平台团队可以批准模型,授予团队级别的访问权限,制定预算并使用公司管理的证书,同时监测跨团队,应用程序和agents的使用情况。 仪表板按模型分解支出,显示总支出,符号量,缓存命中率和节省成本。
在发布,Grid支持来自OpenAI,Anthropic,Gemini企业Agent平台,Amazon Bedrock和Baseten的模型。 开发者可以通过一个设置命令连接Claude Code,Codex,OpenCode和Pi,而管理员可以通过移动设备管理实现配置自动化。
内部应用以及使用Anthropic或OpenAI API的agents可以通过改变基址和模型ID来连接。 带来在同一端点下的现有软件不要求各组织更换其既定的开发者工具。
平台团队还可以为每一次操纵指定一个默认编码模型和一个较小的背景模型,用于诸如摘要等侧面任务。 开发者在设置过程中接收这些默认值,并可在以后更改模型。
共用护卫铁路和推论基础设施
网格将可配置的安全政策置于网关,对请求和回应进行集中检查。 政策可以因工作量而异,记录可以确定标出的内容和处理方式。 已查明的风险包括载有隐藏指示的文件,将agents、未经授权的行动和客户信息显示在不属于它的地方。
这些护栏与执行控制不同。 安全检查检查检查有风险的请求和回应,而执行控制则确定agent可以访问和做什么。 Baseten 称企业需要两层。
在网关下面,Baseten的推论平台处理路由,在模型和牵引协议之间翻译,缓存,缩放和优化。 当Baseten为选定的模型服务时,扩展的多回合agent会话可以被引导到温暖的密钥值缓存,以减少成本。 其模型性能研究、培训后和基础设施团队也跨越定制内核、投机解码和每个模型在运输前必须经过的评价。
除了预览之外,Baseten还计划支持将较长期的工作下放给云托管的agents,以及协调多个agents的复杂任务。 还计划根据客户的数据和使用个案、更丰富的安全信号和支持客户自己的护栏。
因此,经济测试是按要求的质量完成一项任务的成本,象征性价格只有一项投入。 由于报告的节余取决于工作量的形状和若干agent管理能力仍然在计划之中,预览将打开这些基准测试结果如何一致地转化为生产编码工作。
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
AI Models & Platforms
Baseten Launches Grid to Route and Govern Enterprise AI Coding
Add Unite.AI to your preferred sources on Google
Baseten announced Grid on November 4, 2026, opening a public preview of its routing, gateway and guardrails layer for enterprise AI coding. The company reported that Baseten Router achieved nearly 70% savings in cost per task in initial benchmarks, with a 0.9-percentage-point quality tradeoff against Opus 5.5; early access is handled through a waitlist.
Routing Beyond Token Prices
Grid automates a choice that developers otherwise make themselves: which approved model should handle each coding task. For every request, Baseten Router evaluates the organization’s approved open- and closed-source options and weighs likely task performance against cost.
Rather than ranking models by token price alone, the router incorporates the expense of retries, failed tool calls and incomplete answers. Its objective is to reduce the cost of completing a task while meeting the team’s quality and performance requirements. Automatic routes can emphasize cost, intelligence or a balance of both.
Organizations can also opt in to sharing traces, which can be used to train custom routers for Pareto efficiency on their specific workloads. Baseten said exact savings will vary with workload shape and the customer’s desired balance between cost and quality, making the benchmark an indication of potential rather than a universal reduction.
Chintan Parikh, Opendoor’s head of engineering, said Grid consolidated visibility into internal AI spending and reduced spending automatically with minimal quality loss. Almost everyone at Opendoor uses AI, and most employees do not want to decide which model to pick.
Central Access Without Changing Developer Tools
Grid Gateway supplies the administrative layer. Platform teams can approve models, grant team-level access, set budgets and use company-managed credentials while monitoring usage across teams, applications and agents. A dashboard breaks spending down by model and displays total spend, token volume, cache hit rate and cost saved.
At launch, Grid supports models from OpenAI, Anthropic, Gemini Enterprise Agent Platform, Amazon Bedrock and Baseten. Developers can connect Claude Code, Codex, OpenCode and Pi with one setup command, while administrators can automate configuration through mobile device management.
In-house applications and agents using the Anthropic or OpenAI API can connect by changing a base URL and model ID. That brings existing software under the same endpoint without requiring organizations to replace their established developer tools.
Platform teams can also assign each harness a default coding model and a smaller background model for side tasks such as summaries. Developers receive those defaults during setup and can change models later.
Shared Guardrails and Inference Infrastructure
Grid places configurable safety policies at the gateway, applying checks to requests and responses centrally. Policies can vary by workload, and records identify what was flagged and how it was handled. The identified risks include documents carrying concealed instructions that redirect agents, unauthorized actions and customer information surfacing where it does not belong.
Those guardrails are distinct from execution controls. Safety checks examine risky requests and responses, while execution controls determine what an agent can access and do. Baseten said enterprises need both layers.
Underneath the gateway, Baseten’s inference platform handles routing, translation between model and harness protocols, caching, scaling and optimization. When Baseten serves the selected model, extended multi-turn agent sessions can be directed to warm key-value cache to reduce their cost. Its model performance research, post-training and infrastructure teams also work across custom kernels, speculative decoding and the evaluations every model must pass before shipping.
Beyond the preview, Baseten plans to support delegation of longer-running work to cloud-hosted agents and coordination of multiple agents on complex tasks. Also planned are routing tuned to customer data and use cases, richer safety signals and support for customers’ own guardrails.
The economic test is therefore the cost of a completed task at the required quality, with token price only one input. Because the reported savings depend on workload shape and several agent-management capabilities remain planned, the preview leaves open how consistently those benchmark results will translate into production coding work.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.