赞助
企业的新经济学 AI
随着企业AI从孤立的实验转向成为基础基础设施,公司需要注重效率,而不仅仅是消费。
由HPE提供
想象一下你的公司刚刚发现了电。 起初只有几台机器运行在它上,没有人担心效率——消费低,价值明显。 但一旦电力成为基础设施,每个过程都依赖于它,问题就从"我们能使用它吗?"变成了"我们使用它的效率如何?"
企业AI也在同一班最初作为孤立的聊天机器人和copilot实验,正在成为业务的基底层,模型agents和数据在生产工作量上日益相互关联。 重要的问题不再是什么是符号或GPU小时成本。 它成为人工智能环境如何有效地将付酬能力转化为有用的商业成果。
这就是值得追踪的衡量标准:每个有用结果的有效成本——完成企业实际使用的工作所需的总平台,模型,操作,以及能力成本,无论是解决的请求还是完成的工作流程。
3种管理AI的方法
利用是经济学的核心。 将更多的工作用于支付能力降低了有效的单位成本;闲置的GPU、零散的工作量和超规模的模型都提高了每个有用结果的成本。 企业一般选择三种模式:
响铃堆——在内部采购基础设施和控制。 这种办法是灵活的,但它造成了持续的负担,因为随着模式和政策的改变,团队必须使环境重新发挥作用。
按需消费——超标器减少组装负担,并适应低或不确定的需求,但每一次即时或agent行动,收费就会上升。
一个集成的私人AI平台——拥有或专用容量与经过验证的堆栈对齐。 优势不是自由推论;而是控制效率杠杆,如调度,模型选择,GPU分区,以及缓存管理。
正确的模式取决于工作量。 对于实验或可变的需求,API可以是理性的。 随着工作量的持续和企业的关键,企业不仅需要权衡其消费,而且需要权衡其运作效率。
所有权是业务纪律
购买一级方程式赛车,停在你的车库里,意味着拥有有史以来最先进的车型之一——但单凭所有权并不能让你有竞争力;你仍然需要车手,机械师和跟踪时间来证明它是合理的。 AI的基础设施同样运作。
企业AI最大的误解之一是拥有基础设施会自动改善经济学。 拥有GPU为更好的经济学创造了机会,但只有该组织有足够的需求和业务纪律来保持资源的生产。
返回最佳ROI的基础设施并不是一个参考架构,也不是一个标杆式的建材——它是一个完全集成,合格的堆栈,让团队通过KV-cache管理等技术将任务引导到符合质量要求和再利用环境的低成本模型,在保持反应能力的同时减少浪费的能力。
没有这些做法,承诺的基础设施就可能成为受困资本。 随着需求的增长,随着固定成本在更有用的工作中的摊销——在代理系统中越来越重要——固定成本在代理系统中的形成,其经济学的形成速度比整个环境的效率低。
从部署到价值
HPE Private Cloud AI是一个生产准备基础,结合了基础设施,软件,模型,工具,治理和服务,减轻了规模化经营私营AI的集成负担。 其架构让团队管理调度,模型选择,GPU分区,以及缓存管理作为操作杠杆,使能力和服务水平与每个工作量的要求保持一致。 还包括与前方部署的工程师进行为期90天的接触,这些工程师帮助客户小组部署初步使用个案并确定可重复的操作做法。
在高级别评价小组委托进行的独立测试中,一个以高利用率服务于多重工作量的综合平台提供了比多次租用同等能力更低的有效成本。 实际结果将根据工作量的组合和使用情况而有所不同。
衡量什么很重要
托肯消费仍然有用,但它并不是AI经济学的完整衡量标准。 企业更充分地跟踪每个业务相关成果的成本、加速器的利用以及相对于任务复杂性的模型选择。
已经经营私人人工智能的企业应当询问其利用率如何成熟,以及今后12至18个月的工作量将如何变化。 旅程中较早的人应该从第一次部署开始建立这些做法,因此,战略预计在需求成为瓶颈之前增长。
对于低量的、无法预测的需求,API或超规模机可能仍然是合理的。 但随着AI成为持续生产能力,企业对控制利用,摊销固定成本,管理环境作为长期经营资产,具有越来越大的动力。 战略问题不是企业是否会为AI付费——就是企业是否会理解并最终拥有它背后的经济学。
欲了解更多HPE私人云AI,请访问HPE.
该内容由HPE制作。 它不是麻省理工学院技术评论的编辑人员写的。
深潜
人工智能
不要被愚弄-LLMs没有道理
AlphaGo对阵Go冠军李赛铎十年后
别被这个夏日的爱尔胡同所愚弄
关于AGI的无呼吸声称和新能力在严格审查下迅速瓦解。
OpenAI agents黑客Hugging Face的内幕故事
基础模型因作弊和相互交流而获得奖励,这是一份新的OpenAI报告发现。
比尔盖茨称,现在怎么办?
在新的采访中,亿万富翁的慈善家听起来很惊慌,认为我们迫切需要制定AI政策。
保持连接
从
麻省理工学院技术审查
发现特别的报价,顶级故事,即将到来的事件等等。
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Sponsored
The new economics of enterprise AI
As enterprise AI shifts from isolated experiments to becoming foundational infrastructure, companies need to focus on efficiency, not just consumption.
Provided byHPE
Imagine your company just discovered electricity. At first only a few machines run on it, and nobody worries about efficiency — consumption is low and the value is obvious. But once electricity becomes infrastructure, every process depends on it, and the question changes from "can we use it?" to "how efficiently are we using it?"
Enterprise AI is going through the same shift. What began as isolated chatbot and copilot experiments is becoming a foundational layer of the business, with models, agents, and data increasingly interconnected in production workloads. The important question stops being what a token or GPU-hour costs. It becomes how efficiently the AI environment converts paid capacity into useful business outcomes.
That's the metric worth tracking: effective cost per useful outcome — the total platform, model, operations, and capacity cost required to complete work the business can actually use, whether a resolved request or a completed workflow.
Three ways to run AI
Utilization is central to the economics. Directing more work to paid-for capacity lowers effective unit cost; idle GPUs, fragmented workloads, and oversized models all raise the cost of every useful result. Enterprises generally choose among three models:
A bespoke stack — procuring infrastructure and controls in-house. This approach is flexible, but it creates a continuing burden, since teams must revalidate the environment as models and policies change.
On-demand consumption — hyperscalers reduce the assembly burden and suit low or uncertain demand, but charges rise with every prompt or agent action.
An integrated private AI platform — owned or dedicated capacity paired with a validated stack. The advantage isn't free inference; it's control over efficiency levers like scheduling, model selection, GPU partitioning, and cache management.
The right model depends on the workload. APIs can be rational for experimentation or variable demand. As workloads become sustained and business-critical, enterprises need to weigh not just what they consume, but how efficiently they operate the system.
Ownership is an operating discipline
Buying a Formula 1 race car and parking it in your garage means owning one of the most sophisticated vehicles ever built — but ownership alone doesn't make you competitive; you still need drivers, mechanics, and track time to justify it. AI infrastructure works the same way.
One of the biggest misconceptions in enterprise AI is that owning infrastructure automatically improves economics. Owning GPUs creates the opportunity for better economics, but only if the organization has sufficient demand and operational discipline to keep resources productive.
The infrastructure that returns the best ROI isn't a reference architecture or a bespoke build-out — it's a fully integrated, qualified stack that lets teams route tasks to the least costly model that meets quality requirements and reuse context through techniques such as KV-cache management, reducing wasted capacity while maintaining responsiveness.
Without these practices, committed infrastructure can become stranded capital. With them, rising demand improves economics as fixed costs are amortized across more useful work — increasingly important in agentic systems, where economics are shaped less by any single prompt than by the efficiency of the complete environment.
From deployment to value
HPE Private Cloud AI is a production-ready foundation combining infrastructure, software, models, tools, governance, and services, reducing the integration burden of operating private AI at scale. Its architecture lets teams manage scheduling, model selection, GPU partitioning, and cache management as operational levers, aligning capacity and service levels with each workload's requirements. It also includes a 90-day engagement with forward-deployed engineers who help customer teams deploy initial use cases and establish repeatable operating practices.
In independent testing commissioned by HPE, an integrated platform serving multiple workloads at high utilization delivered a lower effective cost per token than repeatedly renting equivalent capacity. Actual results will vary based on workload mix and utilization.
Measure what matters
Token consumption remains useful, but it isn't a complete measure of AI economics. A fuller enterprise view tracks cost per business-relevant outcome, accelerator utilization, and model choice relative to task complexity.
Enterprises already operating private AI should ask how mature their utilization is, and how workload volume will change over the next 12 to 18 months. Those earlier in the journey should build these practices in from the first deployment, so strategy anticipates growth before demand becomes a bottleneck.
For low-volume, unpredictable demand, an API or hyperscaler may remain sensible. But as AI becomes a continuous production capability, enterprises have a growing incentive to control utilization, amortize fixed costs, and manage the environment as a long-term operating asset. The strategic question isn't whether enterprises will pay for AI — it's whether they will understand, and ultimately own, the economics behind it.
To learn more about HPE Private Cloud AI, please visit HPE.
This content was produced by HPE. It was not written by MIT Technology Review’s editorial staff.
Deep Dive
Artificial intelligence
Don’t be fooled—LLMs don’t reason
Ten years after AlphaGo’s match against Go champion Lee Sedol, today’s AI still isn’t tapping into the machinery that made that win possible.
Don’t be fooled by this summer of AI hype
Breathless claims about AGI and new capabilities fall apart pretty quickly under scrutiny.
The inside story on why OpenAI agents hacked Hugging Face
The underlying models had been rewarded for cheating and communicating with each other, a new OpenAI report finds.
Bill Gates says we’ve passed AI’s danger thresholds. Now what?
In a new interview, the billionaire philanthropist sounds an alarm on the urgency of getting our AI policies in order.
Stay connected
Get the latest updates from
MIT Technology Review
Discover special offers, top stories, upcoming events, and more.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.