混合基础设施决定重点关注AI成本和控制
企业人工智能正在进入一个成本意识的阶段，混合基础设施就是进行计算的地方。 随着推论支出的攀升，商业领袖们正在权衡模型运行地点，他们使用的模型以及他们有多少数据愿意交给别人。
这些费用方面的考虑正在改变各行业的购买决定，包括试图将分散的数据转化为实时行动的金融机构。 据戴尔称，超过6500家企业采用了带有Nvidia更新的戴尔AI工厂。 客户要求的改变，据戴尔销售高级副总裁Kyle Dufresne(图)说。
近三个月来，我们看到80%的象征来自前沿模型，三个月后，世界上80%的代币正在由开放模型生成，"Dufresne 称。 “为什么？因为费用每个人都在谈论象征性的漫画。”
Dufresne在Dell Technologies New York研讨会上，在SiliconANGLE Media的直播工作室CUBE独家播出时，他们讨论了代币学，混合基础设施以及戴尔如何帮助客户计划AI投资。 (* 下文披露。 )
推论成本将混合基础设施推向边缘
推论现在比训练增长得快，虽然根据杜弗雷斯内的说法，两者都在迅速扩张。 这种转变正在改变AI工作发生的地方，戴尔看到推论运行在数据创建的地方——在云中，在数据中心和外到PC.
“我们看到企业主说，我们如何在不抑制创新的情况下降低这些成本？” “我们发现这发生在整个过程中
经济学也提出了关于控制的战略问题。 Dufresne解释说，公司必须决定是否将数据外包和加以区分，它们现在正在根据工作量在何处、它们使用哪些模型以及数据在何处进行定价。 戴尔将其最新的AI Factory与Nvidia的更新设定在周围，帮助客户获得他们控制的基础设施的结果。
“我们看到世界上每一个执行这些结构的[首席财务官]都说，`戈什，我的象征性费用正在爆炸'。 “`我们如何驱动成本？'”
供应是分类账的另一面。 Dufresne估计，内存价格正在推动科技成本上升而非下降，明年市场将增加约20%的内存，Dell正通过协作规划作出回应，引导客户转向更方便使用的组件，并在即将增加的费用中分享预先可见度。 许多客户发现其资本成本低于组件通胀，因此它们更早购买。
不仅能提供科技，“但也可以与客户分享未来会发生什么
以下是SiliconANGLE的完整视频访谈
(* 披露：CUBE是戴尔技术纽约专题讨论会的付费媒体伙伴。) CUBE活动报道的发起人Dell或其他发起人对CUBE或SiliconANGLE上的内容都没有编辑控制。 )
照片：SiliconANGLE
SiliconANGLE联合创始人John Furrier的留言：
支持我们的使命，通过与CUBE社区接触，保持内容的开放和自由。 加入CUBE的校友信托网络，其中技术领导者相互连接，分享情报，创造机会。
- 15M+观看CUBE视频，为AI、云层、网络安全等各种对话提供动力
- 11.4k+CUBE校友——通过独特的信任网络与11400多名技术和企业领袖建立联系，塑造未来
你是AWS客户吗？在财务上支持SiliconANGLE，从我们的市场门户页面和链接购买您的AWS服务：https://siliconangle.com/aws-marketplace/.
关于 SiliconANGLE 媒体
SiliconANGLE Media由技术视觉家约翰·弗瑞尔(John Furrier)和戴夫·韦兰特(Dave Vellante)创立，构建了产业领先数字媒体品牌的动态生态系统，达到1500+百万精英技术专业人士。 利用CUBEAi.com神经网络，帮助科技公司以数据为导向做出决策
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Hybrid infrastructure decisions put AI costs and control in focus
Enterprise artificial intelligence is entering a cost-conscious phase, and hybrid infrastructure is where that reckoning plays out. As inference spending climbs, business leaders are weighing where models run, which models they use and how much of their data they are willing to hand to someone else.
Those cost considerations are reshaping buying decisions across industries, including among financial institutions trying to turn siloed data into real-time action. More than 6,500 enterprises have adopted the Dell AI Factory with Nvidia updates, according to Dell. A sharp shift in token economics is changing what customers ask for, according to Kyle Dufresne (pictured), senior vice president of sales at Dell.
“It’s incredible to see just over the last three months where we saw 80% of the tokens being generated from frontier models. Three months later, 80% of the tokens in the world are being generated by open models,” Dufresne said. “Why? Because of cost. And everybody talks about tokenomics.”
Dufresne spoke with theCUBE Research’s Dave Vellante at the Dell Technologies New York Symposium, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed tokenomics, hybrid infrastructure and how Dell is helping customers plan AI investments. (* Disclosure below.)
Inference costs push hybrid infrastructure toward the edge
Inference is now growing faster than training, though both are expanding quickly, according to Dufresne. That shift is changing where AI work happens, with Dell seeing inference run wherever data is created — in the cloud, in the data center and out to PCs.
“We’re seeing the business owners saying, ‘Oh my gosh, these costs are getting really high for inferencing. How do we reduce those costs without curbing innovation?'” Dufresne said. “We’re finding it’s happening across that continuum but more and more right out at the far edge.”
The economics also raise a strategic question about control. Companies have to decide whether they want to outsource their data and differentiation, and they are now pricing AI based on where workloads run, which models they use and where their data sits, Dufresne explained. Dell has framed its latest AI Factory with Nvidia updates around helping customers get results on infrastructure they control.
“We’re seeing every single [chief financial officer] in the world that has implemented these structures saying, ‘Gosh, my token costs are exploding,'” he said. “‘How do we drive costs out?'”
Supply is the other side of the ledger. Memory prices are pushing technology costs up rather than down, and about 20% more memory will reach the market next year against roughly 200% more demand, Dufresne estimated. Dell is responding with collaborative planning, steering customers toward more readily available components and sharing advance visibility into upcoming cost increases. Many customers find their cost of capital is lower than component inflation, so they are buying earlier.
“It’s not only just being able to provide the technology,” Dufresne said. “But also to be able to share with customers what’s going to happen in the future so they can make better decisions today on the use of their capital.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the Dell Technologies New York Symposium:
(* Disclosure: TheCUBE is a paid media partner for the Dell Technologies New York Symposium. Neither Dell, the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Photo: SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.