管理服务支助使新云GPU能力保持健康
Neoclouds随着AI实验室和企业寻找专用图形处理单元容量而倍增,但站立一个集群只是开始。 对较小的供应商来说,硬件伙伴提供的有管理的服务支助越来越多地决定这种能力在投入使用后是否保持健康和有利可图。
专门的AI云正在与超标器一起刻出一个角色,特别是在主权云要求决定数据生活地点和由谁控制的情况下。 根据Alpha Compute Corp的执行副总裁Tom Richer(图尔德)的说法,一个年轻的供应商不能自行对复杂的GPU部署的每一层进行员工配备。
“你可以拼凑许多不同的供应商,“你只是想让能够确保成功的综合解决方案提供者帮助你完成所有建设,然后使所有。.....管理的服务保持健康,并使一切工作符合[服务级别协议]。”
Richer在Dell Technologies New York研讨会上,在CUBE, SiliconANGLE Media的直播工作室独家播出时,他们讨论了管理服务支助、主权AI基础设施和新云融资等问题。 (* 下文披露。 )
管理服务支助主控主权新云
Alpha Compute在数字资产启动后不到一年就进入了AI基础设施,现在它以由Dell Technology Inc.和Intel Corp.硬件提供的主权和保密计算动力为首。 该公司通过设计称为主权的它的方法从硅开始,并将客户的数据留在国内,但必须遵守欧盟AI法案和一般数据保护条例等规则,Richer对此作了解释。
“我们从硬件开始。 以为堆。 我们创造飞地,“我们是戴尔公司的合伙人,因此我们使用戴尔技术以及Intel技术。”
那个堆栈已经在生产了公司72号节点的圣路易斯集群从戴尔对齐Nvidia布莱克韦尔系统与InfiniBand联网,并在一个经过改造的棕田数据中心内直接进行液体冷却,Alpha Compute概述了增加布莱克韦尔集群的计划。 Alpha 计算宣布由 Nvidia B300 硬件担保的3,190万美元非回路贷款设施的装订期表。
“虽然那里有三重性。 你需要脱衣舞者,一个好脱衣舞者,“Richer 称。 “但你们也需要这种土地、动力和外壳。”
一旦一个集群被直播,Alpha Compute拥有客户端关系。 车票,补救和硬件回报通过与戴尔的联合团队运行,这使得AI工厂成为其企业战略的中心。 Alpha Compute至今的客户端是AI实验室,希望供应商管理操作系统以下的一切。 据Richer说,企业可能要求更多。
“Dell是我们的管理服务伙伴,我们可以在第二天超越[操作系统]”,Richer 称。 “Dell及其综合方法的强大之处在于我们可以走到任何水平。”
管理下服务支助的深度也决定了Richer如何看待新云的竞争。 他解释说,没有“噪音邻居”或多租户共享的专用供应商将承担最苛刻和敏感的GPU工作量,而不是取代公共云。
“我确实看到新云与公共云一起,“对于那些非常艰巨的超级智能工作量,企业可以把这些敏感、高性能的计算工作量送到新云,这样它们就可以协同工作。”
以下是SiliconANGLE的完整视频访谈
(* 披露:CUBE是戴尔技术纽约专题讨论会的付费媒体伙伴。) CUBE活动报道的发起人Dell或其他发起人对CUBE或SiliconANGLE上的内容都没有编辑控制。 )
照片:SiliconANGLE
SiliconANGLE联合创始人John Furrier的留言:
支持我们的使命,通过与CUBE社区接触,保持内容的开放和自由。 加入CUBE的校友信托网络,其中技术领导者相互连接,分享情报,创造机会。
- 15M+观看CUBE视频,为AI、云层、网络安全等各种对话提供动力
- 11.4k+CUBE校友——通过独特的信任网络与11400多名技术和企业领袖建立联系,塑造未来
你是AWS客户吗?在财务上支持SiliconANGLE,从我们的市场门户页面和链接购买您的AWS服务:https://siliconangle.com/aws-marketplace/.
关于 SiliconANGLE 媒体
SiliconANGLE Media由技术视觉家约翰·弗瑞尔(John Furrier)和戴夫·韦兰特(Dave Vellante)创立,构建了产业领先数字媒体品牌的动态生态系统,达到1500+百万精英技术专业人士。 利用CUBEAi.com神经网络,帮助科技公司以数据为导向做出决策
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Managed services support keeps neocloud GPU capacity healthy
Neoclouds are multiplying as AI labs and enterprises hunt for dedicated graphics processing unit capacity, but standing up a cluster is only the start. For smaller providers, managed services support from hardware partners increasingly decides whether that capacity stays healthy and profitable after go-live.
Specialized AI clouds are carving out a role alongside the hyperscalers, particularly where sovereign cloud requirements dictate where data lives and who controls it. A young provider cannot staff every layer of a complex GPU deployment on its own, according to Tom Richer (pictured), executive vice president of Alpha Compute Corp.
“You can cobble together a lot of different providers, but then when stuff goes wrong, the finger-pointing starts,” he said. “You just want that integrated solution provider who can ensure success, help you with all of the build-out, then all of the … managed services to keep it going healthy and to keep everything performing in line with [service-level agreements].”
Richer spoke with theCUBE Research’s Dave Vellante at the Dell Technologies New York Symposium, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed managed service support, sovereign AI infrastructure and neocloud financing. (* Disclosure below.)
Managed services support anchors a sovereign neocloud
Alpha Compute moved into AI infrastructure less than a year ago after starting out in digital assets, and it now leads with sovereign and confidential computing powered by Dell Technologies Inc. and Intel Corp. hardware. Its approach, which the company calls sovereign by design, starts at the silicon and keeps data in-country for customers subject to rules such as the EU AI Act and the General Data Protection Regulation, Richer explained.
“We start with the hardware. Think of a stack. All the way down to the chip level, we are creating enclaves,” Richer said. “We’re a Dell partner, so we use Dell technology as well as Intel technology.”
That stack is already running in production. The company’s 72-node St. Louis cluster pairs Nvidia Blackwell systems from Dell with InfiniBand networking and direct liquid cooling inside a retrofitted brownfield data center, and Alpha Compute has outlined plans for additional Blackwell clusters. Alpha Compute announced a binding term sheet for a $31.9 million nonrecourse loan facility secured by Nvidia B300 hardware.
“There’s kind of a trinity there, though. You need the off-taker, a good off-taker,” Richer said. “But also you need that kind of land, power [and] shell.”
Once a cluster is live, Alpha Compute owns the client relationship. Tickets, remediation and hardware returns run through a joint team with Dell, which has made AI factories central to its enterprise strategy. Alpha Compute’s clients to date are AI labs that want the provider managing everything below the operating system. Enterprises are likely to ask for more, according to Richer.
“With Dell as our managed services partner, we can go above the [operating system] on day two,” Richer said. “The powerful thing with Dell and their integrated approach is we can go to any level.”
That depth of managed services support also shapes how Richer sees neoclouds competing. Rather than replacing public cloud, purpose-built providers with no “noisy neighbors” or multitenant sharing will take on the most demanding and sensitive GPU workloads, he explained.
“I really see neoclouds now accompanying and fusing with public cloud for enterprise choices in that hybrid manner,” Richer said. “For those superintelligence workloads that are really demanding, enterprises can send those sensitive, intense high-performance computing workloads over to the neocloud, so they can work in concert.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of the Dell Technologies New York Symposium:
(* Disclosure: TheCUBE is a paid media partner for the Dell Technologies New York Symposium. Neither Dell, the sponsor of theCUBE’s event coverage, nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Photo: SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.