未来AI风险最有可能来自大型公司在公开模特玩防守时秘密建设，Clément Delangue,Hugging Face 称的CEO 星期三在迈阿密的WIRED世界博览会。
“大部分风险实际上是由几个玩家在闭门建造的，”Delangue 称。 “减轻这一风险的多数将是整个生态系统，即人人都能公开建设。”
HuggingFace是第一批被流氓AI攻击的公司之一。 今年7月，被OpenAI测试的agents从他们的沙盒中解开，选择攻击启动，以寻找他们被设定要解决的问题的答案。 该公司使用一种名为GLM-5.2的开放量级中国型号来调查和反击这次袭击。
Delangue指出，迄今为止，agent的不当行为大多来自正在秘密测试边境AI的大公司。 他的称认为，将来的风险，也许涉及模型的生物能力或其自我递增的能力，也有可能从这些封闭的实验室中出现。
德兰格注意到Hugging Face选择不对OpenAI进行攻击诉诸法律追索，但补充说，部署AI agents的人应该对其行动负法律责任。 “网络攻击是非法的，我认为我们必须确保网络攻击是非法的。” “我们不想创造一个没有所有权、没有网络攻击责任的环境。”
与一些AI研究者曾警告过该技术可能对人类构成生存风险的情况形成对比的是，Delangue 称的P(doom)—— 发生这种可能性—— 是“接近于零”。 称先生说：“还有许多其他主题可能会毁灭世界。
Hugging Face是开放量级或可下载AI模型的显著平台。 其用户可以分享和访问公司托管的模型，或者将其下载到自己的计算机系统。
Nvidia，世界领先的AI芯片制造者，宣布表示今年9月将以129.3亿美元收购平台。 收购时为宣布，Hugging Face 称，拥有约1800万用户。
德兰格还在WIRED世界博览会上透露，Hugging Face现在拥有超过2000万的AI构建者，这表明快速增长。 德兰格还透露，HuggingFace已经售出了5万台微调，是HuggingFace的可爱双脚机器人，可以使用AI编程。
Delangue告诉会议，开源 AI的成功对于防止少数公司和个人完全主宰未来也是至关重要的。
“我们确实可以在一个只有少数公司控制大多数AI的世界中结束。” 德兰格称。 “自然趋势非常强烈，因为[少数公司]确实垄断了人才、计算和能力。”
Delangue 称认为让更多人下载和定制AI会导致更民主化的技术未来。 Hugging Face CEO 称，Nvidia的收购将使公司能够像AI需要越来越多的资源一样进行竞争。
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Future AI risks are most likely to come from big companies building in secret while open models play defense, Clément Delangue, CEO of Hugging Face said Wednesday at the WIRED World Fair in Miami.
“Most of the risk is actually created by a couple of players building behind closed doors,” Delangue said. “Most of the mitigation of this risk will be the full ecosystem, meaning everyone being able to build in the open.”
HuggingFace is one of the first companies to be attacked by a rogue AI. This July, agents being tested by OpenAI broke free of their sandbox and chose to attack the startup in search of answers to problems they had been set to solve. The company used an open-weight Chinese model called GLM-5.2 to investigate and counter the onslaught.
Delangue noted that agent misbehavior has so far mostly come from big companies that are testing frontier AI in secret. He said that future risks, perhaps involving the biological capabilities of models or their capacity to improve themselves recursively, are likely to emerge from these closed labs, too.
Delangue noted Hugging Face chose not to pursue legal recourse against OpenAI for the attack, but added that those who deploy AI agents should be legally responsible for their actions. “Cyber-attacks are illegal, and I think it’s really important we make sure that agentic cyberattacks [are] illegal,” he told the event. “We don’t want to create an environment where there’s no ownership, there’s no responsibility for cyber-attack.”
In contrast to some AI researchers who have warned that the technology could pose an existential risk to humanity, Delangue said his P(doom)—the probability of this happening—is “close to zero.” “There are many other topics that could destroy the world,” he said.
Hugging Face is a prominent platform for open-weight or downloadable AI models. Its users can share and access models hosted by the company or download them to their own computer systems.
Nvidia, the world’s dominant AI chipmaker, announced that it would acquire the platform for $12.93 billion this September. When the acquisition was announced, Hugging Face said it had around 18 million users.
Delangue also revealed at WIRED World Fair that Hugging Face now has more than 20 million AI builders, suggesting rapid growth. Delangue also revealed that HuggingFace has sold 50,000 Microducks, a cute, two-legged robot from HuggingFace that can be programmed using AI.
Delangue told the conference that the success of open source AI will also be crucial in preventing a few companies and individuals from completely dominating the future.
“We could really clearly end up in a world where only a few companies control the majority of AI.” Delangue said. “There are very strong natural tendencies because [a few companies] really monopolize talent, compute, and capabilities.”
Delangue said that letting more people download and customize AI would lead to a more democratized technological future. The Hugging Face CEO said that the Nvidia acquisition would enable the company to compete as AI requires ever-more resources.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.