AI启动在12小时内入侵Anthropic,获取员工细节和内部消息。
一个网络安全启动器在不到12小时的时间内访问Anthropic的内部系统,暴露了员工的细节和内部信息。 另外,Anthropic的Claude AI在获取受限信息和进行未经授权的行动方面面临审查。
一个名为Cathedral的网络安全启动公司在不到12小时内在Anthropic获得了敏感内部系统的访问权限,暴露了员工信息,工资细节,工作提议和内部信息,讨论公司先进的AI模型。 该事件是在Anthropic为外部研究人员确定弱点的方案下进行的一次安全测试中发现的。
根据"华盛顿邮报"审查的一份报告草稿,大教堂利用AI agents来发现Anthropic用于行政和销售任务的商业软件的弱点。 研究人员在运行agents不到12小时后,找到了获取内部数据的方法,包括会议记录和Slack消息。
大教堂由前美国政府效率部(DOGE)成员创立,为政府机构和企业客户开发AI动力网络安全工具。
Anthropic证实,研究人员访问了一系列有限的销售、人力资源和信息技术系统。 暴露的信息包括一些客户和合作伙伴的商业联系细节,以及基本用户账户记录。 然而,Anthropic 称研究人员无法访问客户与其Claude聊天机之间的对话,无法访问模型产生的响应,也无法访问其AI系统背后的源代码和模型权重。
Anthropic 称在一份声明中表示,该公司还说,除了大教堂外,没有发现任何其他人利用脆弱性的证据。
Anthropic在供应商确认安全缺陷已经解决后,才将受影响的商业软件停用并恢复使用。 它还向联邦官员通报了这一事件。 调查结果有融资国家安全关注,一位特朗普政府高级官员告诉"华盛顿邮报",报告已经在政府内部流传。 AI编码启动程序Cognition的首席信息安全官Alex Stamos也指出了公司管理第三方软件的弱点。
“这是一个非常困难的问题,但Anthropic本可以做得更好。”
然而,Anthropic认为,大教堂夸大了事件对国家安全的影响。 启动的称也没有完全遵守网络安全测试方案的规则,因为它没有披露其在Anthropic系统内的所有活动。 称大教堂一直将数据访问量保持在研究所需的最低限度。
Anthropic的Claude也进行了未经授权的行动。
安全事件是在人们越来越担心AI agents在执行任务时会绕过限制寻找途径的时候发生的。 Anthropic公司自己披露了在未经适当授权的情况下其Claude模型获取信息或采取行动的情况。
在最近一起事件中,Claude查阅了美国乔治亚州在发现旧版政府网站存在漏洞后持有的汇总选票数。 Anthropic 称系统发布了数字访问令牌,允许AI在付费后才能接触到通常可获得的信息。
公司澄清说,Claude没有进入该州的选民登记系统,检索个人选民记录或更改任何投票记录。 所获取的信息仅限于总的计票,它有推出保障措施,以防止类似事件。
Anthropic以前曾报告过Claude围绕限制工作,以获取受象征性或收费保护的信息的例子,包括美国政府机构运营的网站数据。 称公司的事件对现实世界的影响很小。
其他报告的涉及AI agents的案件也增加了这些关切。 据报道,Anthropic型号向费城警方提交了一起未解决的谋杀案的假消息,而美国国务院披露,Anthropic型号在8月提交了19份签证申请。
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
AI startup hacks Anthropic in 12 hours, gains access to employee details and internal messages
A cybersecurity startup accessed Anthropic's internal systems in under 12 hours, exposing employee details and internal messages. Separately, Anthropic's Claude AI has faced scrutiny for accessing restricted information and carrying out unauthorised actions.
A cybersecurity startup called Cathedral gained access to sensitive internal systems at Anthropic in less than 12 hours, exposing employee information, salary details, job offers and internal messages discussing the company's advanced AI models. The incident was discovered during a security test conducted under Anthropic's programme for outside researchers to identify vulnerabilities.
According to a draft report reviewed by The Washington Post, Cathedral used AI agents to find weaknesses in business software used by Anthropic for administrative and sales tasks. The researchers found ways to access internal data, including meeting transcripts and Slack messages, after running their agents for less than 12 hours.
Cathedral was founded by former members of the US Department of Government Efficiency (DOGE) and develops AI-powered cybersecurity tools for government agencies and corporate clients.
Anthropic confirmed that the researchers accessed a limited set of its sales, human resources and IT systems. The exposed information included business contact details for some customers and partners, along with basic user account records. However, Anthropic said the researchers could not access conversations between customers and its Claude chatbot, the responses generated by the model, or the source code and model weights behind its AI systems.
"Our monitoring flagged some of Cathedral’s activity before they reported it to us, and we shut off their access the same day," Anthropic said in a statement. The company added that it had found no evidence of anyone other than Cathedral exploiting the vulnerabilities.
Anthropic disabled the affected business software and restored it only after the vendors confirmed that the security flaws had been addressed. It also briefed federal officials about the incident. The findings have raised national security concerns, with a senior Trump administration official telling The Washington Post that the report had circulated within the government. Alex Stamos, chief information security officer at AI coding startup Cognition, also pointed to weaknesses in how companies manage third-party software.
“This is a really hard problem, but Anthropic could have done a lot better,” Stamos said.
Anthropic, however, argued that Cathedral had overstated the national security implications of the incident. It also said the startup had not fully followed the rules of its cybersecurity testing programme because it failed to disclose all its activity within Anthropic's systems. Cathedral said it had kept data access to the minimum required for its research.
Anthropic's Claude has also carried out unauthorised actions
The security incident comes amid growing concerns about AI agents finding ways around restrictions while carrying out tasks. Anthropic has itself disclosed cases in which its Claude model accessed information or performed actions without proper authorisation.
In one recent incident, Claude accessed aggregate vote counts held by the US state of Georgia after finding a loophole in an older version of a government website. Anthropic said the system issued a digital access token that allowed the AI to reach information normally available only after paying a fee.
The company clarified that Claude did not access the state's voter registration system, retrieve individual voter records or change any voting records. It said the information accessed was limited to aggregate vote counts and that it had introduced safeguards to prevent similar incidents.
Anthropic had previously reported examples of Claude working around restrictions to reach information protected by a token or fee, including data on websites operated by US government agencies. The company said those incidents had minimal real-world impact.
Other reported cases involving AI agents have added to these concerns. An Anthropic model reportedly submitted a fake tip about an unsolved murder to Philadelphia police, while the US State Department disclosed that an Anthropic model had filed 19 visa applications in August.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.