Anthropic 信件串将时间缩短为第一个令牌 35% 用于长对话
Anthropic 发布 Message Threads)在其Claude平台上作为公共β. 直到现在,每个API请求都不得不重传整个对话历史。 根据Anthropic,消息线索只传送自上次消息以来的变化,将请求在50万至100万个令牌之间的时间缩短约35%到第一令牌。
编码agents,计算机使用agents,以及处理大量文件或图像的工作流程对称公司最有利。 线程在请求之间保持加密,在5分钟的不活动后失效。 由于Claude仍然阅读了完整的对话历史,Token的用法没有改变。 该功能在Claude平台上工作,并通过AWS,Microsoft创始公司和Google云。 详情见文件。
AI News Without the Hype – 由人类治愈
订阅THE DECODER免费阅读,每周AI通讯,我们独家的"AI雷达"前沿报告每年6次,全面存档访问,访问我们的评论部分。
现在订阅
本文由 AI图鉴自动抓取并翻译,版权归原作者所有;如需查看原文请点下方链接。
Anthropic's Message Threads cut time to first token by 35 percent for long conversations
Anthropic released Message Threads as a public beta on its Claude platform. Until now, every API request had to resend the entire conversation history. Message Threads only transmits what's changed since the last message, cutting time to first token by about 35 percent for requests between 500,000 and one million tokens, according to Anthropic.
Coding agents, computer-use agents, and workflows processing lots of documents or images benefit the most, the company says. The thread stays encrypted in memory between requests and expires after five minutes of inactivity. Token usage doesn't change since Claude still reads the full conversation history. The feature works on the Claude platform and through AWS, Microsoft Foundry, and Google Cloud. Details are in the documentation.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe now
Auto-fetched and translated by AI Atlas. All rights belong to the original author.