由Google云公司赞助
选择您的第一个基因AI 使用案例
要从基因AI开始，首先关注能够改善人类信息体验的领域。
随着这一举动，中国AI供应商正寻求在开源市场获得优势，同时解决企业对巨额象征性利率的担忧。
3 小读
Getty 图像
周二的DeepSeek将其内部专有的AI推论框架DeepInfer，开源设定为它寻求定位为开源的首选提供者，同时呼吁成本意识的客户。
DeepInfer运行于Nvidia SM100 GPU和Huawei Ascend 950 NPU上以提供离线推断。 销售商选择使用中国芯片制造商华伟和美国AI巨头Nvidia的硬件，是在中国销售商要求减少对Nvidia依赖的推动下产生的。 通过使用两个芯片制造器，DeepSeek可以吸引它的中西部客户。
该引擎是DeepSeek V4.1 Flash的优化层，以其高端代理和编码能力而闻名，使供应商能够在支持的芯片上更有效地运行模型。 该引擎使DeepSeek模型能够更快地生成响应并降低计算成本。
DeepInfer的发布是随着企业寻求削减AI推论成本而来，许多AI模型现在为AI agents提供动力，它们需要大量的代币，这种成本可能令人望而却步。 然而，供应商打开推断框架的举动有助于其企业客户限制这些费用。
称 Lian Jye Su, Omdia的分析师，“消费已经进入屋顶，想法是如果你能以低廉的价格快速地完成一项任务
DeepInfer对企业很有帮助，因为它加速了DeepSeek模型的推论处理，减少了推论工作量所需的GPU数量。
苏称。
虽然开源引擎将有利于在私人，地基基础设施上运行DeepSeek的企业，但使用其他模型的企业可以访问其他开源推论引擎，如Nvidia TensorRT-LLM，这可以加速运行在Nvidia GPU上的大型语言模型。
然而，DeepSeek也正在将DeepInfer推向公众，开源域以为自己的利益，称 Jack Gold,J. Gold Associates的总裁和分析员。
“从市场信息传递的角度来看，他们希望被视作太空中的领头人，所以他们可以做任何事情，将我们展示的称的东西放在那里，对他们有利，对中国来说也很好。”
Gold补充说，DeepSeek从中国芯片制造商华伟手中在硬件上运行引擎对芯片提供商有利，因为它试图建立作为Nvidia可靠替代品的声誉。
“如果有帮助，这对芯片来说是好的。 上面的AI模型看起来不错，"Gold 称。
然而，DeepSeek继续依赖Nvidia的芯片，同时也是显示，尽管大多数中国小贩希望减少对美国AI芯片巨头苏称的依赖，但华威在一些地区仍然落后于Nvidia.
此外，美国和中国之间的政治紧张局势继续加剧，美国禁止联邦机构本周早些时候使用DeepSeek后，星期二愈演愈烈，中国称的举动是企图将技术政治化。
开源的动作“告诉你，DeepSeek相当迷恋创新，” Su 称。 “然后又沉迷于公开提供这些创新想法。”
“如果你已经在使用DeepSeek和其他模型
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Sponsored by Google Cloud
Choosing Your First Generative AI Use Cases
To get started with generative AI, first focus on areas that can improve human experiences with information.
With the move, the Chinese AI vendor is looking to gain an advantage in the open source market, while addressing enterprise concerns about steep token rates.
3 Min Read
Getty Images
DeepSeek on Tuesday made its in-house proprietary AI inference framework, DeepInfer, open source as it seeks to position itself as the open source provider of choice while appealing to cost-conscious customers.
DeepInfer runs on Nvidia SM100 GPUs and Huawei Ascend 950 NPUs to provide offline inference. The vendor’s choice to run on hardware from Chinese chipmaker Huawei and U.S. AI giant Nvidia comes amid a push from Chinese vendors to rely less on Nvidia. By using both chipmakers, DeepSeek can appeal to its Chinese and Western customers.
The engine is an optimization layer for DeepSeek V4.1 Flash, known for its high-end agentic and coding capabilities and enables the vendor to run the model more efficiently on supported chips. The engine enables the DeepSeek models to generate responses faster and reduce compute costs.
The release of DeepInfer comes as enterprises seek to cut AI inference costs, with many AI models now powering AI agents that require large numbers of tokens, a cost that can be prohibitive.. However, the vendor’s move to open up the inference framework could help its enterprise customers limit those expenses.
“There is a lot of discussion around token optimization,” said Lian Jye Su, an analyst at Omdia, a division of Informa TechTarget. “Token consumption has been going through the roof, and the idea is that if you can turn around a task really quickly and at a low cost, it … helps to optimize your AI infrastructure investment.”
DeepInfer is helpful to enterprises because it accelerates inference processing for DeepSeek models, reducing the number of GPUs required for an inference workload.
“You can turn around your workload faster,” Su said.
While the open source engine will benefit businesses running DeepSeek on private, on-premises infrastructure, enterprises that use other models have access to other open source inference engines, such as Nvidia TensorRT-LLM, which speeds up large language models running on Nvidia GPUs.
However, DeepSeek is also moving DeepInfer into the public, open source realm for its own benefit, said Jack Gold, president and analyst at J. Gold Associates.
“From a market messaging perspective, they want to be perceived as the leader in the space, so anything they can do to put stuff out there that says we're exhibiting our leadership is good for them, and it's good for China in general,” he said.
Gold added that the fact that DeepSeek is running the engine on hardware from Chinese chipmaker Huawei is good for the chip provider, as it is trying to build a reputation as a reliable alternative to Nvidia.
“If it helps, it looks good for the chips. It looks good for the AI model on top,” Gold said.
However, DeepSeek’s continued reliance on Nvidia’s chips also shows that Huawei still lags behind Nvidia in some areas, despite most Chinese vendors' desire to be less reliant on the U.S. AI chip giant, Su said.
Moreover, political tension between the U.S. and China continues to increase, mounting on Tuesday after the U.S. banned federal agencies from using DeepSeek earlier this week, a move China said is an attempt to politicize technology.
Meanwhile, its open source move “tells you that DeepSeek is quite obsessed with innovation,” Su said. “And then quite obsessed with open sourcing those innovation ideas.”
“If you're already using DeepSeek versus other models, the idea is that you are a more cost-conscious enterprise,” he added.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.