Nvidia 发布全能适应性强的尼莫特龙 3.5音频转录和翻译模型
Nvidia Corp. 今天的发布是多语种音频转录和翻译的领跑板获奖公开人工智能模型，同时还有微调 Nemotron 3.5 Trancistic的开放数据管道。
传统的转录AI模型遵循一个工作流程，该工作流程检测语音，转录它，识别和标签不同的扬声器，然后回答有关转录的问题。 Transis用一个单一的型号通行证来做这一切，能够消化和回答大约100小时的音频问题，使用40种语言，最多可以给8个发言者贴标签。
它是一个开放的300亿参数专家混合模型，有40亿有效参数。 这意味着它可以适应合理小的硬件，尽管更强大的硬件让它更快地转录。
对于它的大小，Transis的拳击比它的重量要大得多，并且它可以根据压缩情况从边缘到数据中心的任何地方运行。 该模型运行在单一的Nvidia图形处理单元上，从Jetson AGX Thor，边缘计算机机器人大脑，或DGX Spark，桌面AI超级计算机，一直到布莱克威尔数据中心GPU. Nvidia 称 a Blackwell Server Edition GPU，具有NVFP4精度，四分之一型号压缩在不到3分钟内处理100小时的音频。
据该公司称，Transis 达到是将文字正确化的高精度基准测试，30.8%的误差率出框，在小心的提示下可以降低到20.8%. 对专业工作进行了微调，例如，关于Eka Care印度医学演讲基准测试，该模型的字数误差率为11.8%，大幅降低。
用户可以指导抄录分析或用提示提问。 同一检查站可将录音转换成不同的输出，并有单独的提示。
例如，用户可以指示该模型使用“将录音和给每个发言者贴上标签”，或“将录音译成英文”，或“在本次会议上作出了什么决定？” 用户还可以为模型提供重要的术语或对话框，以帮助其在转录前更好地理解对话，提高准确性。
为了构建模型，Nvidia将Granary v1扩展为Granary v2，该公司庞大的开源公共多语言语音AI数据集。 由Nvidia NeMo Curator建造，v2 扩展在前一代格拉纳里语上占有显著地位，现在覆盖了48种语言的843,579小时和19种源头公司，比约643,000小时和25种语言有了上升。
Granary v2为每张录音以干净的逐字记录风格生成三张记录誊本，可以从Tranlax中快速请求。 一是提供一切，包括“ums”和“ahs”。 另一种说法将完整的措辞简化为数字，如拼写数字改为符号。 三分之一消除了填充词。
所有这一切让开发者利用管道数据将不同语言的抄写修改为可读格式和微调模型输出。
Nvidia 称的数字代表数据集的释放，而不是Transis的全部训练混合物或其取样权重。 然而，Granary v2被用于生产，使其尽可能适应现实世界的翻译，转录和理解。
Translax作为Hugging Face demo提供，开发者可以下载一个检查点，并将其用于微调的域域专业知识。
图片：SiliconANGLE/Microsoft设计师。
SiliconANGLE联合创始人John Furrier的留言：
支持我们的使命，通过与CUBE社区接触，保持内容的开放和自由。 加入CUBE的校友信托网络，其中技术领导者相互连接，分享情报，创造机会。
- 15M+观看CUBE视频，为AI、云层、网络安全等各种对话提供动力
- 11.4k+CUBE校友——通过独特的信任网络与11400多名技术和企业领袖建立联系，塑造未来
你是AWS客户吗？在财务上支持SiliconANGLE，从我们的市场门户页面和链接购买您的AWS服务：https://siliconangle.com/aws-marketplace/.
关于 SiliconANGLE 媒体
SiliconANGLE Media由技术视觉家约翰·弗瑞尔(John Furrier)和戴夫·韦兰特(Dave Vellante)创立，构建了产业领先数字媒体品牌的动态生态系统，达到1500+百万精英技术专业人士。 利用CUBEAi.com神经网络，帮助科技公司以数据为导向做出决策
本文由 AI图鉴自动抓取并翻译，版权归原作者所有；如需查看原文请点下方链接。
Nvidia releases all-in-one adaptable Nemotron 3.5 audio transcription and translation model
Nvidia Corp. today released a leaderboard-winning open artificial intelligence model for multilingual audio transcription and translation, along with an open data pipeline for fine-tuning Nemotron 3.5 Transcribe.
Traditional transcription AI models follow a workflow that detects speech, transcribes it, identifies and labels different speakers, then answers questions about the transcription. Transcribe does all of this in a single model pass and is capable of digesting and answering questions about 100 hours of audio, in 40 languages and can label up to eight speakers.
It’s an open-weight, 30-billion parameter mixture-of-experts model with 4 billion active parameters. That means it can fit on reasonably small hardware, though more powerful hardware lets it transcribe faster.
For its size, Transcribe punches way above its weight and it can run anywhere from the edge to the data center depending on compression. The model runs on a single Nvidia graphics processing unit, from a Jetson AGX Thor, an edge computer robot brain, or DGX Spark, a desktop AI supercomputer, all the way to a Blackwell data-center GPU. Nvidia said a Blackwell Server Edition GPU with NVFP4 precision and one-quarter model compression processes 100 hours of audio in under three minutes.
According to the company, Transcribe hits a high accuracy benchmark for getting words right, with 30.8% error rates out of the box, which can be reduced to 20.8% with careful prompting. Fine-tuned for specialized work, for example, on the Eka Care Indian medical speech benchmark, the model hit 11.8% word error rate, a substantial reduction.
Users can guide transcription analysis or ask questions with prompts. The same checkpoint can turn a recording into different outputs with separate prompts.
For example, a user could instruct the model with, “Transcribe the recording and label each speaker,” or “Translate this audio into English,” or “What decisions were made in this meeting?” or some combination. Users can also provide the model with important jargon or dialogue to help it better understand the conversation before transcribing, improving accuracy.
To build the model, Nvidia extended Granary v1 into Granary v2, the company’s massive open-source public multilingual speech AI dataset. Built with Nvidia NeMo Curator, v2 expands significantly on the previous generation of Granary, which now covers 843,579 hours across 48 languages and 19 source corpora, up from about 643,000 hours and 25 languages.
Granary v2 generates three transcripts for each recording in clean verbatim styles that can be requested from Transcribe with a prompt. One provides everything, including “ums” and “ahs.” Another reduces full wording to figures, such as spelled-out numbers to symbols. A third eliminates filler words.
All that lets developers adapt transcription from different languages using the pipeline data into readable formats and fine-tune model outputs.
Nvidia said the figures represent the dataset release, not Transcribe’s full training mixture or its sampling weights. However, Granary v2 was used in production to make it as adaptable as possible for real-world translation, transcription and understanding.
Transcribe is available as a Hugging Face demo, where developers can download a checkpoint and adapt it for domain expertise with fine-tuning.
Image: SiliconANGLE/Microsoft Designer
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
Are you an AWS customer? Support SiliconANGLE financially by buying your AWS services from our Marketplace portal page and links: https://siliconangle.com/aws-marketplace/
About SiliconANGLE Media
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
Auto-fetched and translated by AI Atlas. All rights belong to the original author.