Mozilla Developing Whisperfile For Local Audio-To-Text Translation

Written by Michael Larabel in Mozilla on 22 August 2024 at 06:59 AM EDT. 12 Comments
MOZILLA
The Mozilla Ocho group leads "innovation and experiments" at Mozilla. Following all of their work on Llamafile for easily distributing large language models as a single file that can be easily executed across different hardware/software, their newest effort is Whisperfile for easy audio-to-text translations.

Whisperfile is a new initiative for easily turning audio into text. As implied by the name, Whisperfile is built around OpenAI's Whisper model for local audio/language translation. Whisperfile is based on the Whisper.cpp sources and is also able to translate non-English audio into English as part of the transcribing process.

Whisperfiles bundle in the weights and can be easily run across Linux, Windows, macOS, FreeBSD, OpenBSD, and NetBSD systems. Whisperfiles currently work on both x86_64 and AArch64.

Whisperfile on HuggingFace


Those wanting to learn more about Whisperfile can do so via Mozilla/whisperfile on HuggingFace.

Longtime followers may also recall that Mozilla previously developed DeepSpeech as an open-source, offline speech-to-text engine. DeepSpeech leveraged TensorFlow and Baidu's Deep Speech research paper. Sadly DeepSpeech development was halted with prior Mozilla layoffs and its GitHub repository hasn't seen any commits now in three years.

For those interested I will be running some Whisperfile benchmarks soon across various CPUs.
Related News
About The Author
Michael Larabel

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.

Popular News This Week