TranscribePsy Brings a Smaller ASR Footprint to European-Language Devices

QVAC's 254M-parameter TranscribePsy release targets offline speech recognition across European languages, with separate broad-coverage, focused, GGUF, and Core ML builds. Here is how to interpret its benchmarks and evaluate it for a real product.

Source artwork for QVAC TranscribePsy: State-of-the-Art On-Device Multilingual Speech Recognition
Source artwork · Hugging Face / credited contributors ↗
THE SHORT VERSION

TranscribePsy is a promising compact, multilingual ASR option, but teams should validate language-level accuracy, startup behavior, memory, and privacy across their own devices and audio conditions.

QVAC has released TranscribePsy, a family of compact automatic speech recognition models intended for local execution on laptops and phones. The central checkpoint has roughly 254 million parameters, while deployment artifacts cover PyTorch, an 8-bit GGUF build, and a Core ML version optimized for Apple's Neural Engine. The release is notable less because compact ASR is new than because it treats the model, runtime, and language scope as a single deployment problem.

The publisher reports two principal language configurations: a 25-language European model and an eight-language variant focused on Dutch, English, French, German, Italian, Polish, Portuguese, and Spanish. Its published evaluation shows lower word error rates than several similarly sized systems across the test suites where each model was scored. Those results are promising, but adopters should read them as a starting point for product-specific testing, not as a universal accuracy guarantee.

Why the release has multiple checkpoints

A model's parameter count does not fully describe whether it fits a device. Packaging format, numerical precision, runtime support, initialization cost, and the shape of incoming audio all affect the experience. TranscribePsy reflects these layers through four artifacts rather than presenting one checkpoint as equally suitable everywhere.

The 25-language PyTorch model maximizes coverage. The eight-language PyTorch model narrows the language set in pursuit of better accuracy within that set. A GGUF conversion is aimed at CPU execution through the project's C++ engine, while the Core ML artifact is designed for Apple hardware. This separation is useful: a team can select coverage first and runtime second, instead of assuming that a research checkpoint automatically becomes a mobile feature.

It also exposes an important boundary. The broader model uses language-conditional routing outside English, while the focused model uses one set of weights for all eight supported languages. Applications therefore need a deliberate language policy. If the language is known from user settings, explicit routing may be appropriate. If it is inferred per utterance, teams should include routing errors in their evaluation rather than measuring transcription alone.

Reading the benchmark claims carefully

QVAC reports results on the Open ASR Leaderboard aggregation, Multilingual LibriSpeech, and Common Voice. It says the 25-language model reached word error rates of 8.02%, 6.58%, and 21.56% respectively, using a common decoding and normalization pipeline. The eight-language version scored 7.50% and 5.87% on the first two evaluations but was not evaluated on the 24-language Common Voice comparison.

That missing result is not a flaw; it is a reminder to compare only overlapping language coverage. An eight-language model can be the better choice for a constrained product without being the more general model. Similarly, aggregate WER can conceal a weak language, accent, microphone condition, or vocabulary domain. A deployment decision should examine per-language and per-slice errors, especially because the release says a fuller technical report and complete per-language results are still forthcoming.

The device numbers deserve the same discipline. QVAC measured 160 short utterances across eight languages on six phones and reports that TranscribePsy was fastest among the systems tested. It also reports 32.8 seconds to process 40 minutes of audio with Core ML on an iPhone 17 Pro Max. That demonstrates throughput under the stated protocol, but it does not establish streaming latency: the current release processes complete utterances and explicitly does not support streaming.

A practical evaluation plan

Start with audio that resembles the intended workload. A voice-note app should include pauses, clipped beginnings, background media, and long recordings. A dictation tool needs punctuation expectations and specialist vocabulary. Captions need short chunks and a latency budget. Keep separate test slices for every supported language and for code-switching, even if the latter is not an advertised capability.

Measure more than average WER. Track deletion rates for names and numbers, tail latency, peak memory, package size, cold start, battery impact, and behavior after sustained use causes thermal pressure. Report median and slow-tail latency rather than only throughput. For privacy-sensitive use, verify that the entire preprocessing and transcription path stays local; local model execution alone does not prove that an application sends no audio or telemetry elsewhere.

Compare the GGUF and Core ML paths on target hardware instead of extrapolating between them. Neural accelerators and CPUs have different startup costs and scheduling behavior. A continuously warm transcription service may favor throughput, while an occasionally used voice button may be dominated by initialization. The correct artifact depends on the interaction pattern as much as the headline speed.

Boundaries for product teams

The release supports a defined set of European languages, and QVAC warns that unsupported languages may fail unpredictably. It also advises domain fine-tuning when specialist terminology matters and excludes safety-critical use. Those are meaningful limits for medical, legal, emergency, or other high-consequence workflows, where a transcript should not become the sole basis for an automated decision.

TranscribePsy is released with open weights under Apache 2.0, alongside evaluation configurations, but the announcement says the training code and training data are not included. Teams that require full data provenance or end-to-end reproducibility should account for that distinction during review. For many applications, the strongest takeaway is still practical: compact multilingual ASR now offers several device-oriented packaging choices, but the winning choice must be established with representative audio, supported languages, and the actual runtime lifecycle.

Source: QVAC TranscribePsy: State-of-the-Art On-Device Multilingual Speech Recognition ↗. How we write

← Back to all articles