How to Use OpenAI Whisper on Mac (No Terminal Required)

OpenAI Whisper is the open-source speech recognition model that powers most modern Mac dictation apps. You don't need to touch a terminal to use it — but it helps to understand what's actually running on your Mac when you do.

What is Whisper?

Whisper is an automatic speech recognition (ASR) model that OpenAI released in late 2022 and updated through 2024 with large-v3 and turbo variants. It's open weights — meaning anyone can download the model and run it locally — and it supports 90+ languages with state-of-the-art accuracy.

Three things matter about Whisper:

1. It's open. Apps don't pay per-minute API fees the way they would for a hosted speech-recognition service. That's why local Whisper apps can charge a one-time price (JustVoice is $35 once) instead of a recurring cloud subscription.
2. It runs on your machine. With GPU acceleration on Apple Silicon, it's faster than real-time. No cloud round-trip.
3. It's accurate. Whisper is competitive with or exceeds commercial speech recognition (Dragon, Apple, Google) on most benchmarks, especially for technical and multilingual content.

Whisper model sizes

Whisper ships in several sizes, each with a different accuracy-vs-speed-vs-RAM tradeoff:

How to run Whisper on Mac

Option 1: Use a Mac app that wraps Whisper (recommended)

The path of least resistance. These apps download the model for you, handle GPU acceleration, and give you a hotkey to dictate into any app:

• JustVoice — local Whisper with code mode, custom vocabulary, and snippets. Free to download; $35 one-time license, no subscription. Download here.
• Superwhisper — local Whisper with AI modes. Multi-platform.
• MacWhisper — file transcription specialist with diarisation.
• VoiceInk — open-source Whisper dictation.

1. Download JustVoice.
2. Install it (drag to Applications).
3. Grant microphone and accessibility permissions when prompted.
4. JustVoice ships with base by default, and the $35 license includes every Whisper model size — up to large-v3 — with nothing held back behind a higher tier.
5. Hold your hotkey (default: Right Option), speak, release. The audio is transcribed locally on your Mac's GPU and the text appears at your cursor.

Option 2: Run Whisper from the command line (for tinkerers)

If you'd rather use the official Python implementation:

pip install -U openai-whisper
brew install ffmpeg
whisper your-audio.mp3 --model small

This works but isn't a great daily-driver — there's no hotkey integration, no system-wide dictation, and the Python implementation isn't as fast as the optimised Metal-accelerated builds in apps like JustVoice.

Option 3: whisper.cpp for the truly minimalist

git clone https://github.com/ggerganov/whisper.cpp
cd whisper.cpp
make
./models/download-ggml-model.sh small
./main -m models/ggml-small.bin -f your-audio.wav

Same caveat: powerful, but you're still building the rest of the app — hotkey, app-targeting, text insertion, custom vocabulary — yourself.

GPU acceleration on Apple Silicon

The reason Whisper feels fast on Mac is the Metal Performance Shaders (MPS) backend, which runs the model on the GPU instead of the CPU. The speedup over CPU-only is roughly 5–10x on Apple Silicon.

If you're using a Mac app that wraps Whisper, GPU acceleration is on by default. If you're running the Python version, it's CPU-only unless you use the MLX or PyTorch-MPS variant.

On Intel Macs, Whisper runs CPU-only and is meaningfully slower. It still works for dictation, just don't expect real-time.

Whisper accuracy: what to expect

On clean audio, native English, modern microphone:

• tiny: ~10–15% word error rate (WER) on technical content
• base: ~5–8% WER
• small: ~3–5% WER
• medium: ~2–4% WER
• large-v3: ~1–3% WER

Whisper degrades gracefully with noise, accents, and overlapping speech — but it does degrade. A noisy coffee shop with a bad microphone will hurt accuracy regardless of model size.

Custom vocabulary: the unsung accuracy hack

Whisper has no concept of "your vocabulary" out of the box. But the apps that wrap it do — JustVoice, Superwhisper, and similar tools let you add custom terms (drug names, library names, project nouns, character names) that the app injects as prompt context. Once added, those terms transcribe correctly.

This is the single biggest accuracy improvement most users can make. Add 50 of your most-used technical or domain-specific terms and Whisper stops mangling them.

Should you run Whisper locally or use a cloud service?

Local Whisper:

• Privacy: audio never leaves your Mac
• Cost: no per-minute fees
• Latency: no network round-trip
• Reliability: works offline

• No model download or local compute requirements
• Sometimes faster on very old hardware
• Cross-platform / cross-device sync (depending on service)

Get started

The fastest path: Download JustVoice for Mac. It's free, ships with a Whisper model, and works five minutes after install.

If you'd rather research more options first, see our comparison of every major Mac dictation app.

---