Performance

GPU Accelerated Voice Dictation

Leverage your GPU for faster speech recognition. Vocalinux supports AMD, Intel, and NVIDIA GPUs via Vulkan—with automatic fallback to CPU when needed.

Quick Check: Do You Have GPU Support?

Run this command to check if your system supports Vulkan GPU acceleration:

vulkaninfo --summary | grep deviceName

If you see your GPU name, you're ready for accelerated dictation!

Supported GPU Backends

Vulkan

AMD, Intel, NVIDIA

Recommended

Cross-platform GPU API supported by all major GPU vendors. The default and most compatible backend for whisper.cpp.

  • Works with AMD, Intel, and NVIDIA GPUs
  • No vendor-specific drivers required
  • Excellent Linux support
  • Best option for AMD and Intel GPUs

CUDA

NVIDIA only

NVIDIA's proprietary GPU compute platform. High performance but requires NVIDIA GPU and CUDA toolkit.

  • Excellent performance on NVIDIA hardware
  • Mature ecosystem and tooling
  • Works with PyTorch-based Whisper engine

CPU

All systems

Pure CPU processing. Slower but works on any system. Automatic fallback when GPU is unavailable.

  • Works on any hardware
  • No GPU requirements
  • Predictable performance
  • Lowest power consumption option

Model Performance Comparison

Approximate transcription times for 5 seconds of audio. GPU times assume a mid-range Vulkan-compatible GPU.

ModelSizeCPU TimeGPU TimeAccuracyBest For
tiny~39MB~0.5s~0.2sGood for real-timeReal-time dictation, older hardware
base~74MB~0.8s~0.3sBetter accuracyBalanced speed/accuracy
small~244MB~1.5s~0.5sHigh accuracyMost users, good balance
medium~769MB~4s~1.2sVery high accuracyAccuracy-focused use, with GPU
large~1.5GB~8s~2.5sBest accuracyMaximum accuracy, requires GPU

Hardware Requirements

Minimum (CPU-only)

RAM
4GB RAM
Storage
200MB
GPU
None required

Functional but slower processing

Recommended (with GPU)

RAM
8GB RAM
Storage
500MB
GPU
Any Vulkan-compatible GPU

Real-time dictation with small/base models

Optimal

RAM
16GB+ RAM
Storage
2GB+
GPU
NVIDIA RTX or AMD RX series

Real-time with any model including large

Intel GPU Note

Some Intel integrated GPUs don't fully support the compute features needed for whisper.cpp GPU acceleration. Vocalinux v0.7.0+ automatically detects incompatible Intel GPUs and falls back to CPU processing for reliability.

Get Started with GPU Acceleration

The installer automatically detects your GPU and configures the best backend. Just run and go.