matthartman

ghost-pepper

AI#macOS#Whisper#LLM#Speech-to-Text#Swift

// summary

Ghost Pepper is a privacy-focused macOS application that provides local speech-to-text transcription without relying on cloud APIs. Users simply hold the Control key to record audio, which is then transcribed and automatically pasted into any text field. The app utilizes local models for both speech recognition and text cleanup to ensure that no data ever leaves the user's machine.

// technical analysis

Ghost Pepper is a macOS utility designed to provide private, hold-to-talk speech-to-text functionality by leveraging local machine learning models. By utilizing WhisperKit for transcription and LLM.swift for text cleanup, the application eliminates the need for cloud-based APIs, ensuring that all user data remains strictly on the local device. This architecture prioritizes user privacy and performance by offloading heavy computational tasks to Apple Silicon, offering a high-performance alternative to cloud-dependent dictation services.

// key highlights

Operates entirely offline on Apple Silicon to ensure maximum user privacy and data security.

Features a hold-to-talk mechanism that automatically transcribes and pastes text into any active field upon release.

Integrates local LLMs to perform smart cleanup, effectively removing filler words and correcting self-corrections in real-time.

Provides a lightweight menu bar interface that supports automatic login and customizable settings for a seamless user experience.

Supports multiple speech and cleanup model sizes, allowing users to balance between processing speed and transcription accuracy.

Includes enterprise-ready support for MDM deployment, enabling IT administrators to pre-approve necessary accessibility permissions.

// use cases

Hold-to-talk transcription that automatically pastes text into any application.

Automatic cleanup of filler words and self-corrections using local LLMs.

Private, offline voice-to-text processing for enhanced data security.

// getting started

To begin using Ghost Pepper, download the DMG file from the releases page, move the application to your Applications folder, and grant the requested Microphone and Accessibility permissions. Once installed, simply hold the Control key to record your voice and release it to have the transcribed text automatically pasted into your active application.