voculinux/AGENTS.md

AGENTS.md — Vocalinux

Voice dictation for Linux: GTK 3 tray app (Python) plus a Next.js marketing site in web/. Default speech engine is whisper.cpp (pywhispercpp); OpenAI Whisper, Vosk, and a user-configured remote API are optional. Do not invent features, user counts, or privacy claims.

Commit attribution

Agents must not add themselves as commit co-authors or add Co-authored-by trailers for agents.

Critical: git worktrees for every branch and PR

Never create a branch, commit, or open a pull request in the primary checkout. Always use a linked git worktree so the main working tree stays on main and stays clean. Do not git switch / git checkout a feature branch in the primary directory, and do not leave it dirty.

git fetch origin
git worktree add /tmp/vocalinux-<task> -b <type>/<short-name> origin/main

# All edits, commits, and `gh pr create` happen inside that worktree.

git worktree remove /tmp/vocalinux-<task>
git worktree prune

Rules:

• One worktree per branch, one branch per PR
• Place worktrees outside the primary working tree (/tmp/vocalinux-<task> or a sibling directory such as ../.worktrees/vocalinux-<task>)
• Never run two tasks in the same worktree
• Never commit directly to main
• Clean up the worktree after the PR is pushed

Toolchain

Piece	Current
Python	>=3.11 (requires-python in pyproject.toml; CI: 3.11–3.14). Floor, classifiers, CI matrix and install.sh must agree — tests/test_python_version_policy.py
GTK	Runtime venv/ uses distro python3-gi (PyGObject), never pip-install it; uv builds the locked PyGObject in the separate dev .venv/ on supported distros
uv	>=0.12,<0.14 ([tool.uv] in pyproject.toml). uv.lock is the source of truth; CI runs uv sync --locked / uv run --locked, which fails on drift
just	https://just.systems or distro package just
Format / lint / types	Black + isort (line length 100), flake8 (E9,F63,F7,F82 only), mypy src/ (targets 3.11 and runs as a CI lint gate). The tools live in the lint dependency group, not the dev extra, so CI can install them without building the project
Website	Next.js / TypeScript in web/ — see web/AGENTS.md

Two virtualenvs, on purpose:

• .venv/ — uv's, for dev tooling. just deps checks native headers before syncing it (on Fedora 40+, install glib2-devel, cairo-gobject-devel, gobject-introspection-devel, libffi-devel and the PortAudio headers); every other Python just recipe uses uv run --no-sync so it does not prune extras that just deps-all installed. No activation needed.
• venv/ — what install.sh builds for the app itself, from the system Python so distro gi is importable.

Never run install.sh from an activated .venv: it drops an inherited VIRTUAL_ENV from PATH and picks $SYSTEM_PYTHON (default /usr/bin/python3) precisely because a venv built from uv's interpreter cannot see distro PyGObject.

Setup

./install.sh --dev                 # system deps + venv + editable install + tests
# non-interactive / no TTY:
./install.sh --dev --auto
./install.sh --dev --auto --no-rebuild-whispercpp   # skip cmake/Vulkan rebuild

source venv/bin/activate

Manual venv (must see distro gi):

uv venv --system-site-packages --python /usr/bin/python3
source venv/bin/activate
# exclude pygobject from uv sync/export:
#   --no-install-package pygobject / --no-emit-package pygobject
uv pip install -e ".[dev,vad]"

install.sh flags: --engine=whisper_cpp|whisper|vosk|remote_api, --test, --skip-models, --venv-dir=PATH. Default engine is whisper_cpp.

Commands

just lint          # flake8 (critical) + black --check + isort --check
just format        # black + isort
just typecheck     # mypy src/ (CI lint gate)
just test          # pytest -v
just test-cov      # pytest --cov=src --cov-report=html
just deps          # sync .venv with dev+vad extras and the lint group
just deps-all      # also whisper/vosk/docs; later recipes use --no-sync so they keep it
just lock          # regenerate uv.lock, requirements/*.txt and the Flatpak dep manifest
just lock-check    # fail if uv.lock is stale vs pyproject.toml
just distro-packages       # regenerate install.d/package_map.sh from YAML
just distro-packages-check # fail if the generated package map is stale
just flatpak-deps       # regenerate the Flatpak dep manifest from runtime + [vad] (needs PyPI)
just flatpak-deps-check # fail if that manifest is behind the export
just model-checksums  # refresh pinned model digests after adding a model
just appimage      # build the AppImage in its pinned base image (needs docker)
just appimage-boot fedora:42   # boot that AppImage in a distro container
just native-packages  # build the .deb and .rpm in the pinned base image (needs docker)
just native-smoke fedora:42  # install the built package in a distro container
just aur-gate      # build canonical sdist + unchanged AUR fixture on current Arch (needs uv/docker)
just install-gate debian:12  # run install.sh unattended in a distro container
just remote-install-gate debian:12  # remote curl|bash path end to end against HEAD (needs docker)
just verify-release  # check a published release as published (needs gh)
just reproducible-wheel  # independent locked wheel builds; stages verified dist/ (needs uv)
just pre-commit    # pre-commit run --all-files
just run-debug     # vocalinux --debug
just run-source-debug

pytest
pytest tests/test_command_processor.py
pytest tests/test_command_processor.py::TestCommandProcessor::test_initialization
pytest -m "not slow"
pytest -m "not integration"
python -m vocalinux.main --debug
python -m vocalinux.main --transcribe-file path/to/audio.wav   # diarized file transcription

Website: web/AGENTS.md, web/PRODUCT.md, web/DESIGN.md. Do not duplicate site commands here.

Dependencies (uv)

Use uv 0.13.3 for just lock and just export-check, matching CI. Other versions in the supported contributor range can order equivalent platform markers differently; export verification compares files byte-for-byte. Update the CI pins and regenerate exports together when changing the generation version.

uv.lock is authoritative. just lock regenerates it, the hash-pinned requirements/*.txt exports, and packaging/flatpak/python3-dependencies.yaml. The AppImage build installs from runtime/vad plus appimage.txt; install.sh consumes the runtime and selected extras with --require-hashes --no-deps --no-build-isolation, then installs the project with --no-deps --no-build-isolation. Do not edit requirements/*.txt by hand, nor the url/sha256 pairs in packaging/flatpak/python3-dependencies.yaml. Change pyproject.toml (or requirements/whisper.in for the Whisper engine, requirements/appimage*.in for the AppImage), run just lock, and commit the lock plus the exports with the manifest change.

Constraint	Rule
PyGObject	The runtime installer uses distro python3-gi via --system-site-packages; do not pip-install it into venv/. The dev .venv/ instead builds the locked version with uv when glib 2.80+ and native headers are available. uv-managed interpreters do not see distro gi unless the venv is created with --system-site-packages
[vosk] extra	Wheel-only on PyPI (no sdist). Never part of a source-buildable lock. install.sh --engine=vosk installs it
Whisper CPU torch	requirements/whisper.txt is compiled from requirements/whisper.in. Pin torch to a +cpu local version — PyPI CUDA wheels win resolution regardless of index order. OpenAI Whisper does not use torchaudio, and the CPU index can lag torch
pywhispercpp	Pinned in install.sh as PYWHISPERCPP_VERSION (keep in sync with uv.lock)
Installer build tools	[dependency-groups].installer-build exports to requirements/installer-build.txt. Bootstrap uses hashed wheels on new and reused venvs; source builds use these tools without build isolation. Its setuptools >=83 floor keeps the pinned installer tools patched; do not add it to [build-system] (Arch). Backend rebuilds select pywhispercpp's complete hash block from runtime.txt via scripts/installer_requirements.py, with --no-deps so they cannot replace the runtime
Release build tools	[dependency-groups].release-build exports to requirements/release-build.txt. scripts/build_reproducible_wheel.py builds in two fresh source trees/venvs with hashed tools and --no-isolation, compares wheel bytes, and stages only canonical distributions in dist/. These build-only venvs exclude system site-packages: host setuptools plugins must not influence locked builds, and packaging does not import GTK. Repeat runs clean recognized diagnostics and staged archives matching retained canonical digests; staged copies are deleted first so interrupted cleanup remains retryable. Unrelated/modified files are preserved and block cleanup. Never wipe all of build/. PR and release CI use Python 3.11 and pinned uv. Failed build outputs/logs stay under build/reproducible-wheel/, excluded from release artifacts
AUR source publication	Use the canonical release sdist, not a GitHub tag archive. scripts/prepare_aur_source.py (run with the locked release-build group) requires its published checksum and provenance from the exact release workflow/tag/commit before preparing a pinned PKGBUILD. Release CI builds/installs that unchanged recipe on current Arch; publication consumes only the gated artifact with updpkgsums: false. PR/local fixtures must explicitly use --local-unattested and are never publication inputs. just aur-gate keeps distributions, diagnostics and tooling in its own temporary directory, leaving shared packaging outputs and dev environments untouched; failures retain that directory and print its path. vocalinux-bin publication depends only on release creation and both AppImages, not the source gate or global checksums. Existing AUR provider stubs/pinned import smoke remain limited as documented in docs/AUR.md
Installer Whisper export	Compiled universally from Python 3.11, constrained by runtime.txt and installer-build.txt to keep shared pins consistent. Uses a +cpu torch pin and best-match index resolution so the CPU index's older copies of shared packages do not downgrade the runtime
Remote installer	After cloning, hand off to the tagged install.sh with the original arguments and remote venv path. The installer and its exports must come from the same revision, including when the tag predates the pinned installer
[vad] extra	onnxruntime for Silero VAD
One export per extra	Every extra in pyproject.toml needs a hash-pinned requirements/<extra>.txt (underscores become dashes), written by a uv export line in just lock. install.sh installs six of them, so an extra with no export is an install path with nothing pinned, which is how [parakeet], [faster_whisper] and [vosk] reached users. tests/test_dependency_exports.py enumerates the extras and the installer's call sites rather than trusting the recipe to stay complete; docs is the one exemption and it carries its reason in EXPORT_EXEMPT
Exports match the lock	just export-check re-runs every uv export line in just lock and fails if a committed export is behind uv.lock. It reads those lines out of the recipe, so an export added there is checked without touching scripts/check_exports.py, and it runs under UV_OFFLINE=1: uv export reads the lock and nothing else. The lint job runs it, because an export named in the recipe and never regenerated is a snapshot, not a pin. uv pip compile targets are out of scope by design (they resolve against live indexes)
AppImage PyGObject	Pinned separately in requirements/appimage.in, and below 3.52: the AppImage bundles its own interpreter and builds PyGObject against the base image's girepository-1.0, while uv.lock's 3.56 needs girepository-2.0 (glib 2.80+)
AppImage build inputs	Base image, tooling, interpreter, shaderc and the Vulkan headers are pinned in packaging/appimage/tool_checksums.txt. Build with just appimage (docker) — building on the host ships the host's glibc, which is what kept the AppImage off Debian 12
AppImage boot matrix	packaging/appimage/boot-test.sh runs the finished AppImage in distro containers, and the matrix in unified-pipeline.yml must keep distros both older and newer than the build image: the old ones prove the glibc floor, the new ones catch a bundle that breaks the host binaries it spawns. A distro added there needs its package recipe in the script — tests/test_appimage_packaging.py checks both
Native packages (.deb / .rpm)	Thin packages built by nfpm in the pinned Debian 12 image (packaging/native/tool_checksums.txt pins the image and the nfpm releases). Python, GTK and PyGObject come from the distro; only pywhispercpp and pynput are vendored under /usr/lib/vocalinux/vendor (unpackaged on Debian/Fedora). packaging/native/smoke-test.sh installs the package per-distro and runs vocalinux --version plus an import smoke — tests/test_native_packaging.py keeps the deps lists, vendored set and CI matrix consistent offline
Snap Python inputs	snap/local/build.py uses requirements/installer-build.txt in an isolated, build-only venv and installs requirements/runtime.txt with hashes, no dependency resolution or build isolation. The project installs without dependencies or index access; never strip PyGObject from pyproject.toml. GI comes from the GNOME extension. Keep portable CPU flags and force the pinned pywhispercpp sdist without a wheel cache. PR/release CI installs the real artifact via snap/local/smoke-test.sh before publication. Native Ubuntu/GNOME/Snapcraft inputs remain channel-controlled, not byte-for-byte reproducible — see docs/SNAP.md
Flatpak deps	packaging/flatpak/python3-dependencies.yaml is generated from requirements/vad.txt (runtime dependencies plus the [vad] extra) by scripts/sync_flatpak_deps.py (just flatpak-deps, which just lock runs itself). It resolves each artifact by the digest uv already recorded, so the Flatpak downloads the bytes in uv.lock; onnxruntime is pinned to CPython wheels for each Flatpak architecture and the GNOME 50 Python version. The project installs there with pip3 install --no-deps, so nothing inside the build evaluates pyproject.toml — tests/test_flatpak_packaging.py checks the invariant offline
Speech models	Verified against digests pinned in src/vocalinux/utils/model_checksums.txt before install, by both install.sh and the runtime downloaders. Fails closed — an unpinned model is refused. Regenerate with just model-checksums (never by hand); tests/test_model_checksums.py fails if it falls behind. whisper.cpp URLs use a pinned Hugging Face commit, never main

Optional extras: vosk, whisper, vad, dev.

Layout

src/vocalinux/
├── main.py, version.py, common_types.py, dbus_service.py, post_processor.py
├── audio/
│   ├── capture.py              # PortAudio capture sources and device handling
│   ├── pipewire.py             # PipeWire system-audio capture
│   └── playback_ducker.py      # lower default sink while dictating
├── single_instance.py          # $XDG_DATA_HOME/vocalinux/instance.lock
├── auto_pause_monitor.py       # unload model while configured apps run
├── model_keepalive.py          # idle unload
├── suspend_handler.py          # logind PrepareForSleep
├── custom_dictionary.py         # terms bias + transcript correction file contracts
├── gateway_embed/               # optional local VocaGateway lifecycle
├── speech_recognition/
│   ├── recognition_manager.py  # VAD, segmentation, and engine dispatch
│   ├── engines/                 # engine implementations and availability
│   ├── command_processor.py    # voice commands
│   ├── command_phrases.py      # voice command phrases and localized forms
│   ├── diarization.py          # TinyDiarize per-speaker file transcription (--transcribe-file / tray)
│   ├── silero_vad.py
│   └── data/                   # bundled silero_vad.onnx
├── text_injection/
│   ├── text_injector.py        # DesktopEnvironment backend selection
│   ├── focused_window.py       # focused application detection
│   ├── remote_desktop_portal.py # Wayland Remote Desktop Portal support
│   └── ibus_engine.py          # Wayland IBus injection
├── ui/
│   ├── tray_indicator.py, settings_dialog.py, settings_about.py
│   ├── settings_engines.py, first_run_dialog.py, dictation_overlay.py
│   ├── dictation_pad.py
│   ├── transcript_dialog.py    # speaker-tagged transcript viewer/export
│   ├── config_manager.py, action_handler.py, audio_feedback.py
│   ├── autostart_manager.py, keyboard_shortcuts.py, notifications.py
│   ├── logging_dialog.py, logging_manager.py, transcription_history.py
│   └── keyboard_backends/      # pynput (X11), evdev (Wayland)
├── utils/
│   ├── paths.py, resource_manager.py, host_process.py
│   ├── update_checker.py, update_monitor.py, gtk_color_scheme.py
│   ├── pywhispercpp_loader.py  # bundled-lib preloader for source-built installs
│   └── whispercpp_model_info.py, vosk_model_info.py
└── resources/                  # SVG icons + WAV cues (also repo resources/)

Also: tests/, docs/, packaging/ (AppImage, AUR, Flatpak, native .deb/.rpm), scripts/, install.sh (bootstrap and orchestration), install.d/ (sourced installer modules), uninstall.sh, web/. scripts/distro-package-map.yaml owns installer package names; install.d/package_map.sh is generated by just distro-packages.

Task	Start here
Voice command	speech_recognition/command_processor.py
Engine / models	speech_recognition/recognition_manager.py
Text injection	text_injection/text_injector.py, focused_window.py, remote_desktop_portal.py, ibus_engine.py
Settings	ui/config_manager.py, ui/settings_dialog.py
Hotkeys	ui/keyboard_shortcuts.py, ui/keyboard_backends/

Style

• Type hints on all function signatures. Protocol interfaces live in common_types.py
• Imports: stdlib → third-party → local (isort black profile)
• Names: PascalCase classes, snake_case functions, UPPER_SNAKE_CASE constants, _private methods
• logger = logging.getLogger(__name__) per module
• Triple-quoted docstrings on modules, classes, and public functions
• Specific exceptions; log errors with context
• subprocess calls that run a host binary pass env=host_env() (utils/host_process.py): a host binary inheriting the AppImage's library paths dies on the wrong GLib. The one spawn of our own interpreter (start_engine_process) passes the environment untouched — it needs the bundle. tests/test_host_process.py walks the AST and fails on either mistake
• Tests: tests/test_*.py, test_* functions, unittest.TestCase or pytest; pytest-mock via mocker
• Markers: @pytest.mark.slow, integration, audio (hardware). Default timeout 10s (pytest-timeout)

Git and PRs

Conventional Commits: type(scope): short description with optional body and Fixes #123.

Types: feat, fix, docs, style, refactor, test, chore.

feat(commands): add "select all" voice command
fix(tray): resolve icon not updating on Wayland
docs(readme): update installation instructions

Branch prefixes: feature/, fix/, docs/, refactor/, test/, release/ (e.g. release/v0.7.0-beta).

• Never push to main. Never commit on main
• Every change goes through a PR (including docs)
• Wait for CI (.github/workflows/unified-pipeline.yml) before asking for merge
• Squash merge
• Do not merge the PR yourself
• Fill .github/PULL_REQUEST_TEMPLATE.md

Releases: follow docs/RELEASE_PROCESS.md. Version source of truth is src/vocalinux/version.py; sync README, docs/INSTALL.md, docs/UPDATE.md, web/src/app/page.tsx, web/package.json. Prep on release/vX.Y.Z-PHASE; tag after merge.

Website

Site-only work: web/AGENTS.md (commands, layout map). Product claims: web/PRODUCT.md. Visual system: web/DESIGN.md. Git/worktree/PR rules are this file — do not duplicate them under web/.

Runtime (any Linux dev machine)

• Create runtime/dev venvs with --system-site-packages. Build-only venvs for scripts/build_reproducible_wheel.py, just aur-gate preparation and snap/local/build.py are the exception: exclude host packages to keep the locked tools isolated; the Snap runtime gets GI from its GNOME command chain. Never prune the developer environment to run a packaging gate
• Kill the app by PID, never pkill -f vocalinux (matches editors, shells, and cwd paths)
• Stale instance: $XDG_DATA_HOME/vocalinux/instance.lock (default ~/.local/share/vocalinux/instance.lock)
• Default dictation shortcut: hold Right Alt (push-to-talk). Existing ~/.config/vocalinux/config.json wins
• Headless speech smoke: pywhispercpp.model.Model + CommandProcessor (first run may download the tiny model)

Update this file when commands, layout, or agent rules change.

Agent skills

Issue tracker

Issues live in Gitea at git.bongbetic.com, managed with the tea CLI. See docs/agents/issue-tracker.md.

Triage labels

Default five-role vocabulary (needs-triage, needs-info, ready-for-agent, ready-for-human, wontfix). See docs/agents/triage-labels.md.

Domain docs

Single-context: one GLOSSARY.md plus docs/adr/ at the repo root. See docs/agents/domain.md.