Files
voculinux/tests/test_speech_recognition.py
T
Jatin K MalikandGitHub 1dc1d44665 feat: Alpha Launch v0.2.0 - Complete UX Overhaul 🚀🎤 (#39)
* feat: prepare for v0.2.0-alpha release

* feat: prepare for v0.2.0-alpha release

* chore: remove CHANGELOG.md, use GitHub Releases instead

* refactor: use existing About dialog instead of Settings section

* style: enhance About dialog UI readability

* style: fix formatting with black and isort

* feat: show VAD and silence timeout settings for Whisper engine

- Renamed 'VOSK Settings' to 'Recognition Settings'
- VAD Sensitivity and Silence Timeout now apply to both engines
- Added tooltips explaining each setting
- VOSK-specific model info only shown when VOSK selected

* fix: resolve overlapping UI elements in settings dialog

* fix: save VAD and silence timeout settings for both engines

Previously these settings were only saved when VOSK was selected.
Now they persist correctly for Whisper as well.

* fix: show download progress when selecting undownloaded model

Previously when auto-applying settings, models would download silently
in the background without showing the progress dialog. Now:
- Download progress dialog appears for undownloaded models
- Model icons update correctly after download completes

* feat: add download progress, speed, ETA and cancel button

- Show real download progress percentage for VOSK models
- Display download speed (MB/s) and estimated time remaining
- Add Cancel button to abort downloads
- Update status during extraction phase
- Whisper downloads still pulse (uses internal downloader)

* fix: defer model download until needed, don't block startup

- App now starts instantly even if models aren't downloaded
- Models are downloaded on-demand when selected in Settings
- If user tries to dictate without a model, plays error sound
- Added model_ready property to check if engine is usable

* fix: improve first-run UX without downloaded models

- Settings dialog now defaults to smallest available model, not saved config
- Only show saved model if it's actually downloaded
- Add desktop notification when trying to dictate without a model
- Prevents auto-downloading large models on first launch

* feat: add download progress tracking for Whisper models

- Implement custom Whisper model download with progress/speed/ETA
- Uses OpenAI's CDN URLs directly instead of whisper.load_model()
- Progress callback works the same as VOSK downloads
- Supports cancellation during download

* fix: enable download progress callback for Whisper models

Progress callback was only being set for VOSK downloads, not Whisper.
Now both engines show real-time progress, speed, and ETA.

* fix: update tests for defer_download and config manager mocking

- test_main: Mock ConfigManager to prevent saved config from overriding test values
- test_settings_dialog: Mock ModelDownloadDialog to prevent GTK init errors
- test_speech_recognition: Use proper MockVoskModule class instead of MagicMock, pass defer_download=False for download test
- test_whisper_support: Pass defer_download=False to trigger model loading in test

* fix: resolve test failures for CI

- test_main: Fix ConfigManager patch path to use source module
- test_settings_dialog: Mock _is_vosk_model_downloaded and _is_whisper_model_downloaded to skip download flow, add missing dialog attributes
- test_speech_recognition: Replace recognizer with properly configured mock that returns valid JSON, fixing test isolation issues when running all tests together

* fix: mock _download_whisper_model in whisper test to avoid requests exception handling issue

* fix: add gir1.2-girepository-2.0 dep for PyGObject on Ubuntu 24.04

- Add missing girepository-2.0 package for newer Ubuntu runners
- Use --no-build-isolation for PyGObject to use system packages

* fix: skip PyGObject pip install, use system python3-gi package

- Use --no-deps for editable install to skip PyGObject
- Install other deps explicitly without PyGObject
- Add python3-gi-cairo for complete GTK support
- Removes problematic girepository-2.0 build requirement

* fix: install PyGObject via pip with proper build deps

- Remove python3-gi/python3-gi-cairo (doesn't work with setup-python)
- Install PyGObject from pip after installing build dependencies
- Simplify venv setup without --system-site-packages hack

* Fix GObject

* fix: set GI_TYPELIB_PATH for pip-installed PyGObject to find AppIndicator3
2025-12-28 15:29:51 -08:00

438 lines
16 KiB
Python

"""
Tests for speech recognition functionality.
"""
import concurrent.futures
import sys # Add the missing import
import unittest
from unittest.mock import MagicMock, PropertyMock, call, patch
import pytest
# Create proper mock responses that can be safely JSON serialized
MOCK_VOSK_RESULT = '{"text": "test transcription"}'
# We need to patch the entire vosk Model class and KaldiRecognizer
class MockModel:
def __init__(self, path):
pass
class MockKaldiRecognizer:
def __init__(self, model, rate):
pass
def AcceptWaveform(self, data):
return True
def FinalResult(self):
return MOCK_VOSK_RESULT
def PartialResult(self):
return '{"partial": "test"}'
# Create a proper mock vosk module that uses our custom classes
class MockVoskModule:
Model = MockModel
KaldiRecognizer = MockKaldiRecognizer
# Path modules before importing the recognition_manager
sys.modules["vosk"] = MockVoskModule
# Mock other required modules
sys.modules["pyaudio"] = MagicMock()
sys.modules["numpy"] = MagicMock()
sys.modules["whisper"] = MagicMock()
sys.modules["whisper"].load_model = MagicMock(return_value=MagicMock())
sys.modules["torch"] = MagicMock()
sys.modules["torch"].cuda.is_available = MagicMock(return_value=False)
# Mock tempfile and wave modules to avoid file system issues
mock_tempfile = MagicMock()
mock_temp_file = MagicMock()
mock_temp_file.name = "/tmp/tmpfile.wav"
mock_temp_file.__enter__ = MagicMock(return_value=mock_temp_file)
mock_temp_file.__exit__ = MagicMock(return_value=None)
mock_tempfile.NamedTemporaryFile = MagicMock(return_value=mock_temp_file)
sys.modules["tempfile"] = mock_tempfile
mock_wave = MagicMock()
mock_wave_file = MagicMock()
mock_wave_file.__enter__ = MagicMock(return_value=mock_wave_file)
mock_wave_file.__exit__ = MagicMock(return_value=None)
mock_wave.open = MagicMock(return_value=mock_wave_file)
sys.modules["wave"] = mock_wave
# Update import paths to use the new package structure
from vocalinux.common_types import RecognitionState
from vocalinux.speech_recognition.recognition_manager import SpeechRecognitionManager
class TestSpeechRecognition(unittest.TestCase):
"""Test cases for the speech recognition functionality."""
def setUp(self):
"""Set up for tests."""
# Patch os.makedirs to avoid creating directories
self.patcher_makedirs = patch("os.makedirs")
self.mock_makedirs = self.patcher_makedirs.start()
# Patch os.path.exists to return True for any path
self.patcher_exists = patch("os.path.exists", return_value=True)
self.mock_exists = self.patcher_exists.start()
# Mock the command processor
self.patcher_cmd = patch(
"vocalinux.speech_recognition.recognition_manager.CommandProcessor"
)
self.mock_cmd_class = self.patcher_cmd.start()
self.mock_cmd = MagicMock()
self.mock_cmd_class.return_value = self.mock_cmd
# Mock threading to avoid thread creation
self.patcher_thread = patch(
"vocalinux.speech_recognition.recognition_manager.threading.Thread"
)
self.mock_thread_class = self.patcher_thread.start()
self.mock_thread = MagicMock()
self.mock_thread_class.return_value = self.mock_thread
# Mock audio feedback functions
self.patcher_play_start = patch(
"vocalinux.speech_recognition.recognition_manager.play_start_sound"
)
self.mock_play_start = self.patcher_play_start.start()
self.patcher_play_stop = patch(
"vocalinux.speech_recognition.recognition_manager.play_stop_sound"
)
self.mock_play_stop = self.patcher_play_stop.start()
self.patcher_play_error = patch(
"vocalinux.speech_recognition.recognition_manager.play_error_sound"
)
self.mock_play_error = self.patcher_play_error.start()
# Patch the download method for vosk models
self.patcher_download = patch.object(SpeechRecognitionManager, "_download_vosk_model")
self.mock_download = self.patcher_download.start()
# Patch os.unlink to avoid file removal errors
self.patcher_unlink = patch("os.unlink")
self.mock_unlink = self.patcher_unlink.start()
def tearDown(self):
"""Clean up after tests."""
self.patcher_makedirs.stop()
self.patcher_exists.stop()
self.patcher_cmd.stop()
self.patcher_thread.stop()
self.patcher_play_start.stop()
self.patcher_play_stop.stop()
self.patcher_play_error.stop()
self.patcher_download.stop()
self.patcher_unlink.stop()
def test_init_state(self):
"""Test the initial state of the speech recognition manager."""
# Test VOSK initialization
manager = SpeechRecognitionManager(engine="vosk", model_size="small")
# Verify initial state
self.assertEqual(manager.state, RecognitionState.IDLE)
self.assertEqual(manager.engine, "vosk")
self.assertEqual(manager.model_size, "small")
self.assertFalse(manager.should_record)
self.assertEqual(manager.audio_buffer, [])
self.assertEqual(manager.text_callbacks, [])
self.assertEqual(manager.state_callbacks, [])
self.assertEqual(manager.action_callbacks, [])
# Test Whisper initialization with different model size
manager = SpeechRecognitionManager(engine="whisper", model_size="medium")
# Verify Whisper initialization
self.assertEqual(manager.engine, "whisper")
self.assertEqual(manager.model_size, "medium")
# Test invalid engine
with self.assertRaises(ValueError):
SpeechRecognitionManager(engine="invalid")
def test_callbacks(self):
"""Test registering and using callbacks."""
manager = SpeechRecognitionManager(engine="vosk")
# Replace recognizer with a mock that returns proper JSON
mock_recognizer = MagicMock()
mock_recognizer.FinalResult.return_value = MOCK_VOSK_RESULT
mock_recognizer.AcceptWaveform.return_value = True
manager.recognizer = mock_recognizer
# Create mock callbacks
text_callback = MagicMock()
state_callback = MagicMock()
action_callback = MagicMock()
# Register callbacks
manager.register_text_callback(text_callback)
manager.register_state_callback(state_callback)
manager.register_action_callback(action_callback)
# Verify callbacks were registered
self.assertEqual(manager.text_callbacks, [text_callback])
self.assertEqual(manager.state_callbacks, [state_callback])
self.assertEqual(manager.action_callbacks, [action_callback])
# Test state update
manager._update_state(RecognitionState.LISTENING)
self.assertEqual(manager.state, RecognitionState.LISTENING)
state_callback.assert_called_once_with(RecognitionState.LISTENING)
# Test text processing with callbacks
# Setup command processor mock return values
self.mock_cmd.process_text.return_value = ("processed text", ["action1"])
# Prepare audio buffer for processing
manager.audio_buffer = [b"audio_data"]
# Process the buffer
manager._process_final_buffer()
# Verify command processor was called
self.mock_cmd.process_text.assert_called_once_with("test transcription")
# Verify text callback was called
text_callback.assert_called_once_with("processed text")
# Verify action callback was called
action_callback.assert_called_once_with("action1")
def test_vosk_model_path(self):
"""Test getting the VOSK model path based on size."""
with patch.object(SpeechRecognitionManager, "_get_vosk_model_path") as mock_get_path:
# Test small model size
mock_get_path.return_value = "/path/to/vosk-model-small-en-us-0.15"
manager_small = SpeechRecognitionManager(engine="vosk", model_size="small")
# Verify the small model path is constructed correctly
mock_get_path.assert_called_with()
# Test medium model size
mock_get_path.return_value = "/path/to/vosk-model-en-us-0.22"
manager_medium = SpeechRecognitionManager(engine="vosk", model_size="medium")
# Verify the medium model path is constructed correctly
mock_get_path.assert_called_with()
# Test large model size
mock_get_path.return_value = "/path/to/vosk-model-en-us-0.42"
manager_large = SpeechRecognitionManager(engine="vosk", model_size="large")
# Verify the large model path is constructed correctly
mock_get_path.assert_called_with()
def test_download_vosk_model(self):
"""Test downloading VOSK model."""
# Make os.path.exists return False to trigger download
with patch("os.path.exists", return_value=False):
# Instantiate manager with defer_download=False to trigger download
manager = SpeechRecognitionManager(
engine="vosk", model_size="small", defer_download=False
)
# Verify download was attempted
self.mock_download.assert_called_once()
def test_start_recognition(self):
"""Test starting speech recognition."""
# Create a manager
manager = SpeechRecognitionManager(engine="vosk")
# Reset mock for clean test
self.mock_thread_class.reset_mock()
self.mock_play_start.reset_mock()
# Start recognition
manager.start_recognition()
# Verify state changed
self.assertEqual(manager.state, RecognitionState.LISTENING)
# Verify start sound was played
self.mock_play_start.assert_called_once()
# Verify recording flag was set
self.assertTrue(manager.should_record)
# Verify threads were started
self.assertEqual(self.mock_thread_class.call_count, 2)
self.mock_thread.start.assert_called()
# Try starting when already listening
self.mock_thread_class.reset_mock()
manager.start_recognition()
# Should not start again
self.mock_thread_class.assert_not_called()
def test_stop_recognition(self):
"""Test stopping speech recognition."""
# Create a manager
manager = SpeechRecognitionManager(engine="vosk")
# Setup manager state
manager.state = RecognitionState.LISTENING
manager.should_record = True
manager.audio_thread = self.mock_thread
manager.recognition_thread = self.mock_thread
# Reset mocks
self.mock_play_stop.reset_mock()
# Stop recognition
manager.stop_recognition()
# Verify state changed
self.assertEqual(manager.state, RecognitionState.IDLE)
# Verify stop sound was played
self.mock_play_stop.assert_called_once()
# Verify recording flag was cleared
self.assertFalse(manager.should_record)
# Verify threads were joined
self.mock_thread.join.assert_called()
def test_record_audio(self):
"""Test recording audio with simulated voice activity."""
# This test would be complex due to audio processing, just test basic setup
manager = SpeechRecognitionManager(engine="vosk")
manager.should_record = True
# Skip detailed testing of the audio recording function
self.assertTrue(hasattr(manager, "_record_audio"))
def test_process_final_buffer_vosk(self):
"""Test processing the final audio buffer with VOSK."""
# Setup manager
manager = SpeechRecognitionManager(engine="vosk")
# Replace recognizer with a mock that returns proper JSON
mock_recognizer = MagicMock()
mock_recognizer.FinalResult.return_value = MOCK_VOSK_RESULT
mock_recognizer.AcceptWaveform.return_value = True
manager.recognizer = mock_recognizer
# Setup command processor mock
self.mock_cmd.process_text.return_value = ("processed text", ["action1"])
# Register mock callbacks
text_callback = MagicMock()
action_callback = MagicMock()
manager.register_text_callback(text_callback)
manager.register_action_callback(action_callback)
# Prepare audio buffer
manager.audio_buffer = [b"audio_data1", b"audio_data2"]
# Process the buffer
manager._process_final_buffer()
# Verify command processor was called
self.mock_cmd.process_text.assert_called_once_with("test transcription")
# Verify callbacks were called
text_callback.assert_called_once_with("processed text")
action_callback.assert_called_once_with("action1")
def test_process_final_buffer_whisper(self):
"""Test processing the final audio buffer with Whisper."""
# Skip the problematic file operations by creating a mock implementation
# of the _process_final_buffer method
with patch.object(SpeechRecognitionManager, "_process_final_buffer") as mock_process:
# Setup manager with whisper engine (this should work now with mocked torch)
manager = SpeechRecognitionManager(engine="whisper")
# Setup side effect function that will be called when _process_final_buffer is called
def process_side_effect():
# Access transcription result directly from the model
result = {"text": "whisper transcription"}
# Simulate processing the result through command processor
processed_text, actions = self.mock_cmd.process_text("whisper transcription")
# Call callbacks as the real method would
for callback in manager.text_callbacks:
callback(processed_text)
for callback in manager.action_callbacks:
for action in actions:
callback(action)
# Set the side effect
mock_process.side_effect = process_side_effect
# Set up a mock model just for completeness
whisper_model = MagicMock()
whisper_model.transcribe.return_value = {"text": "whisper transcription"}
manager.model = whisper_model
# Setup command processor mock
self.mock_cmd.process_text.return_value = ("processed whisper", ["action2"])
# Register mock callbacks
text_callback = MagicMock()
action_callback = MagicMock()
manager.register_text_callback(text_callback)
manager.register_action_callback(action_callback)
# Prepare audio buffer (not actually used because we're mocking the method)
manager.audio_buffer = [b"audio_data1", b"audio_data2"]
# Call the mocked process method
manager._process_final_buffer()
# Verify command processor was called with expected text
self.mock_cmd.process_text.assert_called_once_with("whisper transcription")
# Verify callbacks were called with expected values
text_callback.assert_called_once_with("processed whisper")
action_callback.assert_called_once_with("action2")
def test_empty_buffer(self):
"""Test processing an empty buffer."""
# Setup manager
manager = SpeechRecognitionManager(engine="vosk")
# Process empty buffer
manager.audio_buffer = []
manager._process_final_buffer()
# Verify command processor was not called
self.mock_cmd.process_text.assert_not_called()
def test_configure(self):
"""Test configuring recognition parameters."""
# Setup manager
manager = SpeechRecognitionManager(engine="vosk")
# Default values
self.assertEqual(manager.vad_sensitivity, 3)
self.assertEqual(manager.silence_timeout, 2.0)
# Configure with valid values
manager.reconfigure(vad_sensitivity=4, silence_timeout=1.5)
self.assertEqual(manager.vad_sensitivity, 4)
self.assertEqual(manager.silence_timeout, 1.5)
# Configure with out-of-range values
manager.reconfigure(vad_sensitivity=10, silence_timeout=10.0)
self.assertEqual(manager.vad_sensitivity, 5) # Clamped to max
self.assertEqual(manager.silence_timeout, 5.0) # Clamped to max
manager.reconfigure(vad_sensitivity=0, silence_timeout=0.2)
self.assertEqual(manager.vad_sensitivity, 1) # Clamped to min
self.assertEqual(manager.silence_timeout, 0.5) # Clamped to min