Skip to content

Add Cohere Transcribe STT support #129

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
beshkenadze wants to merge 9 commits into
base: main
Choose a base branch
from
Open

Add Cohere Transcribe STT support #129

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
8195c46
Add agent guidance for MLX metallib builds
beshkenadze Mar 27, 2026
5f296a8
Add Cohere Transcribe model implementation
beshkenadze Mar 27, 2026
15659c3
Wire Cohere Transcribe into CLI and docs
beshkenadze Mar 27, 2026
018d172
Add Cohere Transcribe tests
beshkenadze Mar 27, 2026
a7ff8f0
Merge branch 'main' into draft/cohere-transcribe-experimental
beshkenadze Mar 27, 2026
ee2e20e
Fix Cohere fixture weight normalization
beshkenadze Mar 27, 2026
d2a1441
fix: align Cohere prompt token order
beshkenadze Mar 29, 2026
d8d8aba
Merge branch 'main' into draft/cohere-transcribe-experimental
beshkenadze Mar 29, 2026
d216e3c
feat: support quantized Cohere checkpoints
beshkenadze Mar 30, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CLAUDE.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Project notes for agents

- Build and test MLX targets with Xcode/xcodebuild on macOS/Apple Silicon so the default metallib is produced and bundled correctly.
- If you see `Failed to load the default metallib`, verify the bundle path (`default.metallib` / `mlx.metallib`) or use `DYLD_FRAMEWORK_PATH` for shell runs.
3 changes: 2 additions & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ MLXAudio follows a modular design allowing you to import only what you need:
- **MLXAudioCore**: Base types, protocols, and utilities
- **MLXAudioCodecs**: Audio codec implementations (SNAC, Encodec, Vocos, Mimi, DACVAE)
- **MLXAudioTTS**: Text-to-Speech models (Qwen3-TTS, Fish Audio S2 Pro, Soprano, VyvoTTS, Orpheus, Marvis TTS, Pocket TTS)
- **MLXAudioSTT**: Speech-to-Text models (Qwen3-ASR, Voxtral Realtime, Parakeet, GLMASR)
- **MLXAudioSTT**: Speech-to-Text models (Qwen3-ASR, Voxtral Realtime, Cohere Transcribe, Parakeet, GLMASR)
- **MLXAudioVAD**: Voice Activity Detection & Speaker Diarization (Sortformer, SmartTurn)
- **MLXAudioSTS**: Speech-to-Speech models (LFM2.5-Audio, SAM-Audio, MossFormer2-SE)
- **MLXAudioUI**: SwiftUI components for audio interfaces
Expand Down Expand Up @@ -133,6 +133,7 @@ for try await event in model.generateStream(text: text, parameters: parameters)
| Qwen3-ASR | [Qwen3-ASR README](Sources/MLXAudioSTT/Models/Qwen3ASR/README.md) | [mlx-community/Qwen3-ASR-1.7B-bf16](https://huggingface.co/mlx-community/Qwen3-ASR-1.7B-bf16) |
| Qwen3-ForcedAligner | [Qwen3-ASR README](Sources/MLXAudioSTT/Models/Qwen3ASR/README.md) | [mlx-community/Qwen3-ForcedAligner-0.6B-bf16](https://huggingface.co/mlx-community/Qwen3-ForcedAligner-0.6B-bf16) |
| Voxtral Realtime | [Voxtral README](Sources/MLXAudioSTT/Models/VoxtralRealtime/README.md) | [mlx-community/Voxtral-Mini-4B-Realtime-2602-fp16](https://huggingface.co/mlx-community/Voxtral-Mini-4B-Realtime-2602-fp16) |
| Cohere Transcribe | [Cohere Transcribe README](Sources/MLXAudioSTT/Models/CohereTranscribe/README.md) | [beshkenadze/cohere-transcribe-03-2026-mlx-fp16](https://huggingface.co/beshkenadze/cohere-transcribe-03-2026-mlx-fp16) |
| Parakeet | [Parakeet README](Sources/MLXAudioSTT/Models/Parakeet/README.md) | [mlx-community/parakeet-tdt-0.6b-v3](https://huggingface.co/mlx-community/parakeet-tdt-0.6b-v3) |
| GLMASR | [GLMASR README](Sources/MLXAudioSTT/Models/GLMASR/README.md) | [mlx-community/GLM-ASR-Nano-2512-4bit](https://huggingface.co/mlx-community/GLM-ASR-Nano-2512-4bit) |

Expand Down
Loading
Loading