Some checks failed
ClawSweeper Dispatch / dispatch (push) Has been cancelled
CodeQL / Security High (actions) (push) Has been cancelled
CodeQL / Security High (channel-runtime-boundary) (push) Has been cancelled
CodeQL / Security High (core-auth-secrets) (push) Has been cancelled
CodeQL / Security High (mcp-process-tool-boundary) (push) Has been cancelled
CodeQL / Security High (network-ssrf-boundary) (push) Has been cancelled
CodeQL / Security High (plugin-trust-boundary) (push) Has been cancelled
CodeQL / Security High (process-exec-boundary) (push) Has been cancelled
Docs Sync Publish Repo / sync-publish-repo (push) Has been cancelled
Docs / docs (push) Has been cancelled
OpenClaw Stable Main Closeout / Resolve stable release closeout inputs (push) Has been cancelled
OpenClaw Stable Main Closeout / Verify stable main closeout (push) Has been cancelled
Workflow Sanity / no-tabs (push) Has been cancelled
Workflow Sanity / actionlint (push) Has been cancelled
Workflow Sanity / generated-doc-baselines (push) Has been cancelled
CI / runner-admission (push) Has been cancelled
CI / preflight (push) Has been cancelled
CI / security-fast (push) Has been cancelled
CI / pnpm-store-warmup (push) Has been cancelled
CI / build-artifacts (push) Has been cancelled
CI / native-i18n (push) Has been cancelled
CI / ${{ matrix.check_name }} (push) Has been cancelled
CI / ${{ matrix.checkName }} (push) Has been cancelled
CI / checks-node-compat-node22 (push) Has been cancelled
CI / check-bundled-channel-config-metadata (push) Has been cancelled
CI / check-dependencies (push) Has been cancelled
CI / check-guards (push) Has been cancelled
CI / check-lint (push) Has been cancelled
CI / check-prod-types (push) Has been cancelled
CI / check-shrinkwrap (push) Has been cancelled
CI / check-test-types (push) Has been cancelled
CI / check-additional-boundaries-a (push) Has been cancelled
CI / check-additional-boundaries-bcd (push) Has been cancelled
CI / check-additional-extension-bundled (push) Has been cancelled
CI / check-additional-extension-channels (push) Has been cancelled
CI / check-additional-extension-package-boundary (push) Has been cancelled
CI / check-additional-runtime-topology-architecture (push) Has been cancelled
CI / check-session-accessor-boundary (push) Has been cancelled
CI / check-session-transcript-reader-boundary (push) Has been cancelled
CI / check-docs (push) Has been cancelled
CI / skills-python (push) Has been cancelled
CI / macos-swift (push) Has been cancelled
CI / ios-build (push) Has been cancelled
CI / ci-timings-summary (push) Has been cancelled
Native App Locale Refresh / Refresh native fa (push) Has been cancelled
Native App Locale Refresh / Refresh native fr (push) Has been cancelled
Native App Locale Refresh / Refresh native hi (push) Has been cancelled
Native App Locale Refresh / Refresh native id (push) Has been cancelled
Native App Locale Refresh / Refresh native it (push) Has been cancelled
Native App Locale Refresh / Refresh native ja-JP (push) Has been cancelled
Control UI Locale Refresh / plan (push) Has been cancelled
Control UI Locale Refresh / Refresh ${{ matrix.locale }} (push) Has been cancelled
Control UI Locale Refresh / Commit control UI locale refresh (push) Has been cancelled
Live Media Runner Image / Build live media runner image (push) Has been cancelled
Native App Locale Refresh / Refresh native ar (push) Has been cancelled
Native App Locale Refresh / Refresh native de (push) Has been cancelled
Native App Locale Refresh / Refresh native es (push) Has been cancelled
Native App Locale Refresh / Refresh native ko (push) Has been cancelled
Native App Locale Refresh / Refresh native nl (push) Has been cancelled
Native App Locale Refresh / Refresh native pl (push) Has been cancelled
Native App Locale Refresh / Refresh native pt-BR (push) Has been cancelled
Native App Locale Refresh / Refresh native ru (push) Has been cancelled
Native App Locale Refresh / Refresh native sv (push) Has been cancelled
Native App Locale Refresh / Refresh native th (push) Has been cancelled
Native App Locale Refresh / Refresh native tr (push) Has been cancelled
Native App Locale Refresh / Refresh native uk (push) Has been cancelled
Native App Locale Refresh / Refresh native vi (push) Has been cancelled
Native App Locale Refresh / Refresh native zh-CN (push) Has been cancelled
Native App Locale Refresh / Refresh native zh-TW (push) Has been cancelled
Native App Locale Refresh / Commit native locale refresh (push) Has been cancelled
Plugin Init Scaffold Validation / Validate provider scaffold (push) Has been cancelled
Plugin NPM Release / preview_plugins_npm (push) Has been cancelled
Plugin NPM Release / Validate release publish approval (push) Has been cancelled
Plugin NPM Release / preview_plugin_pack (push) Has been cancelled
Plugin NPM Release / publish_plugins_npm (push) Has been cancelled
Sandbox Common Smoke / sandbox-common-smoke (push) Has been cancelled
Website Installer Sync / static (push) Has been cancelled
Website Installer Sync / linux-docker (push) Has been cancelled
Website Installer Sync / macos-installer (push) Has been cancelled
Website Installer Sync / windows-installer (push) Has been cancelled
Website Installer Sync / sync-website (push) Has been cancelled
Adolf is a fork/vendored clone of github.com/openclaw/openclaw (v2026.6.11), free to diverge. Tree copied sans upstream .git; upstream remote added for future syncs. Node pinned to 24 (.nvmrc); engines already require >=22.19. Preserves docs/ARCHITECTURE.md. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01LeqyaxJF2nbRXJtae2kNB2
132 lines
4.8 KiB
Markdown
132 lines
4.8 KiB
Markdown
---
|
|
summary: "Use ElevenLabs speech, Scribe STT, and realtime transcription with OpenClaw"
|
|
read_when:
|
|
- You want ElevenLabs text-to-speech in OpenClaw
|
|
- You want ElevenLabs Scribe speech-to-text for audio attachments
|
|
- You want ElevenLabs realtime transcription for Voice Call or Google Meet
|
|
title: "ElevenLabs"
|
|
---
|
|
|
|
OpenClaw uses ElevenLabs for text-to-speech, batch speech-to-text with Scribe
|
|
v2, and streaming STT with Scribe v2 Realtime. The plugin is bundled and
|
|
enabled by default; no `plugins install` step is needed.
|
|
|
|
| Capability | OpenClaw surface | Default |
|
|
| ------------------------ | -------------------------------------------------------------------- | ------------------------ |
|
|
| Text-to-speech | `messages.tts` / `talk` | `eleven_multilingual_v2` |
|
|
| Batch speech-to-text | `tools.media.audio` | `scribe_v2` |
|
|
| Streaming speech-to-text | Voice Call streaming or Google Meet `realtime.transcriptionProvider` | `scribe_v2_realtime` |
|
|
|
|
## Authentication
|
|
|
|
Set `ELEVENLABS_API_KEY` in the environment. `XI_API_KEY` is also accepted for
|
|
compatibility with existing ElevenLabs tooling.
|
|
|
|
```bash
|
|
export ELEVENLABS_API_KEY="..."
|
|
```
|
|
|
|
## Text-to-speech
|
|
|
|
```json5
|
|
{
|
|
messages: {
|
|
tts: {
|
|
providers: {
|
|
elevenlabs: {
|
|
apiKey: "${ELEVENLABS_API_KEY}",
|
|
voiceId: "pMsXgVXv3BLzUgSXRplE",
|
|
modelId: "eleven_multilingual_v2",
|
|
},
|
|
},
|
|
},
|
|
},
|
|
}
|
|
```
|
|
|
|
Set `modelId` to `eleven_v3` to use ElevenLabs v3 TTS. OpenClaw keeps
|
|
`eleven_multilingual_v2` as the default for existing installs.
|
|
|
|
Discord voice channels use ElevenLabs' streaming TTS endpoint when ElevenLabs
|
|
is the selected `voice.tts`/`messages.tts` provider: playback starts from the
|
|
returned audio stream instead of waiting for OpenClaw to download the whole
|
|
audio file first. `latencyTier` maps to ElevenLabs' `optimize_streaming_latency`
|
|
query parameter for models that accept it; OpenClaw omits that parameter for
|
|
`eleven_v3`, which rejects it.
|
|
|
|
## Speech-to-text
|
|
|
|
Use Scribe v2 for inbound audio attachments and short recorded voice segments:
|
|
|
|
```json5
|
|
{
|
|
tools: {
|
|
media: {
|
|
audio: {
|
|
enabled: true,
|
|
models: [{ provider: "elevenlabs", model: "scribe_v2" }],
|
|
},
|
|
},
|
|
},
|
|
}
|
|
```
|
|
|
|
OpenClaw sends multipart audio to ElevenLabs `/v1/speech-to-text` with
|
|
`model_id: "scribe_v2"`. Language hints map to `language_code` when present.
|
|
|
|
## Streaming STT
|
|
|
|
The bundled `elevenlabs` plugin registers Scribe v2 Realtime for Voice Call and
|
|
Google Meet agent-mode streaming transcription.
|
|
|
|
| Setting | Config path | Default |
|
|
| --------------- | ------------------------------------------------------------------------- | ------------------------------------------------- |
|
|
| API key | `plugins.entries.voice-call.config.streaming.providers.elevenlabs.apiKey` | Falls back to `ELEVENLABS_API_KEY` / `XI_API_KEY` |
|
|
| Model | `...elevenlabs.modelId` | `scribe_v2_realtime` |
|
|
| Audio format | `...elevenlabs.audioFormat` | `ulaw_8000` |
|
|
| Sample rate | `...elevenlabs.sampleRate` | `8000` |
|
|
| Commit strategy | `...elevenlabs.commitStrategy` | `vad` |
|
|
| Language | `...elevenlabs.languageCode` | (unset) |
|
|
|
|
```json5
|
|
{
|
|
plugins: {
|
|
entries: {
|
|
"voice-call": {
|
|
config: {
|
|
streaming: {
|
|
enabled: true,
|
|
provider: "elevenlabs",
|
|
providers: {
|
|
elevenlabs: {
|
|
apiKey: "${ELEVENLABS_API_KEY}",
|
|
audioFormat: "ulaw_8000",
|
|
commitStrategy: "vad",
|
|
languageCode: "en",
|
|
},
|
|
},
|
|
},
|
|
},
|
|
},
|
|
},
|
|
},
|
|
}
|
|
```
|
|
|
|
<Note>
|
|
Voice Call receives Twilio media as 8 kHz G.711 u-law. The ElevenLabs realtime
|
|
provider defaults to `ulaw_8000`, so telephony frames can be forwarded without
|
|
transcoding.
|
|
</Note>
|
|
|
|
For Google Meet agent mode, set
|
|
`plugins.entries.google-meet.config.realtime.transcriptionProvider` to
|
|
`"elevenlabs"` and configure the same provider block under
|
|
`plugins.entries.google-meet.config.realtime.providers.elevenlabs`.
|
|
|
|
## Related
|
|
|
|
- [Text-to-speech](/tools/tts)
|
|
- [Google Meet](/plugins/google-meet)
|
|
- [Model selection](/concepts/model-providers)
|