Dubbing v2 API
Dubbing v2 is now available through the API. It translates audio and video into more than 90 languages while preserving each speaker’s voice, tone and pacing.
The new project-based API keeps source transcripts and translations as editable JSON. Create a project from a file or URL, add one or more target languages, edit individual transcript segments or translations, then regenerate only the regions that changed. Follow the Dubbing quickstart to create your first dub.
Quickstart
Create your first Dubbing v2 project and generate a translated audio track.
Refine and regenerate
Edit source transcripts and translations, then regenerate changed regions.
API reference
Explore Dubbing project, language and transcript endpoints.
ElevenAgents
- Conversation guardrail filters: List conversations adds optional
guardrail_types(GuardrailType[]) andcustom_guardrail_names(string array) query parameters. The existing conversation hierarchy can now be filtered with optionalparent_conversation_id(string). - Branch divergence status: List agent branches adds optional
include_commit_status(boolean, defaultfalse). When enabled, branch summaries include nullablecommits_ahead,commits_behindandmerged_into_branch_idfields. - Conversation and tool controls: Client overrides now support
max_duration_secondsandpronunciation_dictionary_locators. MCP server configuration addsrequest_metafor passing MCP_metavalues to tool calls, and webhook tool timeouts now support up to 300 seconds. - Post-call analysis usage: Conversation charging adds an
analysisbreakdown with per-feature running totals and run snapshots. Transcript messages addtriggered_guardrails, and conversation turns add optionalproducing_llm.
Voices
- Voice search filters: Get all voices v2 adds optional
gender,age,language,accent,use_cases,min_notice_period_days,include_custom_rates,include_live_moderatedandhigh_qualityquery parameters.
SDK Releases
JavaScript SDK
- v2.63.0 - Added realtime Speech to Text options for secondary languages, language and entity detection, background audio filtering, logging and single-use token authentication. Added final transcript, entity and invalid request events; fixed unaccepted terms dispatch, duplicate
audio_formatparameters and inclusive VAD bounds. - v2.62.0 - Added Dubbing bulk transcript update methods and
DubbingRegenerateResponse; added conversation guardrail filters, agent branch commit status, agent alerting and MCPrequestMetasupport. Language target creation no longer acceptsmodelId. - v2.61.0 - Added conversation hierarchy filtering, post-call analysis charging, triggered guardrail metadata, branch merge conflict details, DTMF input redaction and Dubbing transcript uploads. Removed exported OpenAI realtime session types and
run_subagent_*tool-result variants.
Python SDK
- v2.63.0 - Added realtime Speech to Text options for secondary languages, language and entity detection, background audio filtering, logging and single-use token authentication. Added final transcript, entity and invalid request events; fixed unaccepted terms dispatch and now rejects connections without an API key or token.
- v2.62.0 - Added Dubbing
update_segmentsmethods andDubbingRegenerateResponse; addedguardrail_types,custom_guardrail_names,include_commit_statusand MCPrequest_metasupport. Dubbing segment updates now use request body models, and language target creation no longer acceptsmodel_id. - v2.61.0 - Added
parent_conversation_id, analysis charging, triggered guardrail metadata, branch merge conflicts, DTMF input redaction and Dubbing transcript uploads. Removed OpenAI realtime session types andrun_subagent_*result models.
Android SDK
- v0.12.1 - Fixed intentional text-only session disconnects being reported as
ConversationStatus.ERROR. - v0.12.0 - Added
ConversationConfig.useMediaStreamfor routing conversation audio through the Android media stream. Remote normal WebSocket closures now reportDisconnectionDetails.Agent, while locally initiated closures reportDisconnectionDetails.User.
MCP Server
- v0.12.2 - Fixed an issue with path traversal.
API
View API changes
New Endpoints
Dubbing
- Batch update source segments -
PATCH /v1/dubbing/project/{project_id}/transcript/segments- Requires
DubbingBulkSegmentUpdateRequest - Atomically updates source segment text, speaker or timing
- Returns
DubbingBulkSourceSegmentUpdateResponsewith the updatedsegmentsandrevision
- Requires
- Batch update target segments -
PATCH /v1/dubbing/project/{project_id}/language/{language_id}/transcript/segments- Requires
DubbingBulkTargetSegmentUpdateRequest - Atomically updates translations for multiple target segments
- Returns
DubbingBulkTargetSegmentUpdateResponsewith the updatedsegmentsandrevision
- Requires
Updated Endpoints
ElevenAgents
- List conversations -
GET /v1/convai/conversations- Added optional
parent_conversation_id(string) - Added optional repeatable
guardrail_types(GuardrailType[]) andcustom_guardrail_names(string array)
- Added optional
- List agent branches -
GET /v1/convai/agents/{agent_id}/branches- Added optional
include_commit_status(boolean, defaultfalse) - Branch summaries add nullable
commits_ahead(integer),commits_behind(integer) andmerged_into_branch_id(string)
- Added optional
Voices
- Get all voices v2 -
GET /v2/voices- Added optional
gender,ageandaccent(string) filters - Added optional
languageanduse_cases(string array) filters - Added optional
min_notice_period_days(integer),include_custom_rates,include_live_moderatedandhigh_quality(boolean) filters
- Added optional
Schema Changes
ElevenAgents
- Client override schemas add
max_duration_seconds(integer) andpronunciation_dictionary_locators(array) - MCP server input and output schemas add
request_metamaps - Agent platform settings add
alerting; language detection addsonly_at_conversation_start(boolean) AnalysisCharging.last_runis now required and non-nullable; running totals add requiredruns(integer)- RAG chunk responses now require
content_formatanddocument_type