Dubbing v2 API

Dubbing v2 is now available through the API. It translates audio and video into more than 90 languages while preserving each speaker’s voice, tone and pacing.

The new project-based API keeps source transcripts and translations as editable JSON. Create a project from a file or URL, add one or more target languages, edit individual transcript segments or translations, then regenerate only the regions that changed. Follow the Dubbing quickstart to create your first dub.

ElevenAgents

  • Conversation guardrail filters: List conversations adds optional guardrail_types (GuardrailType[]) and custom_guardrail_names (string array) query parameters. The existing conversation hierarchy can now be filtered with optional parent_conversation_id (string).
  • Branch divergence status: List agent branches adds optional include_commit_status (boolean, default false). When enabled, branch summaries include nullable commits_ahead, commits_behind and merged_into_branch_id fields.
  • Conversation and tool controls: Client overrides now support max_duration_seconds and pronunciation_dictionary_locators. MCP server configuration adds request_meta for passing MCP _meta values to tool calls, and webhook tool timeouts now support up to 300 seconds.
  • Post-call analysis usage: Conversation charging adds an analysis breakdown with per-feature running totals and run snapshots. Transcript messages add triggered_guardrails, and conversation turns add optional producing_llm.

Voices

  • Voice search filters: Get all voices v2 adds optional gender, age, language, accent, use_cases, min_notice_period_days, include_custom_rates, include_live_moderated and high_quality query parameters.

SDK Releases

JavaScript SDK

  • v2.63.0 - Added realtime Speech to Text options for secondary languages, language and entity detection, background audio filtering, logging and single-use token authentication. Added final transcript, entity and invalid request events; fixed unaccepted terms dispatch, duplicate audio_format parameters and inclusive VAD bounds.
  • v2.62.0 - Added Dubbing bulk transcript update methods and DubbingRegenerateResponse; added conversation guardrail filters, agent branch commit status, agent alerting and MCP requestMeta support. Language target creation no longer accepts modelId.
  • v2.61.0 - Added conversation hierarchy filtering, post-call analysis charging, triggered guardrail metadata, branch merge conflict details, DTMF input redaction and Dubbing transcript uploads. Removed exported OpenAI realtime session types and run_subagent_* tool-result variants.

Python SDK

  • v2.63.0 - Added realtime Speech to Text options for secondary languages, language and entity detection, background audio filtering, logging and single-use token authentication. Added final transcript, entity and invalid request events; fixed unaccepted terms dispatch and now rejects connections without an API key or token.
  • v2.62.0 - Added Dubbing update_segments methods and DubbingRegenerateResponse; added guardrail_types, custom_guardrail_names, include_commit_status and MCP request_meta support. Dubbing segment updates now use request body models, and language target creation no longer accepts model_id.
  • v2.61.0 - Added parent_conversation_id, analysis charging, triggered guardrail metadata, branch merge conflicts, DTMF input redaction and Dubbing transcript uploads. Removed OpenAI realtime session types and run_subagent_* result models.

Android SDK

  • v0.12.1 - Fixed intentional text-only session disconnects being reported as ConversationStatus.ERROR.
  • v0.12.0 - Added ConversationConfig.useMediaStream for routing conversation audio through the Android media stream. Remote normal WebSocket closures now report DisconnectionDetails.Agent, while locally initiated closures report DisconnectionDetails.User.

MCP Server

  • v0.12.2 - Fixed an issue with path traversal.

API

New Endpoints

Dubbing

  • Batch update source segments - PATCH /v1/dubbing/project/{project_id}/transcript/segments
    • Requires DubbingBulkSegmentUpdateRequest
    • Atomically updates source segment text, speaker or timing
    • Returns DubbingBulkSourceSegmentUpdateResponse with the updated segments and revision
  • Batch update target segments - PATCH /v1/dubbing/project/{project_id}/language/{language_id}/transcript/segments
    • Requires DubbingBulkTargetSegmentUpdateRequest
    • Atomically updates translations for multiple target segments
    • Returns DubbingBulkTargetSegmentUpdateResponse with the updated segments and revision

Updated Endpoints

ElevenAgents

  • List conversations - GET /v1/convai/conversations
    • Added optional parent_conversation_id (string)
    • Added optional repeatable guardrail_types (GuardrailType[]) and custom_guardrail_names (string array)
  • List agent branches - GET /v1/convai/agents/{agent_id}/branches
    • Added optional include_commit_status (boolean, default false)
    • Branch summaries add nullable commits_ahead (integer), commits_behind (integer) and merged_into_branch_id (string)

Voices

  • Get all voices v2 - GET /v2/voices
    • Added optional gender, age and accent (string) filters
    • Added optional language and use_cases (string array) filters
    • Added optional min_notice_period_days (integer), include_custom_rates, include_live_moderated and high_quality (boolean) filters

Schema Changes

ElevenAgents

  • Client override schemas add max_duration_seconds (integer) and pronunciation_dictionary_locators (array)
  • MCP server input and output schemas add request_meta maps
  • Agent platform settings add alerting; language detection adds only_at_conversation_start (boolean)
  • AnalysisCharging.last_run is now required and non-nullable; running totals add required runs (integer)
  • RAG chunk responses now require content_format and document_type