Eleven Realtime
Eleven Realtime is a new family of models for ElevenAgents voice agents, rolling out gradually across workspaces. Each one is a complete voice agent configuration. You pick one model, and ElevenLabs handles the LLM, Speech to Text and Text to Speech settings behind it. Your agent’s system prompt, voice, tools and knowledge base work the same as before.
There are two to choose from. Eleven Realtime v1 Mini (eleven_realtime_v1_mini) is the default, and it’s the fastest and cheapest. Eleven Realtime v1 Max (eleven_realtime_v1_max) reasons before it answers, so use it when your agent has complex instructions or multi-step tool calls.
If you’ve already built on OpenAI’s Realtime API, you don’t need to rewrite your client. The events and the WebSocket transport are the same, so you change the endpoint and the session configuration. Your backend calls Create realtime client secret to get a short-lived secret, and the browser uses it to connect directly.
Realtime Translation
Realtime Translation turns speech in one language into speech in another while the speaker is still talking. It’s a WebSocket API, available now for enterprise workspaces.
You open a connection with a target_language and a voice_id, then stream audio in. You get translated speech back in that voice. You don’t have to say which language the speaker is using, because it’s detected automatically, but you can set source_language if you know it. Along the way, the server also sends live transcripts of the original speech and the translated text, for example to show captions.
eagerness controls the tradeoff between speed and quality. high starts translating soonest, and low waits for more of the sentence. The translated voice uses Eleven v4 Turbo by default, and you can switch to eleven_v3 or eleven_flash_v2_5 with tts_model_id. For sensitive conversations, set enable_zrm=true to use Zero Retention Mode.
Video to Music
Video to Music writes a soundtrack for your video. The Video to music API is now available: you upload a video and get back music that fits it, without writing a music prompt from scratch. Use it to score product videos, ads and social clips.
You can send up to 10 video files (200 MB combined). They’re joined in order and scored as one video. To steer the result, add a text description and up to 10 style tags.
Three options are worth knowing. use_audio_as_reference takes the genre, BPM, instruments and mood from the video’s own audio. add_sfx adds sound effects that match the video. separate_tracks returns the music and the sound effects as separate files in a ZIP, so you can mix them yourself.
ElevenAgents
- Alerts: Alerts notify a workspace when agent error rates exceed a threshold or rise sharply above their recent baseline. Monitors cover conversation failures, tool failures, webhook errors, guardrail triggers, call initiation errors and evaluation success scores, and run with default thresholds without any setup. Agent-level thresholds and notifiers can be set through
platform_settings.alertingon Update agent. Notifications can be delivered as webhooks, to Slack or to PagerDuty. - Guardrails generally available: Guardrails are no longer in alpha.
- Workspace environments: Environments for environment variables can now be managed through the API with List environments, Create environment and Delete environment. A variable without a value for an environment falls back to its
productionvalue. Deleting an environment removes its values from all variables, andproductioncannot be deleted. - Answering machine detection actions: Twilio answering machine detection settings on Outbound call and Submit batch call accept
actions, a list of rules that pair anaction(hang_up) with theanswered_byverdicts that trigger it, such asmachine_startorfax. Verdicts without a rule leave the call running. - New LLMs: Agents can use
gemini-4-argon,claude-opus-4-6and the ElevenLabs-hostednemotron-35-super-vl-nvfp4. See Models. - Authored-only workflow reads: Get agent and Update agent accept
include_procedure_generated_workflow_elements. Set it tofalseto receive only the workflow nodes and edges you authored, excluding the ones compiled from structured procedures. Defaults totrue, so existing callers are unchanged. - Branch rebasing from any branch: Rebase branch and Preview rebase accept an optional
source_branch_idto pull changes from a branch other than main. - Delete agents used as subagents: Delete agent accepts
force. Whentrue, the agent is deleted even if other agents use it as a subagent, and it is removed from those agents and their branches. - Sort agents by last update: List agents accepts
sort_by=updated_at, and each agent summary includesupdated_at_unix_secs, the last time the main branch or agent-level settings changed. - Google Calendar event updates: The Google Calendar integration adds
google_calendar_update_eventandgoogle_calendar_delete_eventtools. Both are privileged tools that can change or cancel any event on the connected calendar.
Music and Sound Effects
- Zero Retention Mode: Music generation, composition plan, stem separation and video to music endpoints, plus Sound Effects, accept
enable_logging=falseto use Zero Retention Mode. Zero Retention Mode is available to enterprise customers. Music requests that setstore_for_inpainting=trueare rejected in this mode. - WAV output for sound effects: Sound Effects accepts
wav_8000,wav_16000,wav_22050,wav_24000,wav_32000,wav_44100andwav_48000output formats.
Speech Engine
- 40-minute conversations: Speech Engine supports conversations of up to 40 minutes. The default limit remains 10 minutes. Raise
conversation.max_duration_secondsto allow longer conversations. - Sort by last update: List Speech Engines accepts
sort_by=updated_at, and each summary includesupdated_at_unix_secs.
Dubbing
- Subtitles for dubbed languages: Dubbing project language outputs (
GET /v1/dubbing/project/{project_id}/language/{language_id}) includesubtitles, a signed URL to the translated lines as WebVTT subtitles timed to the source speech. The URL expires one hour after it is issued.
Voices
- Resubmittable voice reviews: Voice sharing
review_statusaddsdeclined_resubmittablefor declined voices that can be resubmitted for review.
Workspaces
- Disable service account API keys: Disable service account API key disables a service account API key without changing its other settings. It remains available after a workspace downgrades from a plan that includes service accounts.
- Group concurrency limits: List workspace groups and List service accounts return
group_concurrency_limit,group_dubbing_concurrency_limitandgroup_music_concurrency_limitfor each group, and group permissions addall_resources_access.
SDK releases
JavaScript SDK
- v2.74.0 - Added
client.conversationalAi.realtime.createClientSecretfor the Realtime API, with theRealtimeModeland OpenAI-compatible session configuration types, and anenvironmentsclient withlist,createanddelete. Also addsforceon agent deletion,sourceBranchIdon branch rebase and rebase preview,includeProcedureGeneratedWorkflowElementson agent reads,enableLoggingon Music and Sound Effects methods, WAV output formats for Sound Effects, service account API keydisable, and Twilio answering machine detectionactions. - v2.73.0 - Added
createAndWaithelpers for Flows image, video and Text to Speech generations and template runs (client.flows.templates.runs.createAndWait). They create the request and poll until it completes or fails, pacing requests with the server’sRetry-Afterheader. Afailedresult is returned rather than thrown, andwaitTimeoutInSecondsthrowsFlowsWaitTimeoutErrorif the work is not finished in time. The regenerated client adds the Video to musicadd_sfx,separate_tracksanduse_audio_as_referenceoptions.
Python SDK
- v2.74.1 -
music.compose_detailednow accepts and forwardsenable_logging, which the custom wrapper previously dropped, so Zero Retention Mode works with this method. - v2.74.0 - Added
client.conversational_ai.realtime.create_client_secretfor the Realtime API and anenvironmentsclient, with the same regenerated API changes as JavaScript SDK v2.74.0. - v2.73.0 - Added
create_and_waithelpers for Flows image, video and Text to Speech generations and template runs, for both sync and async clients, withwait_timeout_in_secondsandmin_poll_interval_in_secondsoptions and aFlowsWaitTimeoutErrorexported fromelevenlabs.flows_custom. Type checkers such as pyright now resolveclient.webhooks.construct_event,client.speech_to_text.realtime,client.text_to_speech.convert_realtimeand the custom Music methods. Includes the same regenerated API changes as the JavaScript SDK. - v2.73.1 - Fixed the test suite on Python 3.13 and later, and added Python 3.13 and 3.14 to CI.
ElevenLabs CLI
- v1.7.0 - Regenerated API commands, adding environments, realtime client secrets and service account API key disabling.
- v1.6.0 - Added
create-and-waitcommands forflows image,flows video,flows text-to-speechandflows templates runs. Each command returns a finished result, with--wait-timeoutand--min-poll-intervaloptions. - v1.5.1, v1.5.2, v1.5.3 and v1.6.1 - Bug fixes for onboarding, including Windows support.
Packages
- @elevenlabs/client@1.28.0 - Added the experimental
persistentSessionoption for resumable text conversations over WebSocket, and theonConversationHistorycallback for the transcript the server replays on resume. WebSocket sessions now also emitonConversationMetadata. - @elevenlabs/react@1.18.0 - Forwards the experimental
onConversationHistorycallback to@elevenlabs/client. - @elevenlabs/types@0.25.0 - Added the
conversation_historyserver event and thepersistent_session_tokenfield onconversation_initiation_metadata. - @elevenlabs/react-native@1.2.30 - Updated to
@elevenlabs/client@1.28.0and@elevenlabs/react@1.18.0. - @elevenlabs/convai-widget-core@0.20.0 and @elevenlabs/convai-widget-embed@0.20.0 - Added the
persistent-sessionattribute. Text conversations survive a dropped connection or a page reload: the widget keeps the transcript, reopens the chat, renders the history replayed by the server and resumes the conversation. End chat discards the stored conversation. Workspaces without persistent sessions fall back to a standard conversation. - @elevenlabs/convai-widget-core@0.19.1 and @elevenlabs/convai-widget-embed@0.19.1 - First message quick replies are shown below the first message in voice calls.
API
View API changes
New endpoints
ElevenAgents
-
Create realtime client secret -
POST /v1/convai/realtime/client_secrets- Create an ephemeral client secret for browser-based Realtime API sessions. Accepts an optionalsession(OpenAI-compatible session configuration withmodelofeleven_realtime_v1_mini(default) oreleven_realtime_v1_max,instructions,audio,tools,turn_detectionandmax_duration_secondsfrom 60 to 7,200, default 600) and optionalexpires_afterwith requiredseconds(integer). Returnsvalue(string),expires_at(integer) and the echoedsession. -
List environments -
GET /v1/convai/environments- List the workspace environments, includingproduction. Each environment hasname, nullableupdated_at_unix_secsand nullablecreated_by_user_id. -
Create environment -
POST /v1/convai/environments- Create an environment with a required, uniquename(string). Returns409if the name is taken. -
Delete environment -
DELETE /v1/convai/environments/{environment}- Delete an environment and remove its values from all environment variables. Returns204.
Workspaces
- Disable service account API key -
POST /v1/service-accounts/{service_account_user_id}/api-keys/{api_key_id}/disable- Disable a service account API key without changing its other settings.
Updated endpoints
ElevenAgents
- Get agent, Update agent, Preview rebase and Preview merge
- Added optional
include_procedure_generated_workflow_elements(boolean, defaulttrue). Whenfalse, the returned workflow contains only authored nodes and edges, without those generated from structured procedures.
- Added optional
- Create agent, Get agent and Update agent
- The
llmenum addsgemini-4-argon,claude-opus-4-6andnemotron-35-super-vl-nvfp4. - TTS configuration
effectsremoves the deprecatedseedfield.
- The
- Delete agent - Added optional
force(boolean, defaultfalse). - List agents -
sort_byaddsupdated_at. Agent summaries add requiredupdated_at_unix_secs(integer). - Rebase branch and Preview rebase - Added optional
source_branch_id(string). Defaults to the agent’s main branch. - Outbound call, Submit batch call and Get batch call
- Twilio machine detection configuration adds
actions, an array of rules with requiredaction(hang_up) and requiredanswered_by(array ofhuman,fax,unknown,machine_start,machine_end_beep,machine_end_silenceormachine_end_other). Each action can appear in at most one rule.
- Twilio machine detection configuration adds
- Get conversation details
- Transcript tool calls add nullable
tool_id(string). It is not set for tools without an ID, such as system tools. - Turn metrics add nullable
voice_id(string). - Tool results add nullable
to_agentandto_node(string). - WhatsApp conversation info adds nullable
recipientwith nullablephoneandbsuid(string), and nullablecall_permission_requestwith requiredstate(blocked,sent,acceptedordeclined) and nullablerequested_at_unix(integer). - The platform charge category enum adds
v3_addon,v4_addonandrag_addon.
- Transcript tool calls add nullable
- Get ticket, List tickets and List workspace tickets
- Ticket responses add required
status_changes, an array of objects withstatus, nullablechanged_by_user_id(string) andchanged_at_unix_secs(integer).
- Ticket responses add required
Text to Speech and Text to Dialogue
- Create speech, Stream speech, Create dialogue and Stream dialogue, including their timestamp variants -
use_pvc_as_ivcis now nullable and no longer declares a default offalse.
Music
- Compose music, Compose detailed, Stream music, Compose detailed stream, Separate stems, Video to music and
POST /v1/music/plan- Added optional
enable_loggingquery parameter (boolean, defaulttrue). Set it tofalsefor Zero Retention Mode.
- Added optional
- Video to music - Added optional
add_sfx,separate_tracksanduse_audio_as_reference(boolean, defaultfalse).
Sound Effects
- Create sound effect
- Added optional
enable_loggingquery parameter (boolean, defaulttrue). output_formataddswav_8000,wav_16000,wav_22050,wav_24000,wav_32000,wav_44100andwav_48000.
- Added optional
Speech Engine
- List Speech Engines -
sort_byaddsupdated_at. Summaries add requiredupdated_at_unix_secs(integer).
Speech to Text
- Create transcript and Get transcript - Edited transcripts add required, read-only
edited_text(string), matchingtextand theedited_textfield of the realtimeedited_transcriptevent.
Dubbing
GET /v1/dubbing/project/{project_id}/languageandGET /v1/dubbing/project/{project_id}/language/{language_id}- Language outputs add nullablesubtitles(string, signed URL).
Voices
- Get voice, List voices and Get voices - Voice sharing
review_statusaddsdeclined_resubmittable.
Workspaces
- List workspace groups and List service accounts
- Groups add nullable
group_concurrency_limit,group_dubbing_concurrency_limitandgroup_music_concurrency_limit(integer orunlimited). - Group permissions add
all_resources_access.
- Groups add nullable
ElevenAgents
- Merge and search triage tickets: Merge tickets folds up to 50 open tickets from the same agent into one target ticket. Merged tickets keep the status
mergedand reference the target throughmerged_into_ticket_id. List tickets and List workspace tickets add a case-insensitivesearchparameter that matches ticket titles, descriptions, comments and turn comments, and each result includes asearch_matchexcerpt showing where the query matched. - Workflow End node outcomes: Workflow End nodes accept an
outcomeofsuccess(default) orfailure, so a workflow can record whether a conversation ended successfully. The conversation error type addsworkflow_end_failure. - Call queueing enabled for new agents: New agents are created with call queueing enabled unless
platform_settings.queueing_config.enabledis set explicitly. Existing agents keep their current setting. - Post-call audio webhook retries: When Enable retries is on,
post_call_audiowebhooks are retried on the same schedule as transcription webhooks. Audio payloads over 50 MiB are not retried, and queued audio retries are capped at 400 MiB per webhook. - Strict tool overrides: The conversation override
tool_ids_strictmakes an overriddentool_idslist the complete set of tools available in the conversation, including tools on workflow nodes. It is ignored when set on the agent itself. - Widget end confirmation: The widget can ask users to confirm before ending a chat or call. Enable it with
end_confirmation_enabledin the widget configuration or theend-confirmationattribute.
Text to Speech
- Audio effects: Text to Speech and Text to Dialogue requests accept an optional
audio_effectsobject. It applies a filter preset, perceived distance, a reverb environment, a looped background noise bed and stereo panning to the generated audio. List valid preset, environment and background noise IDs withGET /v1/audio-effects/catalog. Reverb and non-zero panning produce stereo audio and are rejected forulaw_*,alaw_*andpcm_*output formats. Effects do not change the cost of a request.
Speech to Text
- Turn prediction commit strategy: The realtime Speech to Text WebSocket adds
turn_predictionas acommit_strategyvalue. In addition to silence-based segmentation, it commits a segment as soon as the model predicts the speaker has finished their turn. It is the default for models that predict turns, and partial transcripts from those models includeturn_probability. See transcripts and commit strategies.
Voices
- Voice collections API: Voice collections can now be managed through the API. Create, list, update and delete collections, and add or remove voices. See List voice collections.
Workspaces
- Basic seat fallback: Update member accepts
allow_downgrade_to_basic_seat. When unlocking a user whose original seat type has no seats available, the user is moved to a basic seat instead of the request failing. - Workspace ID on user: Get user returns the
workspace_idof the workspace the API key belongs to.
SDK releases
JavaScript SDK
- v2.72.0 - Added clients for voice collections, the audio effects catalog and triage ticket merging. Text to Speech and Text to Dialogue methods accept
audio_effects, triage ticket list methods add search and filters, and the realtime Speech to Text client adds theturn_predictioncommit strategy.
Python SDK
- v2.72.0 - Added clients for voice collections, the audio effects catalog and triage ticket merging. Text to Speech and Text to Dialogue methods accept
audio_effects, triage ticket list methods add search and filters, and the realtime Speech to Text client adds theturn_predictioncommit strategy.play()andsave()now accept any iterable of audio chunks, such as a list or tuple.RealtimeEvents.CLOSEhandlers receive a dictionary with the WebSocket closecodeandreason; handlers without parameters continue to work.
ElevenLabs CLI
- v1.5.0 - Regenerated API commands, adding voice collections, the audio effects catalog, triage ticket merging and agent merge proposals.
Packages
- @elevenlabs/client@1.27.0 and @elevenlabs/react@1.17.0 - Added a
previousTextoption toScribe.connect()anduseScribe()in microphone mode. The text is sent with the first audio chunk to give the model context, such as existing document text, for casing, punctuation and sentence continuation.MediaDeviceOutputnow receiveslibsampleratePath, so output resampling uses the same custom libsamplerate bundle path asMediaDeviceInput. - @elevenlabs/react-native@1.2.29 - Updated to
@elevenlabs/client@1.27.0and@elevenlabs/react@1.17.0. - @elevenlabs/convai-widget-core@0.19.0 and @elevenlabs/convai-widget-embed@0.19.0 - Added an optional confirmation dialog before ending a chat or call, enabled with the
end-confirmationattribute orend_confirmation_enabledconfig, with customizable text. Added carousel rich content with scrollable item cards that can include an image, subtitle, description and actions. Carousels remain in the transcript after a reply, without their actions. Rich content is now shown during voice calls when the transcript is visible.
API
View API changes
New endpoints
ElevenAgents
- Merge tickets -
POST /v1/convai/triage-tickets/{agentqa_ticket_id}/merge- Merge open tickets into the target ticket. Requiressource_ticket_ids(string array, 1–50 items) and returns the target ticket.
Voices
- List voice collections -
GET /v1/voices/collections- List the voice collections the caller can access, sorted by title. - Create voice collection -
POST /v1/voices/collections- Create a collection with requiredtitleandicon(string, maximum 1,000 characters each). - Get voice collection -
GET /v1/voices/collections/{collection_id}- Retrieve a collection with itstitle,iconand the caller’spermission_on_resource(admin,editor,commenterorviewer). - Update voice collection -
PATCH /v1/voices/collections/{collection_id}- Update the optionaltitleoricon. - Delete voice collection -
DELETE /v1/voices/collections/{collection_id} - Add voice to collection -
POST /v1/voices/collections/{collection_id}/voice/{voice_id} - Remove voice from collection -
DELETE /v1/voices/collections/{collection_id}/voice/{voice_id}
Audio effects
GET /v1/audio-effects/catalog- List the availablefilter_presets,environmentsandbackground_noises. Each entry has an ID, anameand a nullabledescription.
Updated endpoints
ElevenAgents
- Create agent, Get agent and Update agent
- Workflow End nodes add
outcome(successorfailure, defaultsuccess). The field is required in responses. - Standalone workflow agent nodes and agent transfer configurations add nullable
branch_id(string) to target a specific branch of the destination agent. When unset, the transfer follows the target agent’s traffic deployment. Transfer tool results add aconfiguredbranch reason. - Prompt override configurations add
tool_ids_strict(boolean, defaultfalse). - TTS configuration
effectsaddpan(number, -1 to 1, default0). Theseedfield is deprecated and has no effect.
- Workflow End nodes add
- Get widget config - Added
end_confirmation_enabled(boolean, defaultfalse). - List tickets
- Added optional
search(string, maximum 200 characters) andmerged_into_ticket_id(string) query parameters. - Ticket responses add nullable
merged_into_ticket_idand nullablesearch_matchwithfield(title,description,commentorturn_comment),snippet,highlight_start,highlight_endand nullableturn_index.
- Added optional
- List workspace tickets - Added optional
agent_id,sources,priorities,sort_by(created_atorpriority, defaultcreated_at),owner_user_id,issue_type,label,merged_into_ticket_idandsearchquery parameters. - List tests - Added optional
created_by_user_id(string). Use@mefor the authenticated user. - List test invocations - Added optional
test_id(string),version_id(string),start_timeandend_time(integer, Unix seconds, inclusive) query parameters. - Update agent branch - Added optional
auto_rebase(boolean). Branch responses addauto_rebase(boolean, defaultfalse). - Get conversation details
- Twilio, SIP trunk and Exotel phone call metadata add nullable
call_resultwithanswered,voicemail,busy,no_answerandfailedvalues. - Batch call metadata adds nullable
cold_attempt(integer) and nullableconversation_type(initial,retry,callbackorredirect). - The conversation error type adds
workflow_end_failure.
- Twilio, SIP trunk and Exotel phone call metadata add nullable
- Knowledge base auto-sync
auto_discoveris deprecated and no longer has any effect.
Text to Speech
- Create speech, Stream speech, Create speech with timing and Stream speech with timing
- Added optional nullable
audio_effectswithfilter_preset_id(string),distance(number, 0–1, default0),environment_id(string),background_noise_id(string),send_level(number, 0–1, default1) andpan(number, -1 to 1, default0). - Unknown effect IDs return
404. Stereo effects return400forulaw_*,alaw_*andpcm_*output formats.
- Added optional nullable
Text to Dialogue
- Create dialogue, Stream dialogue, Create dialogue with timestamps and Stream dialogue with timestamps - Added optional nullable
audio_effects, matching the Text to Speech endpoints.
Speech to Text
- Realtime Speech to Text
- The
commit_strategyquery parameter addsturn_prediction, alongsidemanualandvad. partial_transcriptmessages add optionalturn_probability(number), sent only for models that predict turns.
- The
Music
POST /v1/music/video-to-music- Responses add asong-idheader with the ID of the generated song.
History
- List generated items - The history item
sourceenum addsVoicePreview.
Workspace and user
- Update member - Added optional
allow_downgrade_to_basic_seat(boolean, defaultfalse). - Get user - Added required
workspace_id(string). - Service account API key permissions add
voice_collections_readandvoice_collections_write.
ElevenAgents
- Structured procedures compile on save and publish: Update agent and Create agent draft now compile and validate structured procedures automatically. Integrations no longer need to call the compile endpoint or manually update the generated workflow. Invalid procedures return per-procedure errors as
400 procedure_validation_failed. Agents without structured procedures are unaffected. - Compile procedures endpoint is legacy: Compile procedures is marked legacy and should not be used by new integrations. It remains available for existing callers.
- Merge proposals: Merge proposals are available in alpha. Teams can open a proposal for an agent branch, review configuration changes and test results, leave comments or approval decisions, and merge approved changes into a target branch. See Merge proposals.
SDK releases
JavaScript SDK
- v2.71.0 - Added clients for agent merge proposals, deployment history, test invocation cancellation and Speech Engine duplication. The release also adds triage ticket priorities and sorting, batch call export limits,
gpt-6.1-sol,claude-sonnet-5-5, Eleven v4 agent voice models and current agent configuration types.
Python SDK
- v2.71.0 - Added clients for agent merge proposals, deployment history, test invocation cancellation and Speech Engine duplication. The release also adds triage ticket priorities and sorting, batch call export limits,
gpt-6.1-sol,claude-sonnet-5-5, Eleven v4 agent voice models and current agent configuration types.
Swift SDK
- v3.4.0 - Dynamic variables now preserve native JSON types when sent in conversation initiation data.
Packages
- @elevenlabs/client@1.26.0, @elevenlabs/react@1.16.0, @elevenlabs/react-native@1.2.28 and @elevenlabs/types@0.24.0 - Added realtime Speech to Text transcript editing through
transcriptEdit, theedited_transcriptevent and React’sonEditedTranscriptcallback. React now forwardsfilterBackgroundAudioto realtime sessions. The client also exportsMessagePayloadand uses stable response IDs to prevent duplicate agent replies. - @elevenlabs/convai-widget-core@0.18.3 and @elevenlabs/convai-widget-embed@0.18.3 - Added image previews and download links for agent message attachments, including attachment-only replies. Stable response IDs prevent duplicate replies, and text-only conversations now use a stop control with an End chat tooltip.
API
View API changes
New endpoints
ElevenAgents
- Create a merge proposal -
POST /v1/convai/agents/{agent_id}/merge-proposals- Create a proposal with requiredsource_branch_id,target_branch_idandtitlefields, plus an optional description, reviewer IDs and triage ticket ID. - List merge proposals -
GET /v1/convai/agents/{agent_id}/merge-proposals- List proposals with status, source branch, target branch and text filters, plus cursor pagination. - Get a merge proposal -
GET /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}- Retrieve a proposal and its review, comment and outcome details. - Update a merge proposal -
PATCH /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}- Update its title, description or requested reviewers, or close it without merging. - Review a merge proposal -
POST /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}/reviews- Submit anapprovedorchanges_requesteddecision with an optional comment. - Comment on a merge proposal -
POST /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}/comments- Add a Markdown comment of up to 4,096 characters. - Merge a merge proposal -
POST /v1/convai/agents/{agent_id}/merge-proposals/{merge_proposal_id}/merge- Merge the source branch and optionally control forced conflict resolution and source branch archival. - List agent deployments -
GET /v1/convai/agents/{agent_id}/deployments- List current and historical branch traffic splits with page-based pagination. - Cancel a test invocation -
POST /v1/convai/test-invocations/{test_invocation_id}/cancel- Cancel a running test invocation.
Speech Engine
- Duplicate a Speech Engine -
POST /v1/speech-engine/{speech_engine_id}/duplicate- Duplicate a Speech Engine and optionally assign the copy a newname.
Updated endpoints
ElevenAgents
- Create agent, Get agent and Update agent
- Added
gpt-6.1-solandclaude-sonnet-5-5to theLLMenum. - Added
eleven_v4andeleven_v4_turboto the conversational TTS model options. The default changed fromeleven_flash_v2toeleven_v4_turbo. - Agent transfers and standalone workflow agent nodes add optional
preserve_voice_settings(boolean, defaultfalse) to retain the base voice, TTS model and voice settings after a transfer. - Skip-turn tool configurations add optional
wait_timeout_secs(number, default-1). A value of-1keeps the agent silent until the caller speaks. - Post-call webhook configurations add optional
exclude_transcript(boolean, defaultfalse) to omit turn-by-turn transcripts from JSON transcription webhooks. - Conversation history redaction configurations add optional
excluded_data_collection_ids(string array, maximum 50) to preserve selected extracted values while redacting their rationales. - Client tool
response_timeout_secsnow accepts-1to wait indefinitely whenexpects_responseis enabled.
- Added
- List tickets
- Added optional
priorities(array) withlow,medium,highandurgentvalues. - Added
sort_bywithcreated_atandpriorityvalues; the default iscreated_at. - Ticket responses now require
title, nullablepriority, and apriority_changesarray. Ticket creation and update requests can setpriority, and ticket status addscancelled.
- Added optional
- List tools - Added optional nullable
used_by_agent_id(string) to return tools referenced by an agent’s main branch. - Export batch call results - Added optional nullable
limit(integer, minimum1) to export only the first recipients as a column preview. - List test invocations and Get test invocation
- Test invocation summaries add required
cancelled_count(integer) and optionalcancelled(boolean, defaultfalse). - Test run status adds
cancelled.
- Test invocation summaries add required
- Get conversation details - Transcript entries add optional nullable
platform_eventwithuser_turn_timeoutandskip_turn_wait_elapsedvalues. - Get agent version metadata - Added optional nullable
merged_authors, an array describing the people who published changes merged into the main branch. - Get crawl job - Removed the deprecated
max_depthresponse field.
Eleven v4 和 Eleven v4 Turbo
Eleven v4 和 Eleven v4 Turbo 现已推出。Eleven v4 可在超过 90 种语言中提供更高质量、更具表现力的语音,以及更出色的语音克隆。Eleven v4 Turbo 属于同一模型系列,适用于实时应用,中位推理延迟约为 100 ms。
内容创作和长音频可通过文本转对话 API 使用 eleven_v4。智能体和交互式应用可通过文本转对话 WebSocket 使用 eleven_v4_turbo。
语音转文字
- 转录编辑:批量和实时转录现可接受最长 2,000 个字符的自然语言编辑指令。批量响应会在
edited_transcript中返回结果,实时会话则会发出edited_transcript事件。有关不兼容项、响应处理和定价,请参阅批量和实时指南。
ElevenAgents
- 智能体模型:在支持的智能体 LLM 选项中新增
gpt-6-sol、gpt-6-luna、glm-52、deepseek-v41-flash、claude-opus-5和claude-opus-5-5。 - 智能体测试用量:测试调用摘要可包含总积分和美元价格。单次测试运行可包含积分和计费明细。
Flows
- 模板 API:新增用于列出和获取已发布 Flows 模板、启动模板运行及获取运行结果的端点。运行可指定已发布版本,并将最终结果发送至配置的 webhook。
文本转对话
- 生成连续性:文本转对话请求可使用前文或后文以及请求 ID,以保持多次生成之间的连续性。
- 专业音色模式:文本转对话请求可使用专业语音克隆的即时语音克隆版本,以降低延迟或提升表现力。
SDK 发布
JavaScript SDK
- v2.70.0 - 新增批量和实时语音转文字转录编辑类型、测试调用摘要的
branchId筛选和费用字段、知识库自动发现、文本转对话usePvcAsIvc以及deepseek-v41-flash智能体模型。
Python SDK
- v2.70.0 - 新增批量和实时语音转文字转录编辑类型、测试调用摘要的
branch_id筛选和费用字段、知识库自动发现、文本转对话use_pvc_as_ivc以及deepseek-v41-flash智能体模型。
ElevenLabs CLI
- v1.4.0 - 修复使用明确 API 密钥的请求同时发送已存储 OAuth 凭据的问题,该问题会导致身份验证失败。为反馈命令组添加说明,并为生成的智能体技能添加报告缺失功能的说明。使用 Flows 模板端点和当前架构类型重新生成 API 客户端。
API
查看 API 变更
新增端点
Flows
- 列出模板 -
GET /v1/flows/templates- 列出已发布模板及其可运行版本。 - 获取模板 -
GET /v1/flows/templates/{template_id}- 获取模板及其可运行版本。 - 创建模板运行 -
POST /v1/flows/templates/{template_id}/runs- 使用输入值、可选版本和可选 webhook 启动模板运行。 - 列出模板运行 -
GET /v1/flows/templates/{template_id}/runs- 使用游标分页和可选版本筛选列出模板运行。 - 获取模板运行 -
GET /v1/flows/templates/{template_id}/runs/{run_id}- 获取模板运行及其输出状态。
更新的端点
语音转文字
- 将语音转换为文字 -
POST /v1/speech-to-text- 新增可选可空
transcript_edit(字符串),可接受最长 2,000 个字符的自然语言编辑指令。 - 响应新增可选可空
edited_transcript。编辑成功时包含必填kind: "transcript"和text字段。编辑失败时包含必填kind: "error"、error_type: "edit_failed"和message字段。
- 新增可选可空
- 实时语音转文字接受
transcript_edit(字符串),并发出包含必填text和edited_text字段的edited_transcript事件。
ElevenAgents
- 创建智能体、获取智能体和更新智能体
- 在
LLM枚举中新增gpt-6-sol、gpt-6-luna、glm-52、deepseek-v41-flash、claude-opus-5和claude-opus-5-5。 - 告警监控项新增可选可空
enabled(布尔值),用于控制监控项是否可发送通知。
- 在
- 列出对话和文本搜索
data_collection_params和dynamic_variable_params新增neq和in运算符。in的值使用竖线分隔。evaluation_params接受success、failure或unknown作为结果值。
- 智能搜索 -
GET /v1/convai/conversations/messages/smart-search- 新增可选可空
branch_id(字符串)。
- 新增可选可空
- 列出测试调用 -
GET /v1/convai/test-invocations- 新增可选可空
branch_id(字符串)。 - 测试调用摘要新增可选可空
credits_used(整数)和total_price(数字)。
- 新增可选可空
- 获取测试调用 -
GET /v1/convai/test-invocations/{test_invocation_id}- 单次测试运行新增可选可空
credits_used(整数)和charging(ConversationChargingCommonModel)。
- 单次测试运行新增可选可空
- 模拟对话和模拟对话流
- 将可选
new_turns_limit的默认值从10,000改为100,并将最大值设为100。
- 将可选
- 创建爬取任务和获取爬取任务
- 新增可选
auto_discover(布尔值,默认false),用于在自动同步期间跟踪链接并添加新发现的页面。这需要enable_auto_sync: true。
- 新增可选
- 刷新知识库文档 -
POST /v1/convai/knowledge-base/{documentation_id}/refreshAutoSyncInfo新增可选auto_discover(布尔值,默认false),用于指示刷新时是否爬取并添加新发现的页面。
- 列出 MCP 服务器工具 -
GET /v1/convai/mcp-servers/{mcp_server_id}/tools- 响应新增可选
tool_approval_statuses(数组)。每项包含必填tool_id(字符串)和state(up_to_date、needs_review或not_approved),以及可选的审批策略和已批准定义字段。
- 响应新增可选
文本转对话
- 将文本转换为对话、流式转换文本为对话、转换并附带时间戳和流式转换并附带时间戳
- 新增可选
use_pvc_as_ivc(布尔值,默认false),用于使用专业语音克隆的即时语音克隆版本。 - 新增可选可空
previous_text和future_text(字符串,最长 100 个字符),以及previous_request_ids和next_request_ids(字符串数组,最多 3 个 ID),用于保持生成连续性。 - 可选
settings对象新增可空similarity(数字,0–1,默认0.75)。
- 新增可选
文本转语音
- 将文本转换为语音、流式转换文本为语音、转换并附带时间戳和流式转换并附带时间戳
- 现有的
use_pvc_as_ivc字段不再弃用。
- 现有的
Flows
声音设计
工作区
- 创建服务账户 API 密钥 -
POST /v1/service-accounts/{service_account_user_id}/api-keys- 为企业版服务账户 API 密钥新增可选可空
tts_concurrency_limit、music_concurrency_limit和dubbing_concurrency_limit(整数)。
- 为企业版服务账户 API 密钥新增可选可空
- 更新服务账户 API 密钥 -
PATCH /v1/service-accounts/{service_account_user_id}/api-keys/{api_key_id}- 新增可选
tts_concurrency_limit、music_concurrency_limit和dubbing_concurrency_limit。每个字段可接受整数、clear、no_update或null,默认值为no_update。
- 新增可选
模型
- 列出模型 -
GET /v1/models- 弃用必填
max_characters_request_free_user和max_characters_request_subscribed_user。这些字段不会强制执行;请改用maximum_text_length_per_request。
- 弃用必填
图像和视频
- Sora 2 和 Sora 2 Pro 已停用:OpenAI 将于 2026 年 9 月 24 日停止 Sora API 服务。两个模型已从图像和视频模型选择器中移除,并将于该日期停止生成。现有生成内容仍可在历史记录中查看。使用 Sora 节点的 Flows 和模板需切换到其他视频模型,例如 Gemini Omni 1.1 Flash,才能再次运行。
- Seedance 1.5 Pro 已弃用:ByteDance 将于 2026 年 11 月 11 日停止 Seedance 1.5 Pro 服务。该模型不再提供给新的生成任务,并将于该日期停止运行。请改用 Seedance 2.0 模型。
ElevenAgents
- 并行工具调用:智能体提示词配置现包含
enable_parallel_tool_calls(布尔值,默认true)。启用后,支持的模型可在一次轮次中执行多个工具。 - 智能体模型:智能体 LLM 选项新增
gpt-6-astra。 - 告警:智能体告警现支持 Slack 频道,以及 PagerDuty 和 webhook 通知器。
- 电话号码搜索:新增基于游标分页的电话号码端点,可按提供商、外呼支持、已分配智能体和分支、标签及电话号码筛选。
图像和视频
- GPT Image 2.5 模型:图像生成现支持
gpt-image-2.5-flare和gpt-image-2.5-sunburst。两个模型均最多支持 10 张参考图像,质量级别最高可选max,支持 14 种固定宽高比及auto,并可输出 1K、2K 或 4K。
语音引擎
- 级联超时:语音引擎创建和更新请求现接受
cascade_timeout_seconds(数字,2–15,默认4),用于控制 ElevenLabs 在重试前等待上游语音引擎的时长。
文本转语音
- 多上下文轮次边界:现会在该轮次的每个缓冲字节后发送
is_final_audio_for_turn标记,包括 MP3 和 Opus 输出。客户端无需切换到 PCM,即可将此标记用作精确的轮次边界。
SDK 发布
JavaScript SDK
- v2.69.0 - 在实时文本转语音封装器中新增
transcriptEdit,编辑后的文本通过edited_transcript事件发送。修复带数据驻留后缀的 API 密钥的语音引擎 JWT 验证问题。新增phoneNumbers.listV2和 Flows 模板方法,可列出和获取模板,以及列出、创建和获取运行。重新生成了 GPT Image 2.5、Slack 智能体告警、并行工具调用、gpt-6-astra、服务账户 API 密钥并发限制、Music 零保留、对话筛选器和 MCP 工具审批状态的客户端和类型。
Python SDK
- v2.69.0 - 在实时文本转语音封装器中新增
transcript_edit,编辑后的文本通过edited_transcript事件发送。修复带数据驻留后缀的 API 密钥的语音引擎 JWT 验证问题,并让play在ffplay失败时抛出错误。新增phone_numbers.list_v2和 Flows 模板方法,可列出和获取模板,以及列出、创建和获取运行。重新生成了 GPT Image 2.5、Slack 智能体告警、并行工具调用、gpt-6-astra、服务账户 API 密钥并发限制、Music 零保留、对话筛选器和 MCP 工具审批状态的客户端和类型。
ElevenLabs CLI
- v1.3.2 - 新增可选
--intent元数据,以收集 CLI 使用反馈。新增elevenlabs feedback missing-capability,用于报告 CLI 不支持的工作流程。
API
查看 API 变更
新增端点
ElevenAgents
- 列出电话号码页面 -
GET /v1/convai/v2/phone-numbers- 新增可选
page_size(整数,1–1,000,默认100)和cursor(可为空的字符串)分页参数。 - 新增可选
search、label、phone_number、provider、supports_outbound、agent_id、branch_id、sort_by和sort_direction筛选器。sort_by接受label或phone_number;sort_direction默认为asc。 - 响应包含必填
phone_numbers(数组)、可选且可为空的next_cursor(字符串)和has_more(布尔值,默认false)。
- 新增可选
更新的端点
ElevenAgents
- 创建智能体、获取智能体 和 更新智能体
- 提示词配置新增
enable_parallel_tool_calls(布尔值,默认true)。工作流程覆盖项接受可为空的布尔值。 LLM枚举新增gpt-6-astra,包括对话发起覆盖项。- 告警集成通知器现使用
integration_type选择pagerduty或slack。Slack 通知器需要connection_id和channel_id(字符串);channel_id接受 1–64 个字符。
- 提示词配置新增
- 列出对话和解析对话引用
data_collection_params不再接受missing运算符。请使用空值来匹配未收集该字段的对话。dynamic_variable_params中的空值可匹配未设置该变量的对话。
- 创建语音引擎、获取语音引擎 和 更新语音引擎
- 新增
cascade_timeout_seconds(数字,2–15)。创建请求默认值为4,更新请求接受可为空的值,响应要求包含该字段。
- 新增
图像和视频
- 创建图像生成 -
POST /v1/flows/image- 为
gpt-image-2.5-flare和gpt-image-2.5-sunburst新增请求变体。 - 两种变体均需要
prompt和model_id,最多接受 10 个images,并新增resolution(1K、2K或4K,默认1K)。 quality接受low、medium、high、xhigh或max,默认为high。aspect_ratio接受auto和 14 种固定比例,默认为16:9。
- 为
配音
- 创建配音项目 -
POST /v1/dubbing/project- Multipart
keyterms接受重复字段或单个 JSON 数组。 - Multipart
webhook_ids接受重复字段、单个 JSON 数组或逗号分隔字符串。
- Multipart
- 获取工作区资源、共享工作区资源 和 取消共享工作区资源
WorkspaceResourceType新增dubbing_project。
知识库
- 创建爬取任务 -
POST /v1/convai/knowledge-base/crawl- 已弃用
max_depth(整数,默认3)。该字段现无实际作用,且不再有最小或最大限制。 - 爬取任务元数据不再要求
max_depth。
- 已弃用
用户
架构变更
文本转语音
- 多上下文 WebSocket
audio和final消息现将is_final_audio_for_turn定义为:在该轮次的所有缓冲字节均已发送后发生。
ElevenAgents
- 通话排队和等待音频:为达到并发上限的智能体新增通话排队。排队中的来电者会听到等待音频,并持续收到
queue_status事件,直至接入或超时。新增 API 方法可上传或删除自定义等待音频。 - 测试版本元数据:智能体测试结果现在会标识其运行所针对的智能体版本,以及是否包含草稿更改。调用摘要还会标识部分重新提交是否针对不同版本运行。
- 模型和账户元数据:智能体 LLM 配置现支持
gemini-3.8-flash。WhatsApp 账户响应会标识账户使用 Cloud API 还是共存注册流程。
音乐
- Music v2.5 API 支持:音乐端点和 SDK 现支持
music_v2_5。乐曲方案生成分块最多支持 6,132 个字符,最多 30 行,每行 200 个字符。
SDK 发布
JavaScript SDK
- v2.68.0 - 新增上传和删除智能体等待音频的方法。重新生成了通话排队、流程引用、草稿分支创建、RAG 查询限制、测试版本元数据、
gemini-3.8-flash和music_v2_5的类型。
Python SDK
- v2.68.0 - 新增同步和异步上传、删除智能体等待音频的方法。重新生成了通话排队、流程、草稿分支创建、RAG 查询限制、测试版本元数据、
gemini-3.8-flash和music_v2_5的类型。compose_detailed封装器现支持所有已生成的音乐模型 ID,以及基于提示词和分块的乐曲方案。
iOS SDK
- v3.3.1 - 现按
response_id而非event_id协调智能体消息,可保留工具调用前后的多个响应,并防止流式片段或修正内容附加到错误的消息。
ElevenLabs CLI
- v1.3.0 - 为生成的 API 命令新增可选
--intent元数据。新增elevenlabs feedback missing-capability,用于报告 CLI 不支持的工作流程。
软件包
- @elevenlabs/convai-widget-core@0.18.2 和 @elevenlabs/convai-widget-embed@0.18.2 - 修复工具和流程调用后出现重复智能体回复的问题。流式文本回复会保留 Markdown 格式,语音对话也不再渲染未说出的流式聊天片段。嵌入软件包还将
user_activity事件限制为每秒一次,并在会话结束时清除该限制。
API
查看 API 变更
新增端点
ElevenAgents
- 上传智能体等待音频 -
POST /v1/convai/agents/{agent_id}/hold-audio- 接受必填的
hold_audio_file(二进制)作为 multipart 表单数据。文件必须为 MP3 或 WAV,最大 40 MB、180 秒。 - 返回必填的
agent_id(字符串)和hold_audio(AgentHoldAudioConfig)。等待音频对象需要audio_path、audio_url、original_filename(字符串)、duration_secs(数字)和size_bytes(整数)。
- 接受必填的
- 删除智能体等待音频 -
DELETE /v1/convai/agents/{agent_id}/hold-audio- 删除自定义片段,使排队来电者听到默认等待音。
- 返回必填的
agent_id(字符串)。
更新的端点
ElevenAgents
- 创建智能体、获取智能体 和 更新智能体
- 新增可选
platform_settings.queueing_config(AgentQueueingConfig),包含enabled(布尔值,默认false)和wait_timeout_seconds(整数,1–1,800,默认180)。 - 队列配置响应包含只读、可为空的
hold_audio(AgentHoldAudioConfig)。智能体响应还包含可选default_hold_audio_url(字符串)。
- 新增可选
- 获取对话 -
GET /v1/convai/conversations/{conversation_id}- 元数据新增可选、可为空的
queue_wait_secs(数字)。排队时间不计入call_duration_secs和计费时长。
- 元数据新增可选、可为空的
- 创建智能体分支 -
POST /v1/convai/agents/{agent_id}/branches- 新增可选
include_draft(布尔值,默认false)。设为true时,从分支顶端创建的分支会包含调用方的草稿流程集。
- 新增可选
- 列出流程以及流程创建、获取和草稿端点
- 列表项新增可选
referenced_tool_ids、referenced_kb_ids、referenced_procedure_ids和referenced_dynamic_variables(字符串数组)。 - 智能体和合并预览响应新增可选
procedures,这是一个以流程 ID 为键的映射。
- 列表项新增可选
- 列出测试调用 -
GET /v1/convai/test-invocations- 新增可选、可为空的
search(字符串),可按名称筛选测试和文件夹。
- 新增可选、可为空的
- 在智能体上运行测试和获取测试调用
- 测试套件调用和单元测试运行响应新增可选、可为空的
version_id(字符串)以及可选ran_against_draft(布尔值,默认false)。 - 调用摘要还新增可选
runs_diverged_from_version(布尔值,默认false)。
- 测试套件调用和单元测试运行响应新增可选、可为空的
POST /v1/convai/agents/{agent_id}/knowledge-base/rag-query- 请求正文新增可选、可为空的查询专用覆盖项
max_documents_length(整数,1–50,000)和max_retrieved_rag_chunks_count(整数,1–20)。
- 请求正文新增可选、可为空的查询专用覆盖项
- 获取 WhatsApp 账户 -
GET /v1/convai/whatsapp-accounts/{phone_number_id}- 新增可选
account_type(WhatsAppAccountType,默认cloud_api)。可选值为cloud_api和coexistence。
- 新增可选
- 计算预期 LLM 用量 -
POST /v1/convai/agent/{agent_id}/llm-usage/calculateLLMUsageCalculatorLLMResponseModel新增必填price_per_message(数字)。
音乐
MusicModelID为POST /v1/music/video-to-music、POST /v1/music/plan、创作音乐、POST /v1/music/detailed、POST /v1/music/detailed/stream、POST /v1/music/stream、POST /v1/music/upload和POST /v1/music/finetunes新增music_v2_5。- 对于
POST /v1/music/plan、POST /v1/music、POST /v1/music/detailed、POST /v1/music/detailed/stream、POST /v1/music/stream和POST /v1/music/upload,GenerationChunk.text的maxLength从 6,000 个字符提高到 6,132 个字符。段落名称可包含 1–100 个字符,分块最多可包含 30 行,每行 200 个字符。
架构变更
ElevenAgents
- 实时服务器事件新增
queue_status。其必填queue_status_event.status接受waiting、admitted或timed_out;timed_out会先于 WebSocket 关闭代码4300发生。等待音频仍作为常规audio事件发送。 LLM枚举新增gemini-3.8-flash,包括对话发起覆盖项。- 对话系统工具结果联合类型新增
start_procedure_success、start_procedure_error、end_procedure_success和end_procedure_error。 FeaturesUsageCommonModel新增可选freeform_procedure和structured_procedure功能状态。
Scribe v2 Medical
Scribe v2 Medical 现已正式发布。这是一款专为医疗和临床音频设计的批量语音识别模型,计费标准与 Scribe v2 相同。
在创建转录文本时,将 model_id 设为 scribe_v2_medical。关键词提示、实体检测、说话人分离和非逐字模式的使用方式与 Scribe v2 相同。
ElevenAgents
- 工作区范围的对话工单:新增列出工作区工单,可获取有访问权限的智能体中的对话分诊工单。可按状态或负责人筛选,并使用游标分页,每页最多获取 100 个工单。
- 动态变量对话筛选:列出对话和文本搜索对话消息现接受可重复的
dynamic_variable_params筛选条件。使用name:op:value格式,op可为eq、gt、gte、lt或lte;比较运算符要求值为数值。 - Twilio 答录机检测:外呼电话和批量呼叫配置现支持可选的
twilio_machine_detection。选择enable可尽早判断是人工还是机器,选择detect_message_end则等待语音信箱问候语结束。结果将通过新的answering_machine_detectionwebhook 事件送达。 - 数据收集值约束:数据收集属性现可使用
allowed_values指定一个包含允许值的动态变量。此前的allowed_values_dynamic_variable字段已弃用。 - 智能体元数据:列出智能体分支响应现会指明草稿的创建时间,以及它是否早于分支最新提交。智能体和语音引擎摘要现在要求提供
voice_id。 - 知识库源 URL:智能体 RAG 查询分块现包含必需且可为 null 的
source_url,其中包含 URL 文档的追踪 URL。 - 智能体响应附件:
agent_responseWebSocket 事件现包含可选的attachments。每个附件都需要url和name,并可包含mime_type。
工作区
- API 密钥平台限制:服务账号 API 密钥响应现可包含企业版
platform_limits,涵盖额度、专业语音克隆,以及 TTS、配音和音乐的并发限制。
SDK 发布
JavaScript SDK
- v2.67.0 - 在对话列表和文本搜索请求中添加
dynamicVariableParams。重新生成 Twilio 答录机检测、数据收集值约束、API 密钥平台限制、智能体分支草稿元数据和知识库源 URL 的类型。
Python SDK
- v2.67.0 - 在同步和异步对话列表及文本搜索方法中添加
dynamic_variable_params。重新生成 Twilio 答录机检测、数据收集值约束、API 密钥平台限制、智能体分支草稿元数据和知识库源 URL 的类型。实时文本转语音客户端不再将内部 omit sentinel 传递给连接。
ElevenLabs CLI
- v1.2.0 - 添加
elevenlabs say命令及其智能体技能,重新生成 API 命令绑定,并将eleven_v3设为默认 TTS 模型。
软件包
- @elevenlabs/client@1.25.0、@elevenlabs/react@1.15.2、@elevenlabs/react-native@1.2.27、@elevenlabs/convai-widget-core@0.18.1 和 @elevenlabs/convai-widget-embed@0.18.1 - 从
@elevenlabs/client重新导出MessageAttachment,以便使用者直接导入该类型。 - @elevenlabs/client@1.24.0、@elevenlabs/types@0.23.0、@elevenlabs/react@1.15.1、@elevenlabs/react-native@1.2.26、@elevenlabs/convai-widget-core@0.18.0 和 @elevenlabs/convai-widget-embed@0.18.0 - 将智能体响应文件附件转发至
onMessage,并新增可选的webRtc.singlePeerConnection会话设置。组件还对问候按钮进行了本地化,并修复了文本聊天响应丢失或重复的问题。
API
查看 API 变更
新增端点
ElevenAgents
- 列出工作区工单 -
GET /v1/convai/triage-tickets- 列出调用方有权访问的所有智能体中的对话分诊工单,按创建时间从近到远排序。
- 添加可选的
page_size(整数,1–100,默认100)、status(AgentConversationTicketStatus)、assignee_user_id(字符串或unassigned)和cursor(字符串)查询参数。 - 返回
GetAgentConversationTicketsPageResponseModel。
已更新端点
ElevenAgents
- 列出对话 -
GET /v1/convai/conversations- 添加可选且可为 null 的
dynamic_variable_params(可重复字符串数组)。每个值使用name:op:value格式,其中op为eq、gt、gte、lt或lte。
- 添加可选且可为 null 的
- 文本搜索对话消息 -
GET /v1/convai/conversations/messages/text-search- 添加具有相同语法的可选且可为 null 的
dynamic_variable_params(可重复字符串数组)。
- 添加具有相同语法的可选且可为 null 的
- Twilio 外呼、SIP 中继外呼、Exotel 外呼和提交批量呼叫
telephony_call_config现使用独立的输入和输出 schema。- 添加可选且可为 null 的
twilio_machine_detection(TwilioMachineDetectionConfig)。其mode接受enable或detect_message_end,默认值为enable。非 Twilio 服务商和呼入电话会忽略此设置。
- 导入电话号码 -
POST /v1/convai/phone-numbers- 为 Twilio API 密钥导入添加可选且可为 null 的
account_auth_token(字符串),用于验证呼入 webhook 签名。
- 为 Twilio API 密钥导入添加可选且可为 null 的
Schema 变更
ElevenAgents
WebhookEventType新增answering_machine_detection。AgentBranchSummary新增可选且可为 null 的draft_created_at(整数)和可选的draft_is_behind_tip(布尔值,默认false)。AgentKnowledgeBaseRagChunkResponseModel新增必需且可为 null 的source_url(字符串)。AgentSummaryResponseModel和SpeechEngineSummaryResponse新增必需的voice_id(字符串)。AnalysisProperty新增可选且可为 null 的name(字符串)和allowed_values(AllowedValues)。LiteralJsonSchemaProperty也新增allowed_values。两者均弃用allowed_values_dynamic_variable。DataCollectionResultCommonModel新增可选且可为 null 的name(字符串)。WorkspaceApiKeyResponseModel新增可选且可为 null 的platform_limits(PlatformLimits)。- MCP 工具
Icon新增可选且可为 null 的theme(light或dark)。 SMBToolConfig新增send_custom_email、create_service_quote_request和create_product_quote_request参数变体。- Webhook 查询参数 schema 和电话呼叫配置现使用独立的输入和输出模型。
agent_responseWebSocket 事件新增可选的attachments(数组)。每项都需要url和name(字符串),并接受可选的mime_type(字符串)。
ElevenCreative
ReferenceVideo.studio_clip现使用StudioClipLocator替代StudioClipReference。字段和线缆格式保持不变。
ElevenAgents
- 电话按键输入:智能体对话配置现支持可选的
dtmf_input_settings,用于 DTMF 输入。可配置数字输入超时、使用#作为结束符,并从转录文本、日志和分析中隐藏按键输入内容。 - 对话附件历史记录:获取对话的转录条目现包含
file_inputs,这是一个数组,包含每个附件文件的 ID、名称、MIME 类型和 URL。 - 智能体标签筛选:列出智能体现接受可选的
tags查询参数。重复该参数可匹配带有任一指定标签的智能体。 - 批量活动上下文:获取对话现可通过可为 null 的
campaign元数据识别批量呼叫,其中包含必需的campaign_id和campaign_lead_id。
音乐
- 波形可视化数据:详细生成音乐、流式生成音乐及详情和上传音乐现接受可选的
with_waveform_visual(布尔值,默认false)。选择启用后,响应会返回低分辨率的waveform_visual整数数组,每秒包含 4 个采样点。
配音
SDK 发布
JavaScript SDK
- v2.66.0 - 为
sendMultimodalMessage添加fileIds,一条消息现在可包含多个文件附件。
Python SDK
- v2.66.0 - 为
send_multimodal_message添加file_ids,一条消息现在可包含多个文件附件。
Android SDK
- v0.12.2 - 连接会话事件时保留
onUnhandledClientToolCall回调。需要响应的未处理客户端工具调用现在会收到自动错误响应,而不再处于未解决状态。
ElevenLabs CLI
- v1.1.0 - 重新生成 API 命令绑定,并为 ElevenAgents workflow 添加命令级请求归因。这些命令会将
cmd/<command>追加到 CLI 的User-Agent,从而区分agents push和agents create等 workflow 发出的请求。
软件包
- @elevenlabs/client@1.23.0、@elevenlabs/react@1.15.0、@elevenlabs/types@0.22.1、@elevenlabs/react-native@1.2.25、@elevenlabs/convai-widget-core@0.17.1 和 @elevenlabs/convai-widget-embed@0.17.1 - 为
sendMultimodalMessage添加fileIds。客户端同时发送file和files字段以保持兼容性,React 则提供更新后的客户端 API。
API
查看 API 变更
已更新端点
ElevenAgents
- 列出智能体 -
GET /v1/convai/agents- 添加可选且可为 null 的
tags(字符串数组)。重复该查询参数可匹配任一指定标签。
- 添加可选且可为 null 的
- 创建智能体、获取智能体和更新智能体
- 添加可选且可为 null 的
conversation_config.conversation.dtmf_input_settings(DTMFInputConfig)。支持dtmf_input_timeout(数值,0.5–10 秒,默认2)、hash_terminator(布尔值,默认true)和redact_input(布尔值,默认false)。 - 在电话号码转接配置中添加可选的
sip_refer_play_dialtone(布尔值,默认true)。将其设为false,可在 SIP REFER 转接完成期间保持原始通话线路静音。 - 开始和结束流程系统工具现可接受
ProcedureVersionRef或ProcedureDraftRef。草稿引用需要procedure_id(字符串),并将version_id设为null。
- 添加可选且可为 null 的
- 获取对话 -
GET /v1/convai/conversations/{conversation_id}- 在转录条目中添加
file_inputs(ConversationHistoryTranscriptFileInputResponseModel数组)。每项都需要file_id、original_filename、mime_type和file_url(字符串)。 - 在批量呼叫元数据中添加可选且可为 null 的
campaign(BatchCallingCampaignInformation)。该对象需要campaign_id和campaign_lead_id(字符串)。 - 向
ChatSourceMedium添加dtmf。
- 在转录条目中添加
- 对话分诊工单问题类型新增
incorrect_information、documentation_gap、platform_bug和wrong_action。
音乐
- 详细生成音乐(
POST /v1/music/detailed)和流式生成音乐及详情(POST /v1/music/detailed/stream)- 添加可选的
with_waveform_visual(布尔值,默认false)。 - 详情响应新增可为 null 的
waveform_visual(整数数组),每秒采样 4 次,取值范围为-1000到1000。
- 添加可选的
- 上传音乐 -
POST /v1/music/upload- 在响应中添加可选的
with_waveform_visual(布尔值,默认false)和可为 null 的waveform_visual(整数数组)。
- 在响应中添加可选的
ElevenCreative
- 创建 Studio 项目和创建播客
quality_preset现接受null,并移除了其standardschema 默认值。
配音
- 列出配音项目 -
GET /v1/dubbing/projectpage_size仍为可选整数,默认值为20,但现在会将值限制在 1–100,而非拒绝请求。status筛选器现说明queued、preparing、ready和failed。- 将上一响应的
next_cursor传入cursor;获取第一页时省略该参数。
- 列出语言目标 -
GET /v1/dubbing/project/{project_id}/languagepage_size仍为可选整数,默认值为20,但现在会将值限制在 1–100,而非拒绝请求。status筛选器支持queued、processing、completed、stale和failed。- 将上一响应的
next_cursor传入cursor;获取第一页时省略该参数。
Schema 变更
工作区
PendingSubscriptionSwitchResponseModel.next_tier新增grant。