ElevenAgents

  • New widget configuration options: Several new settings are now available for the ElevenAgents conversation widget in the agent dashboard:

    • Collapsible widget (widget.dismissible): Allow users to minimize or dismiss the widget during a conversation.
    • Action indicator (widget.show_agent_status): Display a visual indicator when the agent is actively using tools, with distinct states for working, done, and error. Enabling this setting automatically adds agent_tool_request and agent_tool_response to the agent’s client events.
    • Conversation ID display (widget.show_conversation_id): Show the conversation ID to users after a call ends. Defaults to true for both new and existing agents.
    • Audio tag visibility (widget.strip_audio_tags): Hide audio tags from conversation transcripts. Defaults to true for both new and existing agents.
    • Syntax highlighting theme (widget.syntax_highlight_theme): Configure code block highlighting in transcripts. Accepts null (Auto), light, or dark.
  • Folder-aware agent testing: The List agent tests endpoint now supports organizing tests into folders. Added parent_folder_id, include_folders, and sort_mode query parameters for filtered listing. Test creation and update endpoints accept parent_folder_id to assign tests to folders, and test summaries now include entity type, parent folder path, and children count.

  • Workflow say node: Added a new say node type to agent workflows (WorkflowSayNodeModel). This node supports conversation_config, additional_prompt, and tool and knowledge base overrides. The node’s message payload uses a discriminated union with two variants: literal (static text via text) and prompt (LLM-generated via prompt).

  • SMB tool configuration: Formalized the SMBToolConfig schema with a required, discriminated params object. Supported operation types are create, list, search, update, and delete, each applicable to SMB entity categories including clients, staff, services, products, and assets.

  • Summary language for agents: Added summary_language field to agent configuration to specify the language for post-conversation summaries.

  • Twilio call recording: Added optional call_recording_enabled field to the Twilio outbound call request body to enable recording of outbound calls.

  • WhatsApp messaging flag: Added enable_messaging flag to WhatsApp account models and update requests to control whether messaging is enabled for a given phone number.

Pronunciation Dictionaries

  • Set all rules at once: New Set rules endpoint (POST /v1/pronunciation-dictionaries/{pronunciation_dictionary_id}/set-rules) replaces all existing rules in a pronunciation dictionary in a single call, as an alternative to incrementally adding or removing individual rules.

  • Rule matching options: Added case_sensitive (boolean) and word_boundaries (boolean) fields to pronunciation dictionary rule definitions for more precise control over how rules match text.

Music

  • Upload audio: New Upload music endpoint (POST /v1/music/upload) accepts a multipart/form-data request with an audio file. Optionally extracts a composition plan from the uploaded audio and returns a MusicUploadResponse with a song_id.

  • Phonetic name support: Added use_phonetic_names parameter to Generate music, Generate music detailed, and Stream music endpoints.

  • Song ID in responses: Music generation responses now surface the song_id field, making it easier to reference generated songs in subsequent API calls.

Audio Native

  • Update project content from URL: New Update content endpoint (POST /v1/audio-native/content) allows updating an AudioNative project by providing a URL. The endpoint extracts the content from the URL and queues it for conversion and auto-publishing.

Voices

  • Voice bookmarking: Added bookmarked field to voice update requests and is_bookmarked to voice response objects, enabling users to bookmark voices for easy access.

SDK Releases

JavaScript SDK

  • v2.37.0 - Added support for surfacing song_id in music generation responses. Updated to include latest API schema changes from Fern regeneration.

Python SDK

  • v2.37.0 - Added support for new music generation parameters and surfacing song_id in music generation responses. Updated to include latest API schema changes from Fern regeneration.

Packages

  • @elevenlabs/convai-widget-core@0.10.0 - Propagated event_id through transcript and streaming callbacks. Refactored tool status tracking from Map-based to inline transcript entries with a display-transcript utility. Added show-conversation-id config option (boolean, defaults to true) to control visibility of conversation ID in disconnection messages.
  • @elevenlabs/convai-widget-embed@0.10.0 - Propagated event_id through transcript and streaming callbacks. Refactored tool status tracking to inline transcript entries.
  • @elevenlabs/types@0.6.0 - Propagated event_id through transcript and streaming callbacks.

API

New Endpoints

  • Set pronunciation dictionary rules - POST /v1/pronunciation-dictionaries/{pronunciation_dictionary_id}/set-rules - Replace all rules in a pronunciation dictionary in a single call
  • Upload music - POST /v1/music/upload - Upload an audio file to create or reference a song, optionally extracting a composition plan
  • Update Audio Native content from URL - POST /v1/audio-native/content - Update an AudioNative project by extracting content from a provided URL and queuing for conversion

Updated Endpoints

ElevenAgents

  • List agent tests

    • Added parent_folder_id query parameter (string, optional) to filter tests by folder
    • Added include_folders query parameter (boolean, optional) to include folder objects in results
    • Added sort_mode query parameter (string, optional) to control result ordering
    • Response now includes folder metadata: entity type, parent path, and children count on UnitTestSummaryResponseModel
  • Create agent test, Update agent test

    • Added parent_folder_id field (string, optional) for assigning a test to a folder
  • Create agent, Update agent, Get agent

    • Added summary_language field (string, optional) to agent configuration for post-conversation summary language
    • Added widget.dismissible (boolean) - allow users to collapse or dismiss the widget
    • Added widget.show_agent_status (boolean) - display tool usage status indicator in widget
    • Added widget.show_conversation_id (boolean) - show conversation ID after call ends; defaults to true
    • Added widget.strip_audio_tags (boolean) - hide audio tags from transcripts; defaults to true
    • Added widget.syntax_highlight_theme (string, nullable) - code block highlighting theme (null, light, or dark)
    • Added new workflow node type say with WorkflowSayNodeModel schema, including conversation_config, additional_prompt, and tool/knowledge base overrides; message payload supports literal and prompt discriminated variants
  • Twilio outbound call

    • Added call_recording_enabled field (boolean, optional) to enable recording of outbound Twilio calls
  • Update WhatsApp account

    • Added enable_messaging field (boolean, optional) to enable or disable messaging for the account
  • Update webhook

    • Added schema_overrides field (object, optional) for customizing webhook payload schema

Pronunciation Dictionaries

Music

Voices

Schema Changes

New Schemas

  • WorkflowSayNodeModel - Workflow node for agent say operations with conversation config, prompts, and tool overrides
  • WorkflowSayNodeMessageLiteral - Literal (static text) message payload for say nodes
  • WorkflowSayNodeMessagePrompt - Prompt-based (LLM-generated) message payload for say nodes
  • MusicUploadResponse - Response model for music upload including song_id
  • SMBToolConfigCreateClientParams, SMBToolConfigListClientsParams, SMBToolConfigSearchClientsParams, SMBToolConfigUpdateClientParams, SMBToolConfigDeleteClientParams - Discriminated parameter types for SMB tool operations

Modified Schemas

  • AgentConfig - Added summary_language field
  • WidgetConfigV2 - Added dismissible, show_agent_status, show_conversation_id, strip_audio_tags, and syntax_highlight_theme fields
  • SMBToolConfig - params field is now required and uses a discriminated union
  • PronunciationDictionaryRule - Added case_sensitive and word_boundaries fields
  • CustomGuardrailConfig - model field is now optional with a default value
  • UnitTestSummaryResponseModel - Added folder metadata fields: entity type, parent path, children count