Eleven v3

v3 is out of alpha - it’s more stable, accurate and has lower latency. Read more about Eleven v3.

Text-to-Dialogue

  • WAV output formats: Text-to-Dialogue endpoints now support WAV output formats (wav_8000, wav_16000, wav_22050, wav_24000, wav_32000, wav_44100, wav_48000) in addition to existing MP3, PCM, OPUS, and other formats. WAV formats with 44.1kHz sample rate require a Pro tier subscription or above.

Agents Platform

  • Agent branch renaming: You can now rename agent branches using the Update branch endpoint. The new optional name field accepts 1-140 characters.
  • Alignment guardrails: Added AlignmentGuardrail type to GuardrailsV1 schema for enhanced conversation safety controls.
  • Speculative turn configuration: Added speculative_turn field to turn configuration for fine-tuning agent turn-taking behavior.
  • Procedure references: Agent patch requests now support procedure_refs for referencing reusable procedures.
  • Webhook response filtering: Added response_filter_mode and response_filters fields to webhook overrides, with new ResponseFilterMode enum for controlling which response data is passed through.
  • Error details in tool events: Added raw_error_message field to API integration webhook, system, and workflow tool event models for improved debugging.
  • Flexible tool call matching: Testing models now include check_any_tool_matches option to relax tool call matching requirements during agent testing.
  • Secrets pagination: Get workspace secrets endpoint now supports pagination with page_size (max 100) and cursor query parameters, returning next_cursor and has_more in responses.

Workspaces

  • Permission clarifications: Workspace group and invite endpoints now document specific permission requirements (group_members_manage for group member operations, WORKSPACE_MEMBERS_INVITE for workspace invitations) instead of requiring workspace administrator status.
  • New permission types: Added group_members_manage and terms_of_service_accept to the PermissionType enum.

User

  • Compliance terms visibility: Added show_compliance_terms field to user response model.

Metrics

  • ASR provider tracking: Added convai_asr_provider field to metrics for tracking automatic speech recognition provider usage.

SDK Releases

Python SDK

  • v2.34.0 - Added WAV output formats for Text-to-Dialogue, webhook response filtering, agent branch renaming, secrets pagination, and speculative turn configuration
  • v2.33.1 - Fixed bug with URL streaming in Scribe
  • v2.33.0 - Fixed bug with agent initialization and user_id handling, added audio alignment callback for agent conversations

JavaScript SDK

  • v2.34.0 - Added WAV output formats for Text-to-Dialogue, webhook response filtering, agent branch renaming, secrets pagination, and speculative turn configuration

React and Client SDKs

Widget Packages

API

Updated Endpoints

Text-to-Dialogue

  • Text to Dialogue, Text to Dialogue with timestamps
    • Added WAV output formats to output_format parameter: wav_8000, wav_16000, wav_22050, wav_24000, wav_32000, wav_44100, wav_48000
    • Updated description to clarify that WAV formats with 44.1kHz sample rate require Pro tier subscription
    • Added NonStreamingOutputFormats schema reference for non-streaming endpoints

Agents Platform

  • Update agent branch
    • Added optional name field (string, 1-140 characters, nullable) for renaming branches
  • Get workspace secrets
    • Added page_size query parameter (integer, optional, max 100) for pagination
    • Added cursor query parameter (string, optional) for fetching next page
    • Response now includes next_cursor (string) and has_more (boolean) fields
  • Create agent, Update agent
    • Added speculative_turn field to turn configuration
    • Added procedure_refs field to agent patch schema
    • Added AlignmentGuardrail to GuardrailsV1 schema
    • Added response_filter_mode and response_filters to webhook overrides
  • Create agent test, Update agent test
    • Added check_any_tool_matches field (boolean, optional) for relaxed tool call matching

Workspaces

User

  • Get user info
    • Added show_compliance_terms field (boolean) to response

Schema Changes

New Schemas

  • NonStreamingOutputFormats - Enum for non-streaming audio output formats including WAV variants
  • ResponseFilterMode - Enum for webhook response filtering modes
  • AlignmentGuardrail - Configuration for alignment-based conversation guardrails

Modified Schemas

  • SongMetadata - Removed bpm and time_signature fields
  • PermissionType - Added group_members_manage and terms_of_service_accept enum values
  • TurnConfig - Added speculative_turn field
  • GetWorkspaceSecretsResponseModel - Added next_cursor and has_more pagination fields
  • UserResponseModel - Added show_compliance_terms field
  • WebhookToolApiConfigOutput - Added response_filter_mode and response_filters fields
  • AgentTestingCriteriaEvaluateToolCall - Added check_any_tool_matches field
  • Multiple tool event models (ApiIntegrationWebhookToolEventModel, SystemToolEventModel, WorkflowToolEventModel) - Added raw_error_message field