Scribe v2 Realtime
Scribe v2 Realtime, our fastest and most accurate live speech recognition model, has officially launched. It delivers state-of-the-art accuracy in over 92 languages with an ultra-low 150ms of latency. Read more here.
Agents Platform
- Widget end-call feedback: Widgets now support customizable end-of-call feedback collection with optional rating and comment fields, enabling you to gather user feedback directly within your agent conversations.
- Soft timeout configuration: Added comprehensive soft timeout settings to control how agents handle pauses in conversation, with configurable prompts and behavior across turn and conversation levels.
- Advanced conversation filtering: The conversations endpoint now supports filtering by call duration range, evaluation parameters, data collection parameters, and specific tool names.
- Enhanced conversation feedback: Updated conversation feedback system with structured feedback types including ratings and comments for better user experience tracking.
Studios
- Extended project metadata: Projects now include comprehensive asset tracking with video thumbnails, external audio references, and enhanced snapshot information including audio duration.
Billing
- Enhanced invoice details: Invoice responses now include detailed discount information with a new
discountsarray, replacing the deprecateddiscount_percent_offanddiscount_amount_offfields. Thesubtotal_centsandtax_centsfields provide clearer invoice breakdowns.
Music API
- Stem separation latency improvements: The stem separation endpoint has been updated to better handle audio files and provide more predictable latency for processing requests.
SDK Releases
JavaScript SDK
- v2.23.0 - Updated Speech to Text (Scribe) endpoint to
scribe_realtimeand exported additional TypeScript types for improved developer experience. - v2.22.0 - Updated with latest API schema changes including conversation filtering, soft timeout configuration, and widget feedback features.
Python SDK
- v2.22.1 - Updated Speech to Text (Scribe) endpoint to
scribe_realtimeand fixed circular import issues for improved stability. - v2.22.0 - Updated with latest API schema changes including conversation filtering, soft timeout configuration, and widget feedback features.
Agents Packages
- @elevenlabs/client@0.10.0 - Updated realtime endpoint configuration and improved documentation.
- @elevenlabs/react@0.10.0 - Updated realtime endpoint configuration and improved documentation.
- @elevenlabs/types@0.2.0 - Updated type definitions to match latest API schema changes.
- @elevenlabs/react@0.9.2 - Minor bug fixes and stability improvements.
- @elevenlabs/convai-widget-embed@0.5.1 - Updated widget embed functionality with end-call feedback support.
- @elevenlabs/convai-widget-core@0.5.1 - Added end-call feedback configuration to widget core.
- @elevenlabs/convai-widget-embed@0.5.0 - Added support for customizable end-of-call feedback collection.
- @elevenlabs/convai-widget-core@0.5.0 - Introduced
WidgetEndFeedbackConfigandWidgetEndFeedbackTypefor feedback handling. - @elevenlabs/client@0.9.2 - Updated client configuration with latest API changes.
Android SDK
- v0.5.0 - Added
setVolumeandgetVolumefunctions for programmatic audio control, with example implementation including a volume seek bar in the sample app.
API
View API changes
Updated Endpoints
Agents Platform
Conversation Management
-
- Added
call_duration_min_secsquery parameter (integer) to filter conversations by minimum call duration - Added
call_duration_max_secsquery parameter (integer) to filter conversations by maximum call duration - Added
evaluation_paramsquery parameter (array of strings) for filtering by evaluation criteria - Added
data_collection_paramsquery parameter (array of strings) for filtering by data collection parameters - Added
tool_namesquery parameter (array of strings) to filter conversations that used specific tools
- Added
-
- Now uses
ConversationFeedbackRequestModelwith structured feedback types - Added
typefield to specify feedback category - Added
ratingfield for numeric feedback - Added
commentfield for text feedback
- Now uses
Agent Configuration
- Get agent widget
- Added
end_feedbackfield withWidgetEndFeedbackConfigfor configuring end-of-call feedback collection - Supports optional rating and comment fields in feedback forms
- Added
- Get agent & Update agent
- Response schema updated to include new platform configuration options
- Request schema enhanced with additional settings fields
Turn and Conversation Configuration
-
Create agent, Simulate conversation, Simulate conversation stream
- Added
soft_timeout_configfield for controlling pause behavior during conversations - Added
turnconfiguration overrides viaTurnConfigOverrideandTurnConfigOverrideConfig - Added
initial_wait_timetoTurnConfigfor controlling initial response timing - Configuration available at conversation and workflow override levels
- Added
Testing
-
- Request schema enhanced for workflow expression support
- Response schema updated with additional test result fields
-
- Response includes enhanced test result data
- Updated schema for workflow expression results
Projects and Studio
-
- Added
assetsfield (required) containing videos and external audio references - Introduced
ProjectVideoResponseModelfor video asset metadata - Introduced
ProjectExternalAudioResponseModelfor external audio tracking - Introduced
ProjectVideoThumbnailSheetResponseModelfor video thumbnails
- Added
-
- Response restructured with new
ProjectSnapshotExtendedResponseModel - Added
audio_duration_secsfield (required) to snapshot data - Removed
character_alignmentsfromProjectSnapshotResponseModel - Introduced
ProjectSnapshotsResponseModelfor snapshot collections
- Response restructured with new
Billing
- Get subscription
- Added
discountsarray (required) withDiscountResponseModelentries - Deprecated
discount_percent_offfield (still available but marked for removal) - Deprecated
discount_amount_offfield (still available but marked for removal) - Added
subtotal_centsfield (integer, nullable) for pre-tax invoice totals - Added
tax_centsfield (integer, nullable) for tax amounts - Updated invoice examples to include new discount and total fields
- Added
Speech to Text
- Transcribe audio
- Response schema updated with enhanced transcription data
Text to Speech
-
Text to speech with timestamps & Stream text to speech with timestamps
- Response schema updated with enhanced timestamp data
-
Text to dialogue with timestamps & Stream text to dialogue with timestamps
- Response schema updated with enhanced timestamp and voice segment data
Voice Management
-
Get voice, Get voice settings, Get default voice settings
- Response schemas updated with new voice metadata and configuration fields
-
- Request schema updated for voice settings modification
-
- Response schema updated with new voice generation data
Professional Voice Cloning (PVC)
- Get PVC sample audio & Get PVC separated speaker audio
- Response schemas updated for audio sample retrieval
Language Presets
- Language preset models now include
soft_timeout_translationfield for localized soft timeout messages
API Integration Triggers
- Registered new API collection:
convai_api_integration_trigger_connections
Deprecations
- Invoice fields
discount_percent_offanddiscount_amount_offare deprecated; usediscountsarray instead