Conversational AI
- HIPAA compliance: Conversational AI is now HIPAA compliant on appropriate plans, when a BAA is signed, zero-retention mode is enabled and appropriate LLMs are used. For access please contact sales
- Cascade LLM: Added dynamic dispatch during the LLM step to other LLMs if your default LLM fails. This results in higher latency but prevents the turn failing.
- Better error messages: Added better error messages for websocket failures.
- Audio toggling: Added ability to select only user or agent audio in the conversation playback.
Scribe
- HIPAA compliance: Added a zero retention mode to Scribe to be HIPAA compliant.
- Diarization: Increased time length of audio files that can be transcribed with diarization from 8 minutes to 2 hours.
- Cheaper pricing: Updated Scribe’s pricing to be cheaper, as low as $0.22 per hour for the Business tier.
- Memory usage: Shipped improvements to Scribe’s memory usage.
- Fixed timestamps: Fixed an issue that was causing incorrect timestamps to be returned.
- Biased keywords: Added biased keywords to improve Scribe’s performance.
Text to Speech
- Pronunciation dictionaries: Fixed pronunciation dictionary rule application for replacements that contain symbols.
Dubbing
- Studio support: Added support for creating dubs with
dubbing_studio
enabled, allowing for more advanced dubbing workflows beyond one-off dubs.
Voices
- Verification: Fixed an issue where users on probation could not verify their voice clone.
API
View API changes
New Endpoints
- Added 7 new endpoints:
Updated Endpoints
Studio Projects
- Updated Studio project endpoints to add
source_type
property and deprecatequality_check_on
andquality_check_on_when_bulk_convert
properties:
Voice Management
- Updated Voice endpoints with several property changes:
- Get voice - Made several properties optional and added
preview_url
- Create voice - Made several properties optional and added
preview_url
- Create voice from preview - Made several properties optional and added
preview_url
- Get similar voices - Made
language
,description
,preview_url
, andrate
properties optional
- Get voice - Made several properties optional and added
Conversational AI
- Updated Conversational AI agent endpoints:
- Update agent - Modified
conversation_config
,agent
,platform_settings
, andwidget
properties - Create agent - Modified
conversation_config
,agent
,prompt
, platform_settings, widget properties and addedshareable_page_show_terms
- Get agent - Modified
conversation_config
,agent
,platform_settings
, andwidget
properties - Get widget - Modified
widget_config
property and addedshareable_page_show_terms
- Update agent - Modified
Knowledge Base
- Updated Knowledge Base endpoints to add metadata property:
Other Updates
- Dub a video or audio file - Added
dubbing_studio
property - Convert text to sound effects - Added
output_format
query parameter - Convert speech to text - Added
enable_logging
query parameter - Get secrets - Modified
secrets
andused_by
properties - Get all pronunciation dictionaries - Made
next_cursor
property optional
Removed Endpoints
-
Temporarily removed Conversational AI tools endpoints:
- Get tool
- List tools
- Update tool
- Create tool
- Delete tool