User Audio ChunkobjectRequired
Send audio data chunks from the user to the server for processing.
FeedbackobjectRequired
Feedback score for a specific agent response event.
User MessageobjectRequired
Text message sent by the user to the conversation.
User ActivityobjectRequired
Activity ping to prevent agent interruption and indicate user presence.
Multimodal MessageobjectRequired
A message combining text and a file reference, sent by the user to the conversation.
PongobjectRequired
Response message to server ping requests for latency measurement.
Contextual UpdateobjectRequired
Non-interrupting content sent to update the conversation state without disrupting the flow.
Conversation Initiation Client DataobjectRequired
Client configuration data to override default conversation settings.
Agent Response CompleteobjectRequired
Notification that the agent has finished generating a complete response.
Client ErrorobjectRequired
Error event sent when an error occurs during the conversation.
Guardrail TriggeredobjectRequired
Notification that a guardrail was triggered during the conversation.
User TranscriptobjectRequired
Real-time transcriptions of user speech input.
Agent ResponseobjectRequired
Text responses generated by the AI agent.
Agent Response CorrectionobjectRequired
Correction to a previous agent response.
Audio ResponseobjectRequired
Synthesized audio chunks of the agent's speech response.
InterruptionobjectRequired
Notification that the agent's current response was interrupted.
VAD ScoreobjectRequired
Voice Activity Detection scoring information.
Agent Chat Response PartobjectRequired
Streaming text chunks of an agent's chat response.
PingobjectRequired
Server-initiated ping messages for measuring connection latency.
Mcp Connection StatusobjectRequired
MCP connection status update with integration connection states.
