Run tests on agent

POST

/v1/convai/agents/:agent_id/run-tests

POST

/v1/convai/agents/:agent_id/run-tests

curl -X POST https://api.elevenlabs.io/v1/convai/agents/agent_3701k3ttaq12ewp8b7qv5rfyszkz/run-tests \
     -H "Content-Type: application/json" \
     -d '{
  "tests": [
    {
      "test_id": "test_id"
    }
  ]
}'

{
  "id": "id",
  "test_runs": [
    {
      "test_run_id": "test_run_id",
      "test_invocation_id": "test_invocation_id",
      "agent_id": "agent_id",
      "status": "pending",
      "test_id": "test_id",
      "test_info": {
        "type": "llm"
      },
      "branch_id": "branch_id",
      "version_id": "version_id",
      "ran_against_draft": true,
      "workflow_node_id": "workflow_node_id",
      "agent_responses": [
        {
          "role": "user",
          "time_in_call_secs": 1
        }
      ],
      "test_name": "test_name",
      "condition_result": {
        "result": "success"
      },
      "last_updated_at_unix": 1,
      "metadata": {
        "workspace_id": "workspace_id",
        "test_name": "test_name",
        "ran_by_user_email": "ran_by_user_email"
      },
      "root_folder_id": "root_folder_id",
      "root_folder_name": "root_folder_name",
      "environment": "environment",
      "credits_used": 1
    }
  ],
  "agent_id": "agent_id",
  "branch_id": "branch_id",
  "version_id": "version_id",
  "ran_against_draft": true,
  "created_at": 1,
  "folder_id": "folder_id",
  "repeat_count": 1,
  "cancelled": true,
  "bucketing_status": "pending",
  "result_groups": [
    {
      "test_id": "test_id",
      "test_name": "test_name",
      "buckets": [
        {
          "test_run_ids": [
            "test_run_ids"
          ],
          "title": "title",
          "reason": "reason",
          "status": "pending"
        }
      ],
      "workflow_node_id": "workflow_node_id"
    }
  ]
}

Run selected tests on the agent with provided configuration. If the agent configuration is provided, it will be used to override default agent configuration.

Paramètres de chemin

agent_idstringRequis

The id of an agent. This is returned on agent creation.

Requête

This endpoint expects an object.

testslist of objectsRequis

List of tests to run on the agent

agent_config_overrideobjectOptionnel

Configuration overrides to use for testing. If not provided, the agent's default configuration will be used.

branch_idstringOptionnel

ID of the branch to run the tests on. If not provided, the tests will be run on the agent's main branch.

repeat_countintegerOptionnel1-50Par défaut 1

Number of times to run each test. When greater than 1, results are grouped and summarized.

Réponse

Successful Response

idstring

test_runslist of objects

agent_idstringOptionnel

branch_idstringOptionnel

version_idstringOptionnel

ran_against_draftbooleanOptionnelPar défaut false

created_atintegerOptionnel

folder_idstringOptionnel

repeat_countintegerOptionnelPar défaut 1

cancelledbooleanOptionnelPar défaut false

bucketing_statusenumOptionnel

None when repeat_count==1 (no bucketing). Otherwise tracks bucketing lifecycle.

Valeurs autorisées:

result_groupslist of objectsOptionnel

Erreurs

422

Agents Run Tests Request Unprocessable Entity Error

Paramètres de chemin

En-têtes

Requête

Réponse

Erreurs