Run tests on agent

POST

/v1/convai/agents/:agent_id/run-tests

POST

/v1/convai/agents/:agent_id/run-tests

curl -X POST https://api.elevenlabs.io/v1/convai/agents/agent_3701k3ttaq12ewp8b7qv5rfyszkz/run-tests \
     -H "Content-Type: application/json" \
     -d '{
  "tests": [
    {
      "test_id": "test_id"
    }
  ]
}'

{
  "id": "id",
  "test_runs": [
    {
      "test_run_id": "test_run_id",
      "test_invocation_id": "test_invocation_id",
      "agent_id": "agent_id",
      "status": "pending",
      "test_id": "test_id",
      "test_info": {
        "type": "llm"
      },
      "branch_id": "branch_id",
      "version_id": "version_id",
      "ran_against_draft": true,
      "workflow_node_id": "workflow_node_id",
      "agent_responses": [
        {
          "role": "user",
          "time_in_call_secs": 1
        }
      ],
      "test_name": "test_name",
      "condition_result": {
        "result": "success"
      },
      "last_updated_at_unix": 1,
      "metadata": {
        "workspace_id": "workspace_id",
        "test_name": "test_name",
        "ran_by_user_email": "ran_by_user_email"
      },
      "root_folder_id": "root_folder_id",
      "root_folder_name": "root_folder_name",
      "environment": "environment",
      "credits_used": 1
    }
  ],
  "agent_id": "agent_id",
  "branch_id": "branch_id",
  "version_id": "version_id",
  "ran_against_draft": true,
  "created_at": 1,
  "folder_id": "folder_id",
  "repeat_count": 1,
  "cancelled": true,
  "bucketing_status": "pending",
  "result_groups": [
    {
      "test_id": "test_id",
      "test_name": "test_name",
      "buckets": [
        {
          "test_run_ids": [
            "test_run_ids"
          ],
          "title": "title",
          "reason": "reason",
          "status": "pending"
        }
      ],
      "workflow_node_id": "workflow_node_id"
    }
  ]
}

Run selected tests on the agent with provided configuration. If the agent configuration is provided, it will be used to override default agent configuration.

Parametry ścieżki

agent_idstringWymagany

The id of an agent. This is returned on agent creation.

Żądanie

This endpoint expects an object.

testslist of objectsWymagany

List of tests to run on the agent

agent_config_overrideobjectOpcjonalny

Configuration overrides to use for testing. If not provided, the agent's default configuration will be used.

branch_idstringOpcjonalny

ID of the branch to run the tests on. If not provided, the tests will be run on the agent's main branch.

repeat_countintegerOpcjonalny1-50Domyślnie 1

Number of times to run each test. When greater than 1, results are grouped and summarized.

Odpowiedź

Successful Response

idstring

test_runslist of objects

agent_idstringOpcjonalny

branch_idstringOpcjonalny

version_idstringOpcjonalny

ran_against_draftbooleanOpcjonalnyDomyślnie false

created_atintegerOpcjonalny

folder_idstringOpcjonalny

repeat_countintegerOpcjonalnyDomyślnie 1

cancelledbooleanOpcjonalnyDomyślnie false

bucketing_statusenumOpcjonalny

None when repeat_count==1 (no bucketing). Otherwise tracks bucketing lifecycle.

Dozwolone wartości:

result_groupslist of objectsOpcjonalny

Błędy

422

Agents Run Tests Request Unprocessable Entity Error

Parametry ścieżki

Nagłówki

Żądanie

Odpowiedź

Błędy