Skip to main content
Bulk Create Evaluation Set Items
curl --request POST \
  --url https://api-prod.extend.app/evaluation_set_items/bulk \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "evaluationSetId": "<string>",
  "items": [
    {}
  ]
}
'
{
  "success": true,
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "eval_item_1234",
      "evaluationSetId": "eval_set_1234",
      "fileId": "file_1234",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    },
    {
      "object": "evaluation_set_item",
      "id": "eval_item_5678",
      "evaluationSetId": "eval_set_5678",
      "fileId": "file_5678",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    }
  ]
}

Documentation Index

Fetch the complete documentation index at: https://docs.extend.app/llms.txt

Use this file to discover all available pages before exploring further.

If you have a large number of files that you need to add to an evaluation set, you can use this endpoint to create multiple evaluation set items at once. This can be useful if you have a large dataset that you need to evaluate the performance of a processor against. Note: you still need to create each File first using the file API.

Body

evaluationSetId
string
required
The ID of the evaluation set to add the items to.
items
array
required
An array of objects representing the evaluation set items to create. Each object should have the following fields:

Response

{
  "success": true,
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "eval_item_1234",
      "evaluationSetId": "eval_set_1234",
      "fileId": "file_1234",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    },
    {
      "object": "evaluation_set_item",
      "id": "eval_item_5678",
      "evaluationSetId": "eval_set_5678",
      "fileId": "file_5678",
      "expectedOutput": {
        // Output object - see “Processor output types” for details
      },
      "createdAt": "2024-01-01T00:00:00Z",
      "updatedAt": "2024-01-01T00:00:00Z"
    }
  ]
}