The EvaluationSetItem object

The EvaluationSetItem object represents an item in an evaluation set in Extend. Items are the individual files and expected outputs that are used to evaluate the performance of a given processor in Extend.

Hide properties

object · string

The type of the object, in this case it will always be “evaluation_set_item”.

id · string

The evaluation set item ID.

evaluationSetId · string

The ID of the evaluation set that this item belongs to.

fileId · string

The ID of the file associated with this item.

expectedOutput · object

The expected output of the processor when run against the file.

This should be a JSON object conforming to the output type schema of the processor.

createdAt · string

The date and time the evaluation set item was created.

updatedAt · string

The date and time the evaluation set item was last updated.

Example EvaluationSetItem

{
  "object": "evaluation_set_item",
  "id": "eval_item_1234",
  "evaluationSetId": "eval_set_1234",
  "fileId": "file_1234",
  "expectedOutput": {
    // Output object - see “Processor output types” for details
  },
  "createdAt": "2024-01-01T00:00:00Z",
  "updatedAt": "2024-01-01T00:00:00Z"
}