Evaluation

Node catalog Artificial intelligence

On this page

Score outputs against expected values

Usage and specifics

exact and contains modes are local; llm_judge uses a model and AI credential. Output exposes pass, score, expected and actual.

Technical type : ai_evaluation. Runtime : nodulz.

Credentials and prerequisites

Create and configure the credential : ai-model

Create credentials in your nodulz instance’s Credentials area, then select them on the node. Availability depends on ownership and sharing. See the credentials guide for access and rotation.

Parameters

Names below are technical keys. Defaults are not a ready-to-run configuration: complete fields required by your operation. Paths containing [] describe list items; some fields depend on the selected mode.

Parameter	Type	Default	Values / limits
`expected`	`string`	`""`	-
`actual`	`string`	`""`	-
`mode`	`enum`	`"contains"`	`exact`, `contains`, `llm_judge`
`credentialId`	`string`	-	-
`model`	`string`	`""`	-

Initial configuration

Initial catalog configuration example, to adapt before running. Keep secrets in credentials.

json

{
  "expected": "",
  "actual": "",
  "mode": "contains",
  "model": ""
}

Verification

Test with representative data. Check node output in the inspector and logs, then use editor mapping for downstream fields. A trigger test with a simulated payload does not validate external service delivery.