Skip to main content
MindStudio
Pricing
BlogAbout
My Workspace
Utilities

[TypeSafe] Evaluate

Ask TypeSafe structured questions about text or JSON and get calibrated answers. The model returns a probability, a selected option, or a score. It does not write a reply. Each question is a noul (yes or no, as a probability from 0 to 1), a choice (one option from a set you define, with a probability for each), or a score (a rating against ordered levels). Put every question in the same call. The question id is yours: answers come back under the same ids. The model defaults to Jev (jev-latest).

About this capability

  • state is the content to judge: a string, or a JSON object or array (a record, a chat log, application state). Text only. Turn images, audio, and video into text first.
  • questions is a map. The key is an id you choose. It is not shown to the model. The answer comes back under the same id.
  • A noul asks a yes/no question and returns noul, a probability from 0 (no) to 1 (yes). Optional criteria.true and criteria.false say what a yes and a no mean.
  • A choice picks one option. criteria is a map of option id to a short description (or null). At most 255 options. The answer includes the winning choice, a probability for every option, and confidence.
  • A score rates the state on an ordered rubric. criteria is 2 to 10 level descriptions, low to high. The answer's score can land between levels, and includes a probability per level plus confidence.
  • instructions may be a string, or an object that keeps the question in one field and reference data in the others. Refer to those fields by name in backticks.
  • Send every question you need in one call. The model reads the state once and answers them together.
  • model defaults to jev-latest, the current stable release. jev-preview tracks the newest release. Pin a version such as jev-1.13.0 when a threshold was tuned against that version. The response model field is the version that answered.
  • Billed per input token. Output tokens are free.

Add [TypeSafe] Evaluate to your workflow

Build powerful AI workflows with drag-and-drop blocks. No coding required.