# Teach a task whose options change

> When your options change with every request, teach the question once and have decisio certify the answers it can, such as which brand a product title names.

Source: https://opendecisio.com/docs/tasks/dynamic/

Your [options](https://opendecisio.com/docs/glossary/#option) change with every request: which brand a product title names, which of this request’s tools to call. Teach that [question](https://opendecisio.com/docs/glossary/#question) once as a dynamic [task](https://opendecisio.com/docs/glossary/#task), and decisio certifies the answers it can, whatever options a request brings.

 

Each example carries its own options. Prepare `dynamic-task.json` as a complete registration with `id` and `examples`, each example containing a full one-question `request` and its human-labelled `answer`. Use the [task registration format](https://opendecisio.com/docs/tasks/#3-register), keeping the instructions identical while varying candidate options.

 

Run this Python script beside the file; `DECISIO_BASE_URL` selects your endpoint:

 

```
import json
import os
import urllib.request

with open("dynamic-task.json", encoding="utf-8") as source:
    body = json.load(source)
body["options"] = "dynamic"
body["match"] = "instructions"
body.setdefault("certify", {"alpha": 0.05})

base_url = os.environ.get("DECISIO_BASE_URL", "http://127.0.0.1:8000").rstrip("/")
request = urllib.request.Request(
    base_url + "/v1/tasks", data=json.dumps(body).encode(),
    headers={"Content-Type": "application/json"},
)
with urllib.request.urlopen(request, timeout=300) as response:
    print(json.dumps(json.load(response), indent=2))
```

 

Shown, not run: it needs the reader’s own complete dynamic-task.json with labelled requests; transport tests check the registration.

 

[Figure: Keep the instruction stable while the candidate list changes. Two illustrative choice requests share an instruction. The first offers billing, access and bug; the second billing, access and refunds. Each answer uses its own request’s keys.]

 

## 1 See where it works great

 

On questions where the right option can be read from the text, most answers are certified:

  

| Question | Model | Answers certified | Wrong among them | Accuracy |
| --- | --- | --- | --- | --- |
| Which of this request’s tools to call | Gemma 4 12B | 99.9% | 3.7% | 96.3% |
| Which of this request’s tools to call | Gemma 4 31B | 99.7% | 3.7% | 96.1% |
| Which brand a product title names | Gemma 4 12B | 91.4% | 3.1% | 94.8% |
| Which brand a product title names | Gemma 4 31B | 94.6% | 3.1% | 95.2% |
| Which intent a message routes to | Gemma 4 12B | 84.5% | 3.4% | 92.2% |
| Which intent a message routes to | Gemma 4 31B | 80.0% | 2.9% | 91.0% |

 

Measured offline with the server’s own code, on Gemma 4 readouts taken with decisio 0.35.0 and vLLM 0.31.0 on one RTX PRO 6000 Blackwell at 600 W, 2026-10-30, at a 5% error target: the median over three draws of 200 labels, as decisio serves it, with the re-ranker kept where it helps; the pooled figures are the mean over five questions, these three, entity linking and product matching.

 

## 2 Register it

 

- **`"options": "dynamic"` and `"match": "instructions"`**, the only value, make one task of every later choice question with these instructions.
- **Each example’s `answer` is one of its option keys,** or `null` for the request’s none option: the key `none`, or the key you name in `"none_option"`.
- **The `certify` block is required:** a dynamic task is always certified, which needs 59 held-out examples at the defaults.

 

## 3 Read what it kept

 

- **`dynamic.applied` in the registration response** says whether the re-ranker was kept, and why. The server keeps it only when it improves held-out answers.
- **Every answer carries the usual `certified` fields:** an answer that reaches the [threshold](https://opendecisio.com/docs/glossary/#threshold) is certified, on the model’s [top probability](https://opendecisio.com/docs/glossary/#top-probability) or, where it was kept, the re-ranker’s.
- **Later choice questions with these instructions** are answered through the task, whatever their options.

 

## 4 Good to know

 

- Use choice questions on text, with one order per request; score and image questions do not use this path.
- Keep the instructions exactly the same; every example and request can supply its own candidates.
- A fixed-option task matching the exact options takes precedence.
- Some tasks certify nothing at your target; check the returned threshold before connecting automatic actions.
- No request or option text is stored in the fitted correction.

 

## 5 Watch it

 

- **The monitor has no answer mix,** since the options differ. It watches the confidences as for any certified task.
- **It also watches `unseen_options`,** the share of requests none of whose options your examples contained, but only where options recur. `status.monitor.unseen_options.armed` says whether it is watched.
- **An alert on either suspends certification** while it lasts.

 

## What next

 

- [Certify answers](https://opendecisio.com/docs/tasks/certify/): what a certificate promises.
- [Watch for drift](https://opendecisio.com/docs/tasks/drift/): the traffic monitor and its alerts.
- [Teach a task](https://opendecisio.com/docs/tasks/): a question with the same options every time.