Skip to content

CPU stand-in for development

uv sync --extra dev --frozen
uv run pytest
uv run python -m decisio.serve.vllm_engine --backend hf --model Qwen/Qwen3-0.6B-Base

Run against the CPU stand-in at v0.8.2 on 2026-10-07: the install and the server start; the unit tests passed in decisio's own CI on this commit.

  • uv run pytest runs the unit tests on any machine; the GPU tests (pytest -m gpu) need a card, and run by hand until a nightly GPU runner is registered.
  • --backend hf serves every route from a small Hugging Face model on the CPU, for developing and testing the routes; it is not the measured system and its answers are not for measurement.
  • CI runs the stand-in on Qwen/Qwen3-0.6B-Base at a pinned revision (STAND_IN_REVISION in .github/workflows/ci.yml).
  • examples/tasks/ walks through task registration against it.

Decisio is an independent open-source project, not affiliated with or endorsed by TypeSafe. Jev is TypeSafe's product name.

Apache-2.0. This page is built from Decisio v0.8.2.