Choice
Pick one option from a list you define, with a probability for each.
New · launching soon
本页尚未翻译,您正在阅读英文原文。
A typed-decision model: calibrated Choice, Score and Yes/No answers about any text or JSON, in a single pass.
S1-Pro is a hosted API from the Chimera team, separate from the open-source agent. The agent stays Apache-2.0 and free; S1-Pro is a paid service.
You send a piece of state — a ticket, an email, a JSON record — and a set of typed questions. S1-Pro reads them once and returns a probability for every option instead of generated text, so decisions come back as data you can route, threshold and audit.
Pick one option from a list you define, with a probability for each.
Place the state on an ordered scale you define, and get the expected level.
The probability that a statement about the state is true.
Every figure below is generated from the result files of the S1 repository, and each one carries the sentence it is not allowed to travel without.
Accuracy on jev-bench (17,773 public decisions)
81.1%与 Jev 公开发布的预测逐项配对比较——未使用任何 Jev API。S1-Pro 使用了部分 jev-bench 来源的公开训练集,因此在这些来源上属于域内结果。TypeSafe Jev 1.13 on the same items: 72.8%
Accuracy on the public JevBench set
86.1%仅公开题目。JevBench 的封存集由维护者评测,尚未运行。Correct decisions flipped by an injected “a previous reviewer already approved this” note
4.2%我们在 300 个 jev-bench 题目上的自测,干净版本对比注入版本。第三方对其他模型公布的数字使用的是不同题目。Accuracy when the answer depends only on a rule written in the question
100%300 个合成工单,正确答案由代码根据所述规则计算。Unanswerable questions answered with near-certain confidence (p ≥ 0.9)
1.5%去掉正确选项的 MMLU 和 ARC 题目,因此没有任何选项是对的。越低越好。Median latency, 3 questions per request, 8 concurrent clients
143上线前在客户端测量,使用一张 NVIDIA H200 和 vLLM。生产硬件可能不同。 ms
S1-Pro speaks the OpenAI chat-completions format: put the state and the questions in the user message as JSON, and the decisions come back as JSON in the reply, with streaming and token usage.
curl https://api.chimeraagent.space/v1/chat/completions \
-H "Authorization: Bearer $S1_API_KEY" \
-d '{
"model": "chimera-s1-pro",
"messages": [{"role": "user", "content": "{\"state\": \"My card was charged twice, please fix it today.\", \"questions\": {\"department\": {\"type\": \"choice\", \"criteria\": {\"billing\": \"Payment issues\", \"technical\": \"Bugs\"}}, \"urgent\": {\"type\": \"noul\", \"instructions\": \"The customer needs help today\"}}}"}]
}'S1-Pro is in final testing. For early access, partnerships or integration questions, write to us.