TypeLLM 发布开源工作流模型，可在一次 API 调用中执行整个工作流，把 JSON Schema 作为依赖图在共享上下文上运行。它基于 SGLang 将 JSON Schema 转为约束解码，枚举或布尔字段只给一个评分 token、数字限定位数，并复用缓存前缀，因此字段不会返回枚举外的值。作者称无需改动权重即可从现成 Qwen checkpoint 获得 schema 保证的输出。
Open source meets type-safe AI, with TypeLLM.
Chat models give you a reply and decision models give you a choice, but TypeLLM is built to run your whole workflow in one API call.
Most production pipelines need something in between: several typed answers, some depending on others, a few that should exist only under certain conditions.
TypeLLM takes that whole shape as one JSON Schema and executes it as a dependency graph over a single shared context.
Typed LLM outputs, built in the open.
You can get schema-guaranteed outputs from a stock Qwen checkpoint without touching its weights.
The guarantee comes from how the requests are built and decoded.
TypeLLM sits on SGLang and turns a JSON Schema into constrained decoding: one scored token for an enum or boolean, bounded digits for numbers, and a dependency graph that reuses cached prefixes.
So a field can’t return a value outside its enum, because the decoder only considers the allowed candidates.
Chat models return messages. Decision models return decisions. Workflow models execute workflows. TypeLLM introduces the first workflow model. Run an entire workflow in a single API call. Simpler, faster, cheaper. Try it now: https://typellm.ai/examples/ticket-workflow在 X 查看被引用的帖子
来源：Rohan Paul · x.com