All articles

Artificial intelligence

Fast decision models could change how everyday software responds

Oct 15, 202610 min read

Trent Smith, Co-Founder, Contract Cloud

Trent Smith Co-Founder, Contract Cloud In-house lawyer with more than 11 years' experience across commercial contracts, procurement, privacy and governance.

Blue computer processor and circuit board illustrating fast AI decisions.

You ask an app to move an appointment. A robot encounters an object it has not seen before. A public service receives a request that does not fit neatly into its online form. Each situation involves a small judgement about what should happen next. A long, beautifully written answer may be beside the point.

That is why fast decision models are an interesting development in AI. Much of the attention has gone to systems that can write more, reason for longer or handle increasingly complicated conversations. This category focuses on something different: returning a usable judgement quickly, in a form that another system can act on.

TypeSafe AI’s Jev and OpenAI’s new Decisions API are examples of that direction. The potential extends beyond business administration. If small judgements become fast and affordable enough to make throughout an application, the software around us could become more responsive to what we actually mean. The challenge is deciding when that responsiveness is useful, and when a machine should stop and ask.

What has actually been announced

TypeSafe founder Diogo Almeida describes his earlier work at OpenAI in the company’s introduction to Jev. The announcement presents Jev as a model built for structured decisions rather than freeform writing. TypeSafe says it produces probabilities in parallel instead of generating an answer token by token. Its published workflow tests report very large speed and cost gains, but the company also acknowledges favourable demonstration conditions and potential evaluation bias. Those are vendor results, not a promise that every business will see the same improvement. [1]

OpenAI announced its Decisions API at DevDay on 29 September 2026. Its official changelog records the beta release on 6 October. The current documentation describes a GPT-6 Luna service that accepts text and images and returns typed answers, with an advertised speed of about ten times the Responses API. That comparison concerns the specified API use, not every model, workload or end-to-end process. [2, 3, 4]

The common idea is a decision that another piece of software can use immediately. These announcements do not establish that OpenAI copied Jev, that the architectures are identical, or that one consistently outperforms the other. They do show that this category has become a concrete product direction rather than just an interesting way of describing automation.

A decision does not need to be an essay

A conventional language model generates sequences of tokens, often producing prose. Developers can also constrain language models to structured formats. The newer decision-focused approach makes the selection or judgement itself the main interface, rather than treating it as something to extract from a written answer.

TypeSafe’s documentation describes questions that select an option, score information against a rubric or estimate whether a statement is true. It recommends separating complicated judgements into narrower questions and combining the results in code. [5] Jev is therefore more than shorthand for asking a chatbot to answer quickly. OpenAI’s service uses Luna, so it would also be wrong to describe every decision API as an entirely separate species from language models.

Consider a message saying, “I can’t make Tuesday, could we do the same time on Thursday?” A decision-focused system might identify the request as a proposed reschedule. Separate software could then check the calendar and present the change for confirmation. It does not need a miniature essay about what rescheduling means.

The distinction matters when the question changes. “Which action is this person requesting?” is bounded. “Which job should this person take?” involves preferences, uncertainty and consequences that are much harder to compress into a menu. Calling both activities decision-making does not make them interchangeable.

Why speed changes what is practical

A model that takes a few seconds can still be useful. A reviewer waiting for a substantial analysis may happily accept that delay. The calculation changes when an application needs to make several small judgements while someone is filling out a form, uploading a file or moving between screens.

Imagine an intake form that notices a missing schedule before the user presses submit. It could ask for the schedule while the person still has it open. If the same issue is discovered the next morning, the organisation has created another email, another interruption and another opportunity for the request to stall.

That is the attractive part of faster decision-making. It can move a check closer to the moment when fixing the problem is easy. The benefit is not necessarily a spectacular new capability. It may be avoiding small amounts of rework across a large volume of ordinary transactions.

There is a limit, though. A fast model call does not remove the time needed to upload documents, extract text, retrieve the right records or wait for a person. If most of a process is spent waiting for an incomplete brief, shaving a second off classification will barely matter. The sensible measure is time saved across the actual workflow, including the exceptions it creates.

Where this could show up in everyday life

The examples that follow are possibilities for this class of technology, not claims that these products have already delivered them. A useful starting point is an interface that responds while a person is doing something, instead of waiting for a separate conversation with an assistant.

An accessibility tool could help interpret a request and offer a small set of relevant actions. A household application could distinguish a request for information from a request to change a setting. An educational tool could identify that a learner is asking for a hint rather than the complete answer. In each case, the useful result is a better next step, provided the system understands the context and leaves the person in control.

Public services offer another potential use. A person describing a problem in ordinary language may not know which department or form they need. A decision layer could suggest the right route or identify missing information before a request is submitted. That could make access less frustrating. It should not quietly become a mechanism for rejecting people whose circumstances do not match the expected categories.

Science could benefit from a similar separation of tasks. A system might prioritise observations for expert inspection or help sort a stream of material against a defined rubric. That is very different from establishing that a scientific conclusion is true. Any claim about improved discoveries or research outcomes would require evidence from that actual setting.

Robotics is an appealing possibility because machines often need to choose a next action quickly. However, a fast response to a structured question does not establish that a robot can safely move through a home or workplace. Perception, physical control, unpredictable environments and safety checks remain separate problems. It is possible to be excited about the direction without pretending that one component solves the whole machine.

Healthcare makes the distinction especially important. Administrative routing might be a sensible area to investigate. Clinical decisions need clinical validation, appropriate oversight and evidence about harm. Speed alone cannot establish that a system is suitable for diagnosis or treatment, and none of the announcements discussed here should be read as that evidence.

The answer options matter more than they look

A decision system can only work within the choices it has been given. That sounds obvious until an organisation tries to write those choices down. Categories overlap. Exceptions depend on context. Two teams may disagree about who should receive exactly the same request.

Suppose an intake model must choose between “legal”, “procurement” and “finance”. A disputed invoice under a supplier agreement could reasonably involve all three. Forcing a single answer might hide the real issue: the workflow needs a lead owner and a separate mechanism for involving other teams.

A better design might first identify the problem, then apply an agreed ownership rule. It could also offer an unresolved category for cases that do not fit. That gives the organisation something useful to investigate instead of silently distributing ambiguous work according to whichever label received the highest score.

The exercise can be valuable before a model is introduced. If people cannot explain what should happen to a request, automation will not settle the disagreement for them. It will make the disagreement harder to see. Clear categories, examples and ownership decisions are part of the implementation, rather than a bit of administration to finish later.

A valid answer can still be wrong

There is an important difference between returning an answer in the right format and returning the right answer. A system restricted to recognised categories cannot invent a fourth category in its response. It can still select the wrong one.

TypeSafe’s discussion of hallucination emphasises schema matching and type safety. [1] That is useful for software integration, but it should not be read as a guarantee of factual correctness. If an agreement is labelled low risk when it is not, a perfectly formatted result has not solved the business problem.

Confidence also needs careful interpretation. A number that looks precise can encourage people to treat it as certainty. The organisation needs evidence that the score is meaningful for its own documents, categories and operating conditions. A result that is helpful on straightforward examples may behave differently when a scan is incomplete or a crucial qualification appears in a separate schedule.

I would separate a suggestion from authority to act. A system could identify a request to move an appointment or recommend a review queue. Permission to make the change, disclose information or commit money is a separate question. Faster analysis does not create permission that did not exist before, and a person should be able to understand what the application actually did.

How to tell whether it is actually useful

Start with a modest, reversible decision that happens frequently. Routing a request to a review queue is easier to test and correct than allowing a system to commit money or make a consequential decision about someone. The initial question is whether it improves that specific activity.

Use examples that reflect real life, including ambiguous requests, incomplete information and cases where the latest message contradicts an earlier one. Agree the expected outcomes before judging the system. If experienced people disagree, record that disagreement rather than presenting an arbitrary label as unquestionable truth.

Run the model alongside the existing process before allowing it to take action. Measure the different errors separately. Sending a routine item for unnecessary review has a different consequence from missing an important exception. An impressive overall accuracy figure can hide poor performance on the cases that matter most.

For example, a service that receives mostly routine requests could appear accurate by treating almost everything as routine. It would still be unhelpful if it consistently missed unusual circumstances. Test the exception, not merely the average. Include people and language patterns that the initial designers might otherwise overlook.

Once the results justify limited use, keep correction paths visible. Record what information the model received and what happened next. Recheck performance when the application, users or categories change. A successful pilot is evidence for that pilot, not a permanent licence to expand the system’s authority.

Where slower thinking still earns its place

A quick decision layer and a detailed reasoning process can work together. The first might identify that a matter needs deeper attention. The second might compare provisions, investigate an inconsistency or prepare a reasoned explanation for a person to assess.

There is no need to turn that into a contest about which kind of model is the future. Different tasks place different demands on the system. A short, well-defined question may benefit from a fast response. A difficult judgement may benefit from more context, more time and someone who understands the consequences.

The same applies to explanations. A category may be sufficient for an internal routing step. A consequential recommendation may need supporting evidence that a reviewer can inspect. Businesses should decide what evidence the task requires, rather than assuming that a fluent explanation proves correctness or that a probability removes the need for an explanation altogether.

It is also worth keeping ordinary software in the picture. If a rule depends solely on a known date or an exact numerical threshold, a deterministic check may be simpler. The useful place for AI is often where the input needs interpretation before an established rule can be applied.

What makes this development interesting

The exciting prospect is a less conspicuous kind of AI. It could sit inside ordinary applications, helping them respond sensibly to information that does not arrive in a neat form. Users might notice fewer interruptions and less repeated work rather than a new chatbot to manage.

That outcome is not automatic. It depends on choosing suitable decisions, testing them against real examples and keeping control of the actions that follow. Jev and the Decisions API make the direction worth exploring. Their launch claims alone cannot establish the business case for a particular organisation.

For businesses, public institutions and the people using their services, the useful question is similar: which small judgement, made earlier and reliably enough, would improve the experience? The answer might be a faster handover, a clearer interface or an exception spotted before it becomes a problem. Those changes could matter even when nobody notices a model working in the background.

At Contract Cloud, our focus is helping teams work with their contracts and review information in a practical workspace. If you would like to discuss your organisation’s contract workflow and where AI could usefully assist, book a demo at https://contractcloud.com.au/book-a-demo.

Sources

[1] TypeSafe AI. Introducing System One Models and Jev. https://typesafe.ai/blog/introducing-system-one-models-and-jev

[2] OpenAI. DevDay 2026 Recap, 29 September 2026. https://openai.com/index/devday-2026-recap/

[3] OpenAI. API changelog, 6 October 2026 beta release. https://developers.openai.com/api/docs/changelog

[4] OpenAI. Decisions API documentation, checked 15 October 2026. https://developers.openai.com/api/docs/guides/decisions

[5] TypeSafe AI. Introduction and structured question types, checked 15 October 2026. https://docs.typesafe.ai/introduction