OpenAI makes its Jev competitor widely available as decision model competition heats up
OpenAI is launching its decision model to the world. Can it compete with the original Jev?
TL;DR
- OpenAI launched its Decisions API, making a fast and cheap intelligence model widely available.
- The Decisions API is designed to quickly make choices from a set of options and provide confidence ratings, similar to TypeSafe's Jev model.
- OpenAI reconfigured ChatGPT Luna to create its Decisions API, focusing on speed and lower cost.
- The Decisions API reduces inference time significantly, from seconds to milliseconds.
- Customers like Box, Datadog, Ramp, and Speak are using the API to replace LLMs for higher throughput.
- While benchmarks exist, the effectiveness of a decision model varies by workload, with TypeSafe emphasizing in-house trials.
- OpenAI's model may have an advantage in multi-modality, particularly with image classification.
- Faster and cheaper decision models are expected to enable a wider range of use cases.