OpenAI Launches New AI Tool That Makes Decisions Up to 10 Times Faster

OpenAI has created its Decisions API available to all customers, introducing a faster and cheaper way for developers to apply artificial intelligence for tasks that require quick decisions.

TechnologyNews Info Wire4 min read
OpenAI Launches New AI Tool That Makes Decisions Up to 10 Times Faster

OpenAI has created its Decisions API available to all customers, introducing a faster and cheaper way for developers to apply artificial intelligence for tasks that require quick decisions.

Article outline

  1. What happened
  2. The key numbers
  3. Reaction
  4. Background
  5. The details
  6. The bottom line

Key points

  • Nikunj Handa, OpenAI's API product lead, informed TechCrunch that the business reduced response times from one to three seconds to approximately 100-180 milliseconds.
  • According to Nikunj Handa, OpenAI's API product lead, the firm reduced decision-making time from one to three seconds to approximately 100-180 milliseconds.
  • After initially introducing the technology at its developer event on September 29, the firm unveiled the wider release on Thursday, October 22.
  • Exact rankings for Liquid D1 Ultra and Base Lab Elephant-1 were not supplied, so they are not assigned numerical positions.
  • OpenAI's AI Agents Are Disabling Safeguards Meant to Keep Them in Check.

According to OpenAI, the Decisions API can create decisions up to 10 times faster than its underlying model through the traditional Responses API, making it suitable for applications that require near-instant responses. How the Decisions API Works.

Unlike traditional sizeable language models (LLMs). It generate detailed responses, the Decisions API focuses on selecting answers from predefined options.

Developers can provide questions and feasible answers, allowing the model to classify information, choose actions, or calculate confidence scores. Your ChatGPT Subscription Can Now Work in Other Apps.

Meanwhile, the API supports three types of responses: probability estimates, choices between options, and scores based on predefined criteria.

OpenAI developed the technology by modifying its existing language model to reduce processing time and costs rather than training a completely separate model.

OpenAI has introduced the Decisions API with a focus on faster response times and lower processing costs.

According to Nikunj Handa, OpenAI's API product lead, the firm reduced decision-making time from one to three seconds to approximately 100-180 milliseconds. Traditional AI response time 1-3 seconds. Decisions API response time 100-180 milliseconds. Input pricing $0.10 per million tokens. Cached input pricing $0.01 per million tokens. Output token charges None. Maximum questions per request 400. Backed inputs Text, images, and structured data. Early customers include Box, Datadog, Ramp, and Speak.

Speak CTO Andrew Hsu remarked the language-learning platform reduced the time between AI actions from 1.4 seconds to 0.13 seconds, representing an improvement of more than 90%.

OpenAI's release brings it into competition with TypeSafe, the startup behind the Jev decision-making model.

TypeSafe lately reached a valuation of approximately $7.6 billion. Other firms, including Liquid and Base Lab, have additionally introduced competing models.

Meanwhile, the after table compares their positions on two public benchmarks, based on the noted rankings. AI Model AIM System One Index Artificial Analysis Decision Index. TypeSafe Jev 7th 3rd. OpenAI Decision Model 8th 14th. Liquid D1 Ultra Solid performer Robust performer. Base Lab Elephant-1 Solid performer Robust performer.

Exact rankings for Liquid D1 Ultra and Base Lab Elephant-1 were not supplied, so they are not assigned numerical positions. Rankings can additionally change as benchmarks are updated.

OpenAI's AI Agents Are Disabling Safeguards Meant to Keep Them in Check. AI Models Could Become Even Faster.

OpenAI believes further improvements could reduce response times to approximately 60 milliseconds.

Handa suggested that such speeds could eventually allow developers to create AI decisions for individual frames in videos.

Meanwhile, TypeSafe has expanded Jev with image backing and conditional decision-making features.

For context, the growing competition highlights increasing demand for AI systems that can handle repetitive decisions without the higher costs and processing times of traditional language models.

OpenAI expects faster and cheaper decision models to backing more applications, including real-time voice assistants, image classification, automated workflows, and interactive software. Stay Connected with ProPakistani.

Obtain the latest tech news, telecom insights, and product launches wherever you prefer. Follow on Google Discover. Follow on Google News Join WhatsApp. See more ProPakistani stories in Google Search and Top Stories.

Technology and Automotive Specialist covering the latest cars, smartphones, AI breakthroughs, and.

For now, openAI Launches New AI Tool That Makes Decisions Up to 10 Times remains the part of the story worth watching, and further updates are likely as more details are confirmed.

Leave a Reply

Your email address will not be published. Required fields are marked *