tech
OpenAI says its Jalapeño chip bests Nvidia, others
The chip is designed for serving up AI models, rather than training new ones.
TL;DR
- OpenAI's new Jalapeño chip shows industry-leading performance and energy efficiency in serving open source AI models.
- The chip outperforms competitors like Nvidia in benchmarks for specific models.
- Jalapeño is intended for serving AI models, not training them, meaning OpenAI still relies on external hardware for training.
- OpenAI plans to deploy a limited number of Jalape ño systems this year, with greater capacity next year, and is developing future generations.
- Many of OpenAI's rivals, including Google, Amazon, Microsoft, and Anthropic, are also developing or have their own AI chip designs.
- OpenAI has no plans to sell the Jalapeño chip to other companies due to its own high demand.