tech
Sam Altman dishes on OpenAI's top token user
The OpenAI CEO acknowledges that cost concerns have become a "huge issue."
TL;DR
- OpenAI's top token user consumes 100 billion tokens monthly.
- This represents a 1 million-fold increase in token usage compared to six years ago.
- AI demand is rapidly increasing, leading to "tokenmaxxing" culture.
- High demand creates infrastructure challenges and compute constraints for AI labs.
- Cost concerns are now a primary issue for OpenAI customers.
- The development of "constant running proactive AI" will further exacerbate costs.
- Anthropic has surpassed OpenAI in corporate spending.