tech
The next step in AI saving is treating frontier models like expensive consultants
Letting frontier models do the complex thinking and planning, and none of the execution, is the key to saving on your AI budgets.
TL;DR
- AI consultants recommend using expensive frontier AI models for planning and strategic tasks.
- Cheaper, smaller AI models should be used for executing routine or simpler sub-tasks.
- This strategy aims to reduce AI spending and increase return on investment (ROI).
- Companies are moving away from 'tokenmaxxing' (unrestricted AI experimentation) towards more conservative budget management.
- AI-routing startups are emerging to help companies manage AI model usage and monitor spending.