tech
December 8, 2025
Amazon’s bet that AI benchmarks don’t matter
Posts from this topic will be added to your daily email digest and your homepage feed.
TL;DR
- Amazon AI Chief Rohit Prasad believes AI benchmarks are flawed and not indicative of real-world utility.
- He suggests that current benchmark evals are noisy and don't showcase the true capabilities of AI models.
- Amazon has announced Nova Forge, a service designed to enable companies to train custom AI models.
- Nova Forge provides access to Amazon's Nova model checkpoints at different training stages.
- This service offers a solution to the challenges companies face when customizing AI models, such as limitations with closed models, risks with open-weight models, or the high cost of building from scratch.
Continue reading
the original article