Why Evals Are So Hot Right Now
Plus: Where we stand on Grok 4.7, a workflow for going viral on social media, and why every company needs a Slack agent
TL;DR
- Grok 4.7's public launch has divided users, with some experiencing regressions in performance while others find it improved.
- AI evaluation methods ('evals') are becoming increasingly important for assessing AI model capabilities against specific tasks and user needs.
- The shift towards using speed, price, and alignment with user preferences as key AI model selection criteria is driven by the increasing capability of frontier models.
- Companies are beginning to deploy AI agents on conversational platforms like Slack, mirroring the early adoption of websites and signaling a new frontier for business interaction.
- A workflow is provided for converting articles into short animated videos using AI tools like Claude and Hyperframes.