tech

Silicon Valley is spending billions on AI tokens and nobody can agree if it's working

Uber COO Andrew Macdonald criticizes tokenmaxxing amid rising AI costs and limited productivity, sparking debate in Silicon Valley.

Silicon Valley is spending billions on AI tokens and nobody can agree if it's working

TL;DR

  • Uber COO Andrew Macdonald questions direct productivity improvements from increased AI token usage.
  • Tokenmaxxing, the practice of using many AI tokens to boost productivity, is under scrutiny.
  • Companies like Meta, Disney, and JPMorgan are heavily investing in and tracking AI usage.
  • Concerns are rising about massive waste and companies exceeding their AI budgets early.
  • Some tech professionals believe a significant portion of internal token spend is useless with no clear ROI.
  • Google CEO Sundar Pichai notes CIOs are concerned about companies rapidly depleting budgets.
  • Investors like Michael Burry have labeled tokenmaxxing a "crazy, rushed, temporary phase."
  • Some, like Y Combinator CEO Garry Tan, defend the practice.
  • A report suggests companies should tie AI costs to concrete metrics like pull requests, not raw token consumption.