tech
Harvey CEO says the company's AI usage jumped from 1 trillion tokens a month to 12 trillion
Harvey CEO Winston Weinberg said the legal AI startup's token usage jumped more than 12x this year, as companies rethink what AI is worth paying for.
TL;DR
- Harvey's monthly AI token usage increased from 1 trillion in January to an estimated 12-13 trillion in May.
- Tokens are chunks of text processed by AI models, serving as a key metric for AI use and billing.
- Companies are increasingly scrutinizing AI usage costs, with some reducing "tokenmaxxing" due to high bills.
- Weinberg emphasized the need to determine the appropriate level of AI use for specific tasks, citing cost implications.
- The challenge of demonstrating ROI on AI spending is compared to the "billable hours problem" in law firms.