tech

How Microsoft Is Building for a World of Metered Intelligence

The company gets pragmatic in AI’s expensive era

How Microsoft Is Building for a World of Metered Intelligence

TL;DR

  • The era of heavily subsidized AI subscriptions, similar to early Uber pricing, is ending as AI labs face profitability pressures.
  • Microsoft's Build conference addressed rising AI costs, with CEO Satya Nadella promising "unmetered intelligence" while acknowledging the need for pragmatic solutions.
  • The new RTX Spark laptop allows developers to run medium-sized AI models locally, reducing reliance on token-based cloud services.
  • Microsoft's strategy involves offering flexibility, allowing users to switch between different AI models and providers, including local open-source options.
  • Changes in billing, such as GitHub Copilot's move to token-based pricing, highlight the industry-wide shift towards more direct cost-based models for AI services.