tech

Why the first GPU financiers are turning to inference chips in a $400 million deal

A $400 million chip-backed loan points to the next wave of AI infrastructure deals.

Why the first GPU financiers are turning to inference chips in a $400 million deal

TL;DR

  • General Compute, an AI inference cloud startup, received a $400 million loan from Upper90.
  • This loan is likely the first to use inference-specific AI chips as collateral.
  • The financing reflects a market trend toward cheaper AI infrastructure for running open-source models.
  • General Compute's neocloud uses SambaNova's SN50 chips, designed for efficient inference and faster deployment than GPUs.
  • Upper90's previous success financing GPU purchases for Crusoe paved the way for chip-backed loans.
  • Upper90 sees an opportunity in companies like General Compute as the market for GPUs matures.
  • The rise of alternatives to Nvidia's chips could offer cost-efficient inference solutions.
  • This deal signals capital organizing to counter Nvidia's market dominance.