Walk into any major tech conference today and a familiar theme emerges: people celebrate new artificial intelligence (AI) milestones, but the discussion quickly shifts to the same constraint, compute.

Over the past several years, the lion’s share of artificial intelligence (AI) investment has poured into training infrastructure—massive clusters designed to crunch through oceans of data, where speed ...