AI Inference Cloud Disruption (with Matt Miller)

SambaNova CEO Rodrigo Liang announces a $3.5B deal with Vista Equity Partners and Cambium Capital for the 'world's first disaggregated inference cloud' using GPUs, SambaNova's RDU, and Intel CPUs. The technology offers order-of-magnitude lower power consumption (10kW vs traditional GPUs), drastically reducing token costs for enterprises.

Yields

implicit

RUT

Oil

Metals

USD

SambaNova 1.0
Information Technology
Rodrigo Liang 6.0

AI Inference Cloud Disruption (with Matt Miller)

ndx

AI infrastructure investment continues to accelerate with new inference cloud solutions reducing costs dramatically, enabling broader enterprise adoption. Chip demand remains insatiable.

Rodrigo Liang

This is the first commercially available disaggregated inference cloud that runs GPUs, SambaNova RDUs, and Intel CPUs together for maximum efficiency, lowest latency, highest performance inference. 10 kilowatts is an order of magnitude lower power than traditional GPUs, allowing much lower cost tokens for enterprises.
Rodrigo Liang

The orchestration layer allows concurrent use of GPUs (very fast) and CPUs (orchestrate). By disaggregating all three, you get speed and performance economics that no single chip can touch. Vista's 92+ portfolio companies will get early access to drive AI transformation.
Rodrigo Liang

Taiwan/TSMC remains incredibly efficient. Most chips are built there and they're deploying factories elsewhere but it takes time. In the short term, companies must figure out how to continue manufacturing there while seeking savings elsewhere as component costs go up.

SignalTube

markets at a glance