The next wave of AI runs on inference. The opportunity is huge - and making the economics work at scale is where it gets real.
wonderful to see everything about AI is accelerating,
Bloomberg just reported Baseten is set to raise about $2B at valuations up to $30B, more than doubling its June valuation.
Inferencing demand has moved fast, with Baseten’s annualized revenue reportedly tripling from $200M uarter of 2026.
A $30B price, about 50 times that reported run rate, assumes inference spending keeps outgrowing training as agents burn more compute per task.
Its closest rival, Fireworks AI, raised $1.5B at a $17.5B valuation in July.
1
1
11
465
Excited to announce our collaboration with @Supermicro, the perfect partner to build and support inference racks powered by SambaNova SN50.
Our racks join Supermicro's Data Center Building Block Solutions portfolio. They fit the air-cooled data centers customers already run, next to the GPUs they already own. This first batch of SN50s is only phase one. Pumped for what comes next!
sambanova.ai/press/sambanov…
Our racks join Supermicro's Data Center Building Block Solutions portfolio. They fit the air-cooled data centers customers already run, next to the GPUs they already own. This first batch of SN50s is only phase one. Pumped for what comes next!
sambanova.ai/press/sambanov…
3
8
32
1,212
Rodrigo Liang retweeted
Thank you @ClayMagouyrk for the shoutout at the Oracle AI World stage this morning!
We’re proud to bring fast, high-performance AI inference to @Oracle Cloud Infrastructure (OCI).
More on our partnership below ⬇️
We’re proud to bring fast, high-performance AI inference to @Oracle Cloud Infrastructure (OCI).
More on our partnership below ⬇️
1
14
41
37,443
Rodrigo Liang retweeted
LIVE from Oracle AI World!
SambaNova and @Oracle are collaborating to bring high-performance inference to Oracle Cloud Infrastructure (OCI).
“Our customers want the right infrastructure for every AI workload, and inference demand is growing fast. We plan to bring SambaNova’s e AI builders a high-performance, efficient way to run models at scale.” — @MThiagarajan_, President, OCI.
Full press release here: bit.ly/4e0V3Ts
SambaNova and @Oracle are collaborating to bring high-performance inference to Oracle Cloud Infrastructure (OCI).
“Our customers want the right infrastructure for every AI workload, and inference demand is growing fast. We plan to bring SambaNova’s e AI builders a high-performance, efficient way to run models at scale.” — @MThiagarajan_, President, OCI.
Full press release here: bit.ly/4e0V3Ts
1
12
31
66,295
Proud to be involved with CASPA over last 15 years!
Some snaps from the weekend at CASPA!
@RodrigoLiang joined fellow CEOs @NaveenGRao, @unconvAI & @FarisSbahi, @NormalComputing for a panel moderated by @chernandburn, @Reuters. It was an incredible weekend full of insights from some of the most brilliant leaders of the world. Thanr bringing everyone together!
0
0
3
206
Rodrigo Liang retweeted
@nanduri_anil talking CPU as the quarterback for the agentic era at @OpenComputePrj global summit
2
5
35
1,312
Rodrigo Liang retweeted
One big takeaway from @hotchipsorg: agents are changing the inference game.
More reasoning + more tool calls = a LOT more tokens. And across six frontier-model configs, decode made up 75–97% of inference time.
So bandwidth & data movement matter. A fast chip is great. A fast system is better.
Read the recap: bit.ly/4iacTGu
More reasoning + more tool calls = a LOT more tokens. And across six frontier-model configs, decode made up 75–97% of inference time.
So bandwidth & data movement matter. A fast chip is great. A fast system is better.
Read the recap: bit.ly/4iacTGu
0
3
4
1,135
Rodrigo Liang retweeted
Our mixer after this week's Hot Chips was a good time, so we're doing it again!
After AI Infra Summit, swing by the Hyatt Regency Santa Clara so you can meet the team, grab drinks, enjoy some food, and learn more about our open roles.
September 15 | 6–9 PM
Register here: bit.ly/4cjYLa2
After AI Infra Summit, swing by the Hyatt Regency Santa Clara so you can meet the team, grab drinks, enjoy some food, and learn more about our open roles.
September 15 | 6–9 PM
Register here: bit.ly/4cjYLa2
0
4
12
53,505
Rodrigo Liang retweeted
As models get smarter and agentic workloads get more demanding, users expect both intelligence and speed.
That’s why inference speed is becoming part of the AI experience, not just an infrastructure metric.
Premium inference is here. ⚡
More in our blog: bit.ly/3S3jjMQ
That’s why inference speed is becoming part of the AI experience, not just an infrastructure metric.
Premium inference is here. ⚡
More in our blog: bit.ly/3S3jjMQ
1
4
9
76,257
Super excited!
Our squad just keeps getting stronger. 🦾 @mmoazami is joining SambaNova as Vice Chair of Global Strategy & Partnerships, reporting to @RodrigoLiang.
Mohsen has supported some of the world's hottest technology companies, enabling global expansion, forging strategic relang major industry shifts.
Welcome to SambaNova, Mohsen!
bit.ly/4xk7lxA
1
0
7
765
Great to chat @jonfortt!
“How do we solve the scaling problems as AI becomes a global problem?” — @RodrigoLiang
Thank you to @JonFortt for having our CEO on @CNBC Fortt Knox to discuss why enterprises are bringing AI on-prem and why we're the only proven premium AI chip inference.
We appreciate the chance to share our mission! 🚀
cnb.cx/44KX3KG
0
0
4
517
Rodrigo Liang retweeted
My latest Bloomberg Interview, where I talked about AI technologies coming from China, including Kimi K3, and 01.ai's TrueNorth and Boss AI. bloomberg.com/news/videos/20…
13
38
112
43,363
Great to see so many companies get behind open weights. Open models widen access, force competition, and let organizations own what they build instead of renting it back forever. Next comes performance: full precision, fast, at scale. The whole ecosystem gets stronger for it.
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter.
AI will transform every industry, power every company, and be built by every country.
Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty.
rontier closed models and frontier open models.
images.nvidia.com/pdf/Open-Weigh…
0
1
10
1,092
Rodrigo Liang retweeted
AI training made GPUs the standard. AI inference is changing the equation. As Abhi shared with @FierceNetwork, minimizing data movement is the key to faster, more efficient inference—and our RDUs are purpose-built to deliver enterprise AI without requiring entirely new data aMariesbeat for the coverage!
bit.ly/4yzhnfr
bit.ly/4yzhnfr
0
5
4
1,142
Rodrigo Liang retweeted
Same prompt. Same model. Two stacks.
At #Computex, we demonstrated disaggregated inference live: GPUs handling prefill, SambaNova RDUs handling decode, and CPUs orchestrating agent execution.
The result? Up to 2X the speed of B200-only configurations 🦾
At #Computex, we demonstrated disaggregated inference live: GPUs handling prefill, SambaNova RDUs handling decode, and CPUs orchestrating agent execution.
The result? Up to 2X the speed of B200-only configurations 🦾
1
3
21
1,520
Rodrigo Liang retweeted
Co-founder @sarahookr on stage at @brainstormtech with @SambaNovaAI CEO @RodrigoLiang and @FortuneMagazine's @jeremyakahn.
The discussion: Chips not built for inference and models that don’t learn continuously.
Two CEOs, two sides of the same problem. A new era of intelligence is here.
The discussion: Chips not built for inference and models that don’t learn continuously.
Two CEOs, two sides of the same problem. A new era of intelligence is here.
2
11
44
3,219
Here is what happens inside Sambanova RDU.
What actually happens during AI inference?
This video breaks down how RDUs, memory architecture, and multi-level parallelism work together to generate thousands of tokens in parallel across racks.
Built for scalable, real-world AI inference 🦾
Learn more: sambanova.ai/products/rdu-a…
1
0
9
708
Rodrigo Liang retweeted
"VC2 is the largest commercial deployment of SambaNova technology in our history, and we're proud to partner with the industry's strongest leaders." - @LipBuTan1
Excited to see @vectorcorecomp launch live w/ our RDUs powering decode alongside GPUs & CPUs.
itbrief.co.uk/story/vista-la…
Excited to see @vectorcorecomp launch live w/ our RDUs powering decode alongside GPUs & CPUs.
itbrief.co.uk/story/vista-la…
1
8
42
8,326