Native PyTorch on TPUs is here—and TorchTPU is officially open source.
Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed.
Learn more from #PyTorchConf2026 → goo.gle/4hWxEVH
Train and serve models using the tools you already know: @vllm_project, @sgl_project, @_llm_d_, TorchTitan, @huggingface, and @raydistributed.
Learn more from #PyTorchConf2026 → goo.gle/4hWxEVH
Oct 21, 2026 · 5:00 PM UTC
23
68
404
44,264
@googlecloud @vllm_project @_llm_d_ @huggingface @raydistributed Excited to join TorchTPU family!
Here is our blog about SGLang-TorchTPU:
lmsys.org/blog/2026-10-2…
Here is our blog about SGLang-TorchTPU:
lmsys.org/blog/2026-10-2…
0
1
10
645
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Exciting news for a native and principled PyTorch backend for Google TPUs announced at #PyTorchCon this week!
Also learn more on the PyTorch blog: pytorch.org/blog/introduci…
Also learn more on the PyTorch blog: pytorch.org/blog/introduci…
0
2
6
556
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed all i need you to do is just set me loose
0
0
2
249
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Guess "TPUs mean rewriting everything in JAX" is finally retired as an excuse.
0
0
1
163
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Native usually means slow on first run.
0
0
0
143
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed The `torch.accelerator.current_accelerator()` example is worth stealing: keep device selection out of the model code. pytorch.org/blog/introduci…
0
0
0
117
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Good to see familiar serving tools on TPUs. We're scoping a BBF evaluation for repeated exact-answer tasks. Which recipe includes cold setup, cache invalidation and fallback costs as well as warm serving? We want a fair full-cost baseline.
0
0
0
8
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed let's gooo this is fire broo
0
0
0
79
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Kagglers will love this
0
0
0
86
Wanna know why doing Street Interview ads on your own is gonna fail? Check out @thespmedia
28
136
669
4,920,359
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Official AI Open Si 😂📱
0
0
0
150
@googlecloud @vllm_project @sgl_project @_llm_d_ @huggingface @raydistributed Dispersa esse monopólio ! 🤝
0
0
0
22