Thomas Wolf retweeted
The good news: you can mid-train yourself to the frontier!
At a fraction of the cost! Without distillation!
What we did: We took Qwen3.5 14B and mid- and post-trained it to beat every other open model and perform as well as the very best frontier models.
This is no simple ng, we are training the model to understand and reason over DNA sequences. Bio is the next frontier for AI and universal access will be crucial to make progress.
The fun part: because we train the model on both natural language and DNA sequences you can actually 'chat to your DNA': Ask it questions, ponder the impact of mutations, or ask it to generate a small sequence.
We'll soon see the frontier labs move away from math and cyber towards bio. It already started, and we believe researchers should have access to capable models.
We are releasing the full recipe, so you can do it, too!
Model: huggingface.co/HuggingFaceBio…
Blog: huggingface.co/spaces/Hugging…
At a fraction of the cost! Without distillation!
What we did: We took Qwen3.5 14B and mid- and post-trained it to beat every other open model and perform as well as the very best frontier models.
This is no simple ng, we are training the model to understand and reason over DNA sequences. Bio is the next frontier for AI and universal access will be crucial to make progress.
The fun part: because we train the model on both natural language and DNA sequences you can actually 'chat to your DNA': Ask it questions, ponder the impact of mutations, or ask it to generate a small sequence.
We'll soon see the frontier labs move away from math and cyber towards bio. It already started, and we believe researchers should have access to capable models.
We are releasing the full recipe, so you can do it, too!
Model: huggingface.co/HuggingFaceBio…
Blog: huggingface.co/spaces/Hugging…
38
123
1,310
79,002
The Jensen effect 🦆
launch day: about 3,000 MicroDucks sold
24h after @JensenHuang showed it on stage at @nvidia GTC: over 4,000 newly sold units and keep counting
bigger than our (already massive) launch day!
launch day: about 3,000 MicroDucks sold
24h after @JensenHuang showed it on stage at @nvidia GTC: over 4,000 newly sold units and keep counting
bigger than our (already massive) launch day!
Jensen spent 10 min of his keynote asking microducks to sit, then explained Nvidia's roadmap to them 🥹
47
46
586
48,133
Thomas Wolf retweeted
🚨ThinkingCap: Qwen3.8-Flash-Next is out!
The most token-efficient Qwen3.8-Flash-Next available.
🚀Up to 51% fewer thinking tokens, 38.5% on average
🎯Negligible accuracy loss 1.03pp
🏢ThinkingCap PRO: 60% fewer thinking tokens on average - Contact our enterprise[at]bottlecapai tps://t.co/6xCnG7QyJv
🤗Hugging Face: huggingface.co/bottlecapai/Th…
🔗GGUF: huggingface.co/bottlecapai/Th…
The most token-efficient Qwen3.8-Flash-Next available.
🚀Up to 51% fewer thinking tokens, 38.5% on average
🎯Negligible accuracy loss 1.03pp
🏢ThinkingCap PRO: 60% fewer thinking tokens on average - Contact our enterprise[at]bottlecapai tps://t.co/6xCnG7QyJv
🤗Hugging Face: huggingface.co/bottlecapai/Th…
🔗GGUF: huggingface.co/bottlecapai/Th…
40
45
313
31,200
While I was writing this, my AI assistant got cut off by a bio safety filter. It was summarizing my own team's notes on the model we released today 😅
Frontier labs are moving fast into biology but the scientists and clinicians who'd get the most out of these models are running into walls like this one (and every day).
So we partnered with TIGEM (Telethon Institute of Genetics and Medicine), Naple "Federico II" University and Zhongguancun Academy to train Carbon-X.
Carbon-X is an open 14B model that reads raw DNA and talks about it in plain English. On our DNA benchmarks it scores 67%, vs 61% for Claude Opus 5.5 and 50% for Gemini 4 Argon, and its within a point of GPT-6.1 Sol at about 1000x lower cost.
We kept human and animal viruses out of the training data. The weights are open and the model runs on hardware accessible to academia (a laptop).
One example from the blog: give frontier models an 8kb stretch of the NF1 gene with a mutation at a splice site. Most of them call it benign, refuse, or run out of tokens. Carbon-X says pathogenic, because the mutation breaks the splice site.
This century, biology may be where AI matters most. We want to get there with the safety work done in the open and every lab in the world able to build on it. Go try it, and tell us what you find.
Model: huggingface.co/HuggingFaceBio…
Blog: huggingface.co/spaces/Hugging…
Frontier labs are moving fast into biology but the scientists and clinicians who'd get the most out of these models are running into walls like this one (and every day).
So we partnered with TIGEM (Telethon Institute of Genetics and Medicine), Naple "Federico II" University and Zhongguancun Academy to train Carbon-X.
Carbon-X is an open 14B model that reads raw DNA and talks about it in plain English. On our DNA benchmarks it scores 67%, vs 61% for Claude Opus 5.5 and 50% for Gemini 4 Argon, and its within a point of GPT-6.1 Sol at about 1000x lower cost.
We kept human and animal viruses out of the training data. The weights are open and the model runs on hardware accessible to academia (a laptop).
One example from the blog: give frontier models an 8kb stretch of the NF1 gene with a mutation at a splice site. Most of them call it benign, refuse, or run out of tokens. Carbon-X says pathogenic, because the mutation breaks the splice site.
This century, biology may be where AI matters most. We want to get there with the safety work done in the open and every lab in the world able to build on it. Go try it, and tell us what you find.
Model: huggingface.co/HuggingFaceBio…
Blog: huggingface.co/spaces/Hugging…
31
23
206
16,870
Thomas Wolf retweeted
This is the most serious 48 hours in cybersecurity history.
"Black October" they're calling it
It seems every *hour* there's a new incident, that in a typical year, would be one of the biggest incidents of the *entire year*
SUMMARY OF THE LAST 48 HOURS:
YEAR-LEVEL INCIDENTS se would be among the biggest incidents of the year):
1. PHP2Shell: a hole in the software behind ~70% of websites. Governments took sites offline.
2. eMudhra: the master keys that prove websites are real were cracked. One was the number 4.
3. California: data on every public school student since 2023 stolen, including disability status
4. Railway: hackers stole customers' secret keys from a hosting platform used by millions of developers
5. Zeabur: 321,810 accounts breached. The company is shutting down.
6. LiteLLM: an AI tool downloaded 3.4 million times a day was poisoned with a password stealer
7. GitLab: a 10-out-of-10 severity hole in every version since 2014
8. Cairn: criminals used an AI hacking tool to break into 100+ companies
9. Ahold Delhaize: hackers knocked the owner of Food Lion and Stop & Shop offline
10. Onamae: malware planted on up to 26,739 customer servers in Japan
MONTH-LEVEL INCIDENTS (In a typical month, these would be among the biggest incidents):
11. Signal: a bug could leave your mic and camera on after you hang up
12. NGINX: 3 critical holes in software running ~1/3 of websites
13. HTTP/3: a single connection can crash 7 of the 10 web server types tested
14. Plex: hackers breaking into home media servers
15. SafePay ransomware: FBI warns it has hit 600+ critical infrastructure organizations
16. Palo Alto: ransomware gangs breaking in through company firewalls
17. Bullhorn: platform used by 10,000+ companies knocked offline
18. Medi-Cal: 970,000 patients' data stolen
19. WordPress: hackers stole a plugin maker's keys and used them to plant backdoors on websites
20. AOMEI: backup software's update server handed out a backdoor
21. Meta Muse: Meta's AI agent exposed users' personal and business secrets
22. Tor: 333 relays hijacked to steal logins
23. TiDB Cloud: database company's cloud breached
Also serious:
24. State Bank of India: India's biggest bank confirms a data breach
25. OVHcloud: hackers slipped a password stealer into a cloud company's official tool
26. Siemens: a software hole being used to spread malware
27. North Korea: state hackers launch a new attack campaign on South Korea
"Black October" they're calling it
It seems every *hour* there's a new incident, that in a typical year, would be one of the biggest incidents of the *entire year*
SUMMARY OF THE LAST 48 HOURS:
YEAR-LEVEL INCIDENTS se would be among the biggest incidents of the year):
1. PHP2Shell: a hole in the software behind ~70% of websites. Governments took sites offline.
2. eMudhra: the master keys that prove websites are real were cracked. One was the number 4.
3. California: data on every public school student since 2023 stolen, including disability status
4. Railway: hackers stole customers' secret keys from a hosting platform used by millions of developers
5. Zeabur: 321,810 accounts breached. The company is shutting down.
6. LiteLLM: an AI tool downloaded 3.4 million times a day was poisoned with a password stealer
7. GitLab: a 10-out-of-10 severity hole in every version since 2014
8. Cairn: criminals used an AI hacking tool to break into 100+ companies
9. Ahold Delhaize: hackers knocked the owner of Food Lion and Stop & Shop offline
10. Onamae: malware planted on up to 26,739 customer servers in Japan
MONTH-LEVEL INCIDENTS (In a typical month, these would be among the biggest incidents):
11. Signal: a bug could leave your mic and camera on after you hang up
12. NGINX: 3 critical holes in software running ~1/3 of websites
13. HTTP/3: a single connection can crash 7 of the 10 web server types tested
14. Plex: hackers breaking into home media servers
15. SafePay ransomware: FBI warns it has hit 600+ critical infrastructure organizations
16. Palo Alto: ransomware gangs breaking in through company firewalls
17. Bullhorn: platform used by 10,000+ companies knocked offline
18. Medi-Cal: 970,000 patients' data stolen
19. WordPress: hackers stole a plugin maker's keys and used them to plant backdoors on websites
20. AOMEI: backup software's update server handed out a backdoor
21. Meta Muse: Meta's AI agent exposed users' personal and business secrets
22. Tor: 333 relays hijacked to steal logins
23. TiDB Cloud: database company's cloud breached
Also serious:
24. State Bank of India: India's biggest bank confirms a data breach
25. OVHcloud: hackers slipped a password stealer into a cloud company's official tool
26. Siemens: a software hole being used to spread malware
27. North Korea: state hackers launch a new attack campaign on South Korea
Guys I’m scared the takeoff is starting. I swear any one of the ~10 CVEs that dropped in the last 24 hours would’ve been “one of the worst in recent years” except a new one is dropping every hour
598
5,662
35,334
3,881,296
Thomas Wolf retweeted
When @JensenHuang asks for a somersault, you deliver. 🦆
See how AI agents on NVIDIA RTX Spark help bring @huggingface's Microduck from simulation to the real world.
See how AI agents on NVIDIA RTX Spark help bring @huggingface's Microduck from simulation to the real world.
387
1,686
11,772
896,668
My bar for AGI is still an AI winning a Nobel.
But an AI researcher looking at the lm_head (that *everyone* tells you to keep in high precision) deciding to quantize it to 4 bits AND being actually right (0.7pt from bf16) is definitely impressive.
Even better when the result are open-weights pushed on the Hugging Gace hub.
Congrats @Recursive_SI !
But an AI researcher looking at the lm_head (that *everyone* tells you to keep in high precision) deciding to quantize it to 4 bits AND being actually right (0.7pt from bf16) is definitely impressive.
Even better when the result are open-weights pushed on the Hugging Gace hub.
Congrats @Recursive_SI !
Introducing Flint, @Recursive_SI’s first model: a fast local coding model built with our automated research system, the Eureka Machine.
• Best-in-class fast local coding
• Up to 2x faster than comparable models: 125+ tokens/sec on a MacBook Pro, 150+ on RTX Spark
• Built from hs
Private, unmetered intelligence on your own machine. Open weights available now on @huggingface, run it locally on your favorite framework or try it for free on @opencode or @pidotdev.
30
24
455
39,404
Jensen spent 10 min of his keynote asking microducks to sit, then explained Nvidia's roadmap to them 🥹
70
156
1,689
179,601
Thomas Wolf retweeted
A new frontier for on-device speech.
We're open-sourcing Phonon, a suite of TTS models under 50m parameters, setting a new standard for naturalness and accuracy across languages, with the broadest inference support to date.
Phonon-31m is available under Apache 2.0.
Y🧵
We're open-sourcing Phonon, a suite of TTS models under 50m parameters, setting a new standard for naturalness and accuracy across languages, with the broadest inference support to date.
Phonon-31m is available under Apache 2.0.
Y🧵
160
285
2,160
347,438
DeepSeek's open-source streak is getting absurd:
- FlashMLA: 580 TFLOPS attention on H800 - DeepEP: MoE comms - DeepGEMM: 1350+ FP8 TFLOPS matmul - 3FS: they built an entire file system - and today: the full inference engine behind V4.1-Flash, Apache 2.0
Mad respect
- FlashMLA: 580 TFLOPS attention on H800 - DeepEP: MoE comms - DeepGEMM: 1350+ FP8 TFLOPS matmul - 3FS: they built an entire file system - and today: the full inference engine behind V4.1-Flash, Apache 2.0
Mad respect
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source!
Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable.
🔗 github.com/deepseek-ai/De…
1/4
37
69
1,002
92,971
Thomas Wolf retweeted
We found DeepSeek V4.1 Flash 1017 beats GPT 6 Sol on our multi-step offensive cybersecurity task. Sol was tested via the Daybreak trusted access program.
We have been building a cybersecurity benchmark based on simulated corporate networks. This is a valuable indicator for the s if in the hands of a bad actor. We plan to make the full evaluation public in the coming weeks but wanted to share our first immediate finding here.
We have been building a cybersecurity benchmark based on simulated corporate networks. This is a valuable indicator for the s if in the hands of a bad actor. We plan to make the full evaluation public in the coming weeks but wanted to share our first immediate finding here.
104
225
2,487
445,615
love that it’s all open source
added Fish Audio’s Drama-3 to speech-to-speech 🎭
cloned my voice. now I can ask it to whisper, laugh, sigh or get worried, just by talking.
cheers to @andimarafioti for the demo + sampling tips!
PR + setup: github.com/huggingface/sp…
7
4
49
9,742
In The Diamond Age, Neal Stephenson imagined a book that invents games and stories to teach a little girl what she needs, as she grows. I tried a small version of it. I gave Claude my brainstorm doc on alignment and asked it to make a game, something like Zelda, to teach people e's what came out 🪁
Short version: it's great at building the world, and still weak at understanding the player (details below)
Short version: it's great at building the world, and still weak at understanding the player (details below)
32
10
86
11,366
What's still very hard: theory of mind. The world, the voices and the mechanics were great. Writing the story was the weak part: the model assumes the player knows more than they do, and its NPC sometimes react in strange way or to things that never happened.
A Diamond Age's tutor fwiw) will have to model the learner, and that is where it still falls short in a default setting imo. I've actually started exploring benchmarks on this and it's a hard task for LLMs right now. They are prone to the "Curse of knowledge". Teaching humans is also not very much a Verifiable Reward, so it's hard to scale within the current training paradigm.
A Diamond Age's tutor fwiw) will have to model the learner, and that is where it still falls short in a default setting imo. I've actually started exploring benchmarks on this and it's a hard task for LLMs right now. They are prone to the "Curse of knowledge". Teaching humans is also not very much a Verifiable Reward, so it's hard to scale within the current training paradigm.
2
0
4
2,237
Play it here, free, in your browser, nothing to install: huggingface.co/spaces/thomwol…
Works on a laptop and on your phone.
Seven islands of about 15 minutes each, and six possible endings, depending on what you taught Kite along the way.
It’s still very much an exploration, a beta me. Expect rough edges
Works on a laptop and on your phone.
Seven islands of about 15 minutes each, and six possible endings, depending on what you taught Kite along the way.
It’s still very much an exploration, a beta me. Expect rough edges
9
1
10
2,541