We have very little time to stop full recursive self improvement

But ASI hasn't taken over yet

If we all work really hard we might still have a chance

But this means that every single person who is aware of what is going on must be *actually trying*

Like "we're all gonna die if we don't get our shit together so let's do everything we possibly can to stop this" type of trying
Read this from Ajeya. Then read it again.

This is really bad. We may have very little time to prevent this.

If your plan doesn't provide for a path to putting the brakes on this in 2027, it seems like a weak plan.

The board is set. We know enough. Governments should act now.
40
21
154
7,854
Replying to @MichaelTrazzi
One thing that anyone can do: protest

aitreatymarch.org
2
0
6
344
good morning
0
7
51
1,844
It's still time to stop RSI

Next Saturday (Nov 14) hundreds will be marching in SF, DC, NYC, Paris & Montréal demanding that Trump & Xi Jinping start negociating an AI Treaty that would end this deadly AI Arms race

Join the march: aitreatymarch.org
20
24
123
8,631
watching netflix at the dentist
2
0
40
1,363
Stop The AI Race joined Irreplaceable in their national day of walkout on Tuesday, asking AI Companies to freeze AI Development now
9
10
103
2,318
Replying to @MichaelTrazzi
We appeared outside OpenAI's office both in SF and NYC as part of a coalition including nurses, climate groups and a lot of students that joined the walkout
2
0
17
728
Replying to @MichaelTrazzi
But this is just the beginning

Stop The AI Race is planning marches in SF, DC, NYC, Montréal & Paris on November 14, calling for an AI Treaty

Find your march: aitreatymarch.org
1
0
9
318
Tomorrow we're talking about stopping frontier ai development at washington square park @ 4pm

partiful.com/e/YuGQ3lRUKDWc…
0
2
18
993
Ban RSI
SITUATION DETECTED: Anthropic co-founder Jack Clark says he now believes it is likely that full recursive self-improvement will become possible in 2027.
6
21
204
3,356
"if [alignment has not been solved], then racing into RSI is a folly that is unprecedented in world history"
the researchers at all the labs would tell you in private and sometimes in public that alignment has not been solved. if this is true, then racing into RSI is a folly that is unprecedented in world history. we will need to significantly slow the frontier of research very soon
2
3
120
2,876
if research taste in AI models stays on trend:

"the AI Futures Model's probability of a taste-only singularity would rise from 51% to 88%, and its median date for superintelligence moves about 18 months earlier, from mid-2030 to late 2028."
If our doubling trend continued and the “actual” taste involved in frontier AI research had the same doubling time as the one that TasteVal measured, AI takeoff expectations would be faster: the AI Futures Model's probability of a taste-only singularity would rise from 51% to 88%, and its median date for superintelligence moves about 18 months earlier, from mid-2030 to late 2028.

But the "actual" taste involved in frontier AI research may double at a different rate, since (1) our tasks run on a single GPU with fast feedback loops while frontier experiments take weeks on big clusters, (2) we don't measure choosing which problems to work on, and (3) our trend may not continue.
1
0
9
1,692
Lisan al-Gaib
Minerva author on AI solving math:
- IMO gold by 2026 seems reasonable
- superhuman math in 2026 not crazy
- auto-formalizing is unimpressive to mathematicians as most important theorems are hard to formalize
8
16
611
29,554
Reminder that these companies are using their AIs to automate AI R&D itself, bringing us each day closer to self-improving superintelligence that could lead to human extinction

This needs to stop
We’re releasing a broad range of new mathematical results produced by an internal frontier model.

We’ve been consulting with the independent Advisory Group on Mathematics and Artificial Intelligence at the Institute for Advanced Study, and we have drawn on their advice and public recommendations to inform how we release these results.

github.com/openai/math
6
4
63
1,748
I have a lot of respect for Matthew's ability to Just Do Things

Very happy to have him lead Stop The AI Race in NYC!
My testimony at the hearing on AI at @NYCCouncil
0
0
75
2,450
In the New York Times
3
9
89
2,776
Stop The AI Race's Procession to OpenAI's office in NYC
0
8
47
2,000
Michaël Trazzi retweeted
I was honestly p unsure about running a conference with five days from announcement to start time, but we've sold over a hundred tickets so far. We're doing this! Come join us!
agi.wtf/?v=20260919
1
3
36
3,922
Yesterday, @StopTheAIRace marched from OpenAI to Anthropic to City Hall, demanding that San Francisco declare an AI emergency. 🧵
20
17
128
2,976
Replying to @MichaelTrazzi
Arriving there, we had a tense encounter with Supervisor Bilal Mahmood (@bilalmahmood) in front of the steps.

Ten minutes later we were invited into his office, where we asked him to escalate the emergency to Mayor Daniel Lurie (@DanielLurie).
1
0
21
797
Replying to @MichaelTrazzi
This march happened as the public is finally waking up to the existential dangers from AI, following Jacob Coxon's departure last week.

If governments are not yet answering the calls from AI company CEOs for an AI slowdown, it's time for San Francisco to lead.
0
0
20
344