Remember: by participating on twitter, you are adding value to it, thereby incentivizing others to join/stay, and amplifying the voice/reach of the people who set its algorithm's biases.
Is this the ideology you want to amplify? Because if you are here, you are amplifying this.
Is this the ideology you want to amplify? Because if you are here, you are amplifying this.
1
0
0
501
David Marx (@digthatdata.bsky.social) retweeted
'we're in this bizarre world where the best way to learn about llms... is to read papers by chinese companies. i do not think this is a good state of the world' - us labs keeping their architectures and algorithms secret is ultimately hurting ai development in the us.
5
25
123
19,027
> Republicans: "We love America! It has the greatest system of governance. Look, I even carry the constitution next to my heart like a little bible :*) "
> Also republicans: "DISMANTLE THE GOVERNMENT! FUCK THE SEPARATION OF POWERS! GOD KING PRESIDENT CULT OF PERSONALITY!"
> Also republicans: "DISMANTLE THE GOVERNMENT! FUCK THE SEPARATION OF POWERS! GOD KING PRESIDENT CULT OF PERSONALITY!"
0
0
2
288
David Marx (@digthatdata.bsky.social) retweeted
🔥 Are you ever dissatisfied with the imprecise names in vision-language datasets?
🚀 At #NeurIPS2024, we introduce 𝐑𝐄𝐍𝐎𝐕𝐀𝐓𝐄, showing how better segmentation dataset names lead to 𝐛𝐞𝐭𝐭𝐞𝐫 𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠 & 𝐞𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧.
Let’s dive in! 🧵👇
🚀 At #NeurIPS2024, we introduce 𝐑𝐄𝐍𝐎𝐕𝐀𝐓𝐄, showing how better segmentation dataset names lead to 𝐛𝐞𝐭𝐭𝐞𝐫 𝐭𝐫𝐚𝐢𝐧𝐢𝐧𝐠 & 𝐞𝐯𝐚𝐥𝐮𝐚𝐭𝐢𝐨𝐧.
Let’s dive in! 🧵👇
1
7
34
5,818
Yo this paper is wild.
🌟Announcing NeurIPS spotlight paper on the transition from lazy to rich🔦
We reveal through exact gradient flow dynamics how unbalanced initializations promote rapid feature learning
co-led @AllanRaventos
and @ClementineDomi6 @FCHEN_AI @klindt_david @SaxeLab @SuryaGanguli
0
1
1
444
David Marx (@digthatdata.bsky.social) retweeted
New NanoGPT training speed record: 3.28 FineWeb val loss in 4.66 minutes
Previous record: 5.03 minutes
Changelog:
- FlexAttention blocksize warmup
- hyperparameter tweaks
Previous record: 5.03 minutes
Changelog:
- FlexAttention blocksize warmup
- hyperparameter tweaks
8
21
242
75,292
David Marx (@digthatdata.bsky.social) retweeted
This is officially the new record! Congrats @hi_tysam (who is also an OG of CIFAR-10 speedrunning)
x.com/hi_tysam/statu…
x.com/hi_tysam/statu…
New NanoGPT training speed record: 3.28 FineWeb val loss in 4.66 minutes
Previous record: 5.03 minutes
Changelog:
- FlexAttention blocksize warmup
- hyperparameter tweaks
3
11
138
19,816
David Marx (@digthatdata.bsky.social) retweeted
Narrative on X: 🦋 has no AI/ML and just talks about itself
My actual feed on 🦋:
My actual feed on 🦋:
58
62
1,264
241,919
David Marx (@digthatdata.bsky.social) retweeted
You can choose what feeds you have on your homepage -- I personally like the "popular with friends" feed (in the above tweet). The default is "following" - which looks like this for me:
4
5
120
21,241
David Marx (@digthatdata.bsky.social) retweeted
Because X has tended to censor discussion of social networks I won't link directly, but look for this post to get an instant AI/ML feed thanks to @maosbot
10
14
192
25,244
David Marx (@digthatdata.bsky.social) retweeted
We announce LAION-DISCO-12M - a collection of 12 million links to publicly available YouTube samples paired with metadata to support basic machine learning research in foundation models for generic audio and music.
laion.ai/blog/laion-dis…
laion.ai/blog/laion-dis…
0
44
190
14,547
