@CMcdazzle @pleovision @alcuintweets @chatokox3 yeah I just need to hook that up tomorrow, been busy with work
1
0
0
16
@guerre_doctrine yes... yes we should... this stirred a deep memory I forgot I had... how do you do it...
0
0
1
21
@XorDev I thought Inigo had peaced out from developing it, glad to see it's back. I've been a happy fragcoord user though
0
0
2
88
Pleometric retweeted
I've always believed that intelligence should come from simple, general building blocks that learn their own abstractions directly from raw data; in other words, the bitter lesson. I think we're finally seeing a real step towards AI that can learn from all data.
Language s a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less?
Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.
Language s a microcosm of this ideal, and to me it's a central problem in AI: if we can't build LLMs that learn end-to-end from bytes, how will we handle the rest of the world's data that we understand even less?
Last year we introduced hierarchical networks (H-Nets) as a first step. Our new version finds up to 3-5x efficiency gains in controlled scaling law experiments, and at larger scale matches an open-source model trained on 11T tokens with ~10x less data and compute. The posts below walk through what we found and why we think it works.
124
359
3,405
305,014
@wavefnx it's too horny to be pure sweet Maschinenmensch Maria, the Sorayama neuron is too strong
1
0
1
109
@hyrevayn I should note that this is good looking simply because I'm optimizing for speed
0
0
1
41
@kojinglick the question comes by way of people telling me prices are doubling and will soon be tripling
2
0
2
86



