Pinned Tweet
Coming to @NeurIPSConf 2026: Can you learn dynamics from noisy observations ๐๐ถ๐๐ต๐ผ๐๐ ๐ป๐๐บ๐ฒ๐ฟ๐ถ๐ฐ๐ฎ๐น ๐๐ถ๐บ๐๐น๐ฎ๐๐ถ๐ผ๐ป? Yes, and just as accurately as you can with simulation!
Paper: arxiv.org/abs/2606.16138
Code: github.com/lindermanlab/hโฆ
Thread๐งต
Paper: arxiv.org/abs/2606.16138
Code: github.com/lindermanlab/hโฆ
Thread๐งต
2
39
217
18,731
Amazing work by @nate_diamant and collaborators. Check out SMFNet!
1/4 One DNA sequence, many chromatin states.
Excited to share SMFNet, a diffusion model predicting single-molecule chromatin accessibility. Explainer video below!
With co-first author Till (his thread: bsky.app/profile/tschwaโฆ), Yuliya, Roze, @anshulkundaje & Arnaud Krebs.
0
1
7
391
Henry Smith retweeted
1/5 Cryo-EM gives high-resolution RNA structures, but only when high Mgยฒโบ freezes out their motion.
At physiological conditions, RNAs are dynamic and 3D reconstruction fails. Can we still learn their folding equilibria?
New preprint: yes, straight from the raw particle images๐
At physiological conditions, RNAs are dynamic and 3D reconstruction fails. Can we still learn their folding equilibria?
New preprint: yes, straight from the raw particle images๐
3
34
130
7,127
Henry Smith retweeted
I'm excited to share this new work led by @smithhenryd! We develop Helmholtz-SDE, a faster and more accurate simulation-free inference algorithm for latent SDEs. The animation below speaks for itself!
Coming to @NeurIPSConf 2026: Can you learn dynamics from noisy observations ๐๐ถ๐๐ต๐ผ๐๐ ๐ป๐๐บ๐ฒ๐ฟ๐ถ๐ฐ๐ฎ๐น ๐๐ถ๐บ๐๐น๐ฎ๐๐ถ๐ผ๐ป? Yes, and just as accurately as you can with simulation!
Paper: arxiv.org/abs/2606.16138
Code: github.com/lindermanlab/hโฆ
Thread๐งต
9
8
85
3,658
Does this matter for real systems? On experimental predator-prey data (Blasius et al., 2020), Helmholtz-SDE recovers the cycle period and predator lag (6.9 / 1.7 days vs. empirical 6.7 / 1.7), while SDE Matchingโs dynamics decay to a fixed point.
2
0
4
275
This work was done in collaboration with my wonderful advisors Brian Trippe @brianltrippe and Scott Linderman @scott_linderman.
Interested in learning more about Helmholtz-SDE?
Reach out via DM or visit our poster in Sydney on Wednesday, Dec 9 from 5-8 PM AEDT!
Interested in learning more about Helmholtz-SDE?
Reach out via DM or visit our poster in Sydney on Wednesday, Dec 9 from 5-8 PM AEDT!
1
0
5
267
Henry Smith retweeted
Same marginals. Different dynamics.
Gaussian Flow Dynamics + Gauge Matching learn temporal structure beyond one-time marginals, enabling more flexible, simulation-free neural SDE learning in continuous physical time.
arxiv.org/abs/2610.04390
#PhysicalTime #SDE #ML #GenAI
Gaussian Flow Dynamics + Gauge Matching learn temporal structure beyond one-time marginals, enabling more flexible, simulation-free neural SDE learning in continuous physical time.
arxiv.org/abs/2610.04390
#PhysicalTime #SDE #ML #GenAI
2
8
44
2,366
Thank you for the highlight @canaesseth!
We are excited that simulation-free VI for latent SDEs can match the performance of simulation-based VI at a fraction of the runtime. ๐๏ธ๐จ
We are excited that simulation-free VI for latent SDEs can match the performance of simulation-based VI at a fraction of the runtime. ๐๏ธ๐จ
Make sure to also check out the excellent paper from @smithhenryd @brianltrippe and @scott_linderman on Helmholtz-SDE that studies analytic approximations to the optimal gauge.
arxiv.org/abs/2606.16138
0
2
5
526
Henry Smith retweeted
Make sure to also check out the excellent paper from @smithhenryd @brianltrippe and @scott_linderman on Helmholtz-SDE that studies analytic approximations to the optimal gauge.
arxiv.org/abs/2606.16138
arxiv.org/abs/2606.16138
1
2
8
967
Henry Smith retweeted
Softmax attention is expressive, but its KV cache grows with sequence length. Linear attention keeps a fixed state size, but is less expressive.
In our #COLM2026 paper, Switching Linear Attention (SwiLA) gets the best of both worlds by switching among multiple linear maps ๐งต
In our #COLM2026 paper, Switching Linear Attention (SwiLA) gets the best of both worlds by switching among multiple linear maps ๐งต
10
72
456
21,530
Henry Smith retweeted
How do we make quasi-Newton optimization methods practical for modern deep learning?
New preprint with @jooko303 @tanyaisanumber @gowerrobert on SoftServe -- a quasi-Newton method that designed for non-convex objectives, while also scaling to very large neural networks.
New preprint with @jooko303 @tanyaisanumber @gowerrobert on SoftServe -- a quasi-Newton method that designed for non-convex objectives, while also scaling to very large neural networks.
3
18
96
6,762
Henry Smith retweeted
Joining the NeurIPS celebration: our curse of ambiguity paper will be a spotlight ๐
We show that high entropy tokens need
1. More capacity to store
2. Larger embeddings to be represented
3. More training steps
4. More samples to reduce sampling noise
Scaling laws study er all tokens in the data; our work zooms in and sheds some light onto which tokens are harder to learn ๐ฌ
We show that high entropy tokens need
1. More capacity to store
2. Larger embeddings to be represented
3. More training steps
4. More samples to reduce sampling noise
Scaling laws study er all tokens in the data; our work zooms in and sheds some light onto which tokens are harder to learn ๐ฌ
We often ask how hard a task is for an LLM to learn, but what about individual tokens?
Our new paper w/ @scott_linderman @hyundongleee digs into that question and reveals a curse of ambiguity: contexts with multiple possible next tokens are harder for LLMs to learn.
2
13
104
6,393
Henry Smith retweeted
New @open_rss blog (rs-station.github.io/2026/08/31/areโฆ) on a question weโve been thinking about a lot: what information about a molecular ensemble survives measurement and processing? @PilarCossio2 @EmilThomasen
A fuzzy cryo-EM map is not itself an ensemble. But an averaged measurement erage structure either.
We use ensemble resolution to frame the better question: what differences between molecular distributions can the data actually distinguish?
A fuzzy cryo-EM map is not itself an ensemble. But an averaged measurement erage structure either.
We use ensemble resolution to frame the better question: what differences between molecular distributions can the data actually distinguish?
2
8
41
8,567
Henry Smith retweeted
We often ask how hard a task is for an LLM to learn, but what about individual tokens?
Our new paper w/ @scott_linderman @hyundongleee digs into that question and reveals a curse of ambiguity: contexts with multiple possible next tokens are harder for LLMs to learn.
Our new paper w/ @scott_linderman @hyundongleee digs into that question and reveals a curse of ambiguity: contexts with multiple possible next tokens are harder for LLMs to learn.
6
12
76
15,856