Nous Research

@NousResearch

Oct 22

Matt Cynamon

@mattcynamon

Oct 22

Yesterday AI was used to uncover major vulnerabilities in the infrastructure of the internet.

It's yet another example of how profoundly AI is reshaping the web.

But what emerges on the other side is very much up for grabs.

We were lucky enough to recently introduce two heroes @eastdakota, CEO & cofounder of @Cloudflare
@dillonrolnick, CEO & cofounder of @NousResearch, the creators of Hermes, the largest open source agent harness in the world.

Together they discussed who gets to build, control, and benefit from an internet run by AI

It's worth a listen if you care about the future of the web.

0:00 Preview
1:41 From a Discord Group to an AI Lab
8:45 Can Anyone Actually Pause AI?
12:59 Would You Trust an Agent With Your Inbox?
14:58 Why Matthew Wouldn’t Trade Places With Sam or Dario
20:28 The Dead Internet Theory Was Wrong
22:28 Agents Don’t Click Ads. Who Pays?
30:38 Where Should Your Agent Actually Run?
32:32 Why American Builders Are Using Chinese Models
38:37 What Happens When Our Agents Work Together?

Matthew Watkins@SoC_trilogy

Oct 17

Murray Shanahan@mpshanahan

Oct 17

Just finished the wonderful "SolidGoldMagikarp" by @SoC_trilogy. It documents a unique period in AI history, from 2022 to 2024, when "LLM whisperers" (@repligate, @AndyAyrey, et al) were conjuring extraordinary things from the depths of latent space

mephisto

@karan4d

Oct 16

Aryaman Arora

@aryaman2020

Oct 15

Additionally, there is a large body of academic work (including mine) that has gradually and cautiously added to evidence that MLP neurons are an interpretable basis. It's been a bit of a heterodox line of work historically so it'd be good to see them get due credit. They surely support the conceptual claims of the blogpost:

- 2020: @megamor2 et al. arxiv.org/abs/2012.14913 MLPs as KV memories
- 2021: Damai Dai et al. arxiv.org/abs/2104.08696 "knowledge neurons"
- 2023: @_AmilDravid et al. arxiv.org/abs/2306.09346 "rosetta neurons"
- 2024: @YGandelsman et al. arxiv.org/abs/2406.04341 gradient effects of vision model neurons
- 2024: @damichoi95 @vvhuang_ et al. transluce.org/neuron-descrip… autointerp on LM neurons
- 2025: me @ZhengxuanZenWu @TransluceAI transluce.org/neuron-circuits arxiv.org/abs/2601.22594 neuron basis is sparse in LMs
- 2026: @yaboilyrical et al. arxiv.org/abs/2605.12290 steering refusal w/ neurons

(not comprehensive by any means!)

Aryaman Arora

@aryaman2020

Oct 15

Nick

@nickcammarata

Oct 15

interpretability might be the most important scientific problem in the world right now, as I don't think we can solve alignment if we don't know what we're building. I think I have good news about it. I co-authored early work in mechanistic interpretability at OpenAI and came away pessimistic, because neural networks appeared to fold into arbitrary tangled knots. years later, I started openai's first large-scale automated interpretability project, finding about 2% of neurons legible with the primitive tools we had

with modern agentic tools and a much closer look, the picture looks totally different. the vast majority in models up to trillions of parameters are legible, and their circuits beautiful. many famous examples of tangled neurons turned out to be misunderstood. The roadblocks I expected mostly aren't there. I now think ambitious interpretability will be solved by the time we need it most, and possibly quite soon, as automated scientists keep improving. it may be a bitter lesson for interpretability: the simple thing, at absurd scale, works

already-clean.goodfire.com

Nous Research

@NousResearch

Oct 14

sidbing 🪽

@sidbing

Oct 14

connectors for hermes agent!

- launching today w/ 50+ connectors.
- available to everyone (no account needed!)
- link your nous portal account to auto-sync all connectors and settings.
- connect and alias multiple accounts.
- limit a connector based on read/write/destructive cies for teams on nous portal.

coming soon:
- more connectors!
- bring your own MCPs and sync them.
- select tool access during authentication.

kshitij

@Kshitijjkapoor

Oct 10

Nous Research

@NousResearch

Oct 7

As reported in the @WSJ, we have raised a Series B to bring Hermes Agent to new frontiers (and, yes, build a mobile app)

Thank you to our investors including @nvidia @M12vc @SamsungNext @robotventures @usv @ycombinator @MenloVentures, among others

wsj.com/pro/venture-ca…