we’ve retired the hammer with mirrors 🪞
every team shipping AI agents right now is playing whack-a-mole:
fix the system prompt for one customer → breaks for another → patch it → breaks for a third → repeat forever
we built @mirrorsdotdev so you can put down the damn hammer 🔨
0
0
5
318
mirrors.dev exists precisely for this
ngl evals are getting less useful with every model release
the better models get at noticing they’re being tested, the less a passing eval tells you about prod
the only environment a model can’t tell apart from prod is prod. reliability work is shifting from “test before you ship” to “fix it while it runs”
0
0
3
150
mirrors🪞 retweeted
ngl evals are getting less useful with every model release
the better models get at noticing they’re being tested, the less a passing eval tells you about prod
the only environment a model can’t tell apart from prod is prod. reliability work is shifting from “test before you ship” to “fix it while it runs”
the better models get at noticing they’re being tested, the less a passing eval tells you about prod
the only environment a model can’t tell apart from prod is prod. reliability work is shifting from “test before you ship” to “fix it while it runs”
"We'll build realistic evals to determine how the model will handle situations in the real world"
The model during evals:
7
1
13
1,181
mirrors🪞 retweeted
cheffing up something new @runmirrors at the yc office
thinking of calling it dynamic context editing
thinking of calling it dynamic context editing
9
1
24
671
🪞🪞🪞
i just spent the summer sleeping in the tenderloin. now sleeping in dogpatch.
thank you @ycombinator and @amiklas for the upgrade.
proof attached ↓
1
1
6
1,166
mirrors🪞 retweeted
Off Season II at @fdotinc last Friday: ~100 teams, six weeks of building.
Our founder @SidraMiconi spent Friday night filming what people built during six weeks at @fdotinc.
10 demos from a room of ~100 teams.
The full cuts are coming!
@ai_singhal → @runmirrors
@pedro_nagamine @autobrik + @alvax64 → @robonet_
@HeapSmasher → @reachpad
@hasnainbaig06 + @Jahenderson05 → @mirdainsystems
@001TMF + @MukherjeeArvaan → Proteus-Bio
Our founder @SidraMiconi spent Friday night filming what people built during six weeks at @fdotinc.
10 demos from a room of ~100 teams.
The full cuts are coming!
@ai_singhal → @runmirrors
@pedro_nagamine @autobrik + @alvax64 → @robonet_
@HeapSmasher → @reachpad
@hasnainbaig06 + @Jahenderson05 → @mirdainsystems
@001TMF + @MukherjeeArvaan → Proteus-Bio
3
2
6
877