Jeremy van Reenen retweeted
A few of you noticed a sync difference between our @Simulon reality-aware rendering demo and the original footage.
That comes down to the mode we used.
Interaction Mode favors simulated physical contact over sync accuracy. This demo uses Precision Mode, releasing this week, for eed it.
A virtual mouse adds sugar to a real glass of water. I stir it with a virtual spoon. The rendered water responds to both of us while staying closely synced to the original footage.
Just like the previous demo, no prompting was used. The interactions were generated through spatial reasoning.
We’re still scratching the surface. We’ve got some exciting stuff to share this week 👀
That comes down to the mode we used.
Interaction Mode favors simulated physical contact over sync accuracy. This demo uses Precision Mode, releasing this week, for eed it.
A virtual mouse adds sugar to a real glass of water. I stir it with a virtual spoon. The rendered water responds to both of us while staying closely synced to the original footage.
Just like the previous demo, no prompting was used. The interactions were generated through spatial reasoning.
We’re still scratching the surface. We’ve got some exciting stuff to share this week 👀
21
33
230
12,008
Jeremy van Reenen retweeted
Having fun with the new @Simulon app! This thing is AMAZING. I made an incredible VR avatar from my Afro Samurai figure- #bigkidsplayhere #7thbrothertoys #kidult #afrosamurai
2
3
9
73
Jeremy van Reenen retweeted
Reasoning breakdown of the @Simulon video
A little Halloween treat from @Simulon. 🎃
We’re giving everyone 500 free credits to bring something impossible to life.
That includes all existing creators and anyone who signs up this weekend.
We’ve also added a collection of Halloween creatures and characters ready to bring dits are valid through Sunday, November 1.
Happy Halloween!
4
6
20
550
Jeremy van Reenen retweeted
A little Halloween treat from @Simulon. 🎃
We’re giving everyone 500 free credits to bring something impossible to life.
That includes all existing creators and anyone who signs up this weekend.
We’ve also added a collection of Halloween creatures and characters ready to bring dits are valid through Sunday, November 1.
Happy Halloween!
We’re giving everyone 500 free credits to bring something impossible to life.
That includes all existing creators and anyone who signs up this weekend.
We’ve also added a collection of Halloween creatures and characters ready to bring dits are valid through Sunday, November 1.
Happy Halloween!
18
20
145
8,403
Jeremy van Reenen retweeted
I've been following Simulon since day one and have used it through every update. When I saw their Reality-Aware Rendering demo, I honestly thought it was probably exaggerated and couldn't be that good in real use.
This is my very first and only take. You place the asset with scene, and it reacts to you and the space around it.
It works incredibly well. @Simulon
This is my very first and only take. You place the asset with scene, and it reacts to you and the space around it.
It works incredibly well. @Simulon
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
15
23
288
22,380
Jeremy van Reenen retweeted
Nah, this is actually insane.
The fact that I can record a scene with my phone and have AI turn it into something completely different, while still responding to my actions and surroundings?
I've already started imagining the things I could create with this. 😂
Y'all will get tired of me.
@Simulon, please hurry up with the Android version. I'm getting this the moment it drops. 👀
The fact that I can record a scene with my phone and have AI turn it into something completely different, while still responding to my actions and surroundings?
I've already started imagining the things I could create with this. 😂
Y'all will get tired of me.
@Simulon, please hurry up with the Android version. I'm getting this the moment it drops. 👀
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
16
2
46
567
Jeremy van Reenen retweeted
A Chinese maker designed and built this cute crab robot — and open-sourced it!
He even gave away 100 crabs for free to encourage fun remixes and more creative uses!
@ChinaRetold
He even gave away 100 crabs for free to encourage fun remixes and more creative uses!
@ChinaRetold
6
37
197
5,262
Jeremy van Reenen retweeted
More cape physics! Just love how his cape drags across the tv unit here.
2
9
46
1,673
Jeremy van Reenen retweeted
In @Simulon, you can turn any image into a 3D neural asset and bring it into the real world.
Dracula started as a single image. A minute later, he’s riding a real RC car across my dining table, with his cape swinging through the turns. When the car goes over the edge, he jumps n the table.
All of this happens procedurally, with no prompting. He responds to the space and what’s happening around him. The inset shows the original footage.
What would you bring into the world? Drop an image in the replies and tell me what you’d like to see it do. I’ll pick a few and bring your ideas to life.
Dracula started as a single image. A minute later, he’s riding a real RC car across my dining table, with his cape swinging through the turns. When the car goes over the edge, he jumps n the table.
All of this happens procedurally, with no prompting. He responds to the space and what’s happening around him. The inset shows the original footage.
What would you bring into the world? Drop an image in the replies and tell me what you’d like to see it do. I’ll pick a few and bring your ideas to life.
38
73
669
28,478
Jeremy van Reenen retweeted
Playing around with Simulon today, video coming up later.
As a preview: Mech Vs Cat.
I know who I have my money on...
As a preview: Mech Vs Cat.
I know who I have my money on...
13
10
105
5,479
Jeremy van Reenen retweeted
So cool! 😍
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
0
5
59
8,794
Jeremy van Reenen retweeted
One year ago, I would have never imagined that we could reach this level of Mixed Reality with complex interactions. This is an incredible achievement at @Simulon but you would be surprised by how easy it is to use! Give it a try! (Android version is launching soon!)
Here’s how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how he’d respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance es and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
1
7
16
1,141
Jeremy van Reenen retweeted
Reality-Aware Rendering is a new mode in the Simulon app that turns a phone recording into a rendered scene. The demo runs about a minute and eighteen seconds.
Per the creator, you place neural assets with your phone and act out the scene. When you stop recording, it reads what you do, what you say and the place around you, and the assets respond to all of it. The final is regenerated from the recording as a new performance, not a copy of the footage.
Why it matters: it points to a way of making visual effects that starts from a phone and a real room instead of a studio pipeline. It is available now on iPhone, with Android coming.
Credit: @diveshnaidoo x.com/diveshnaidoo/s…
Per the creator, you place neural assets with your phone and act out the scene. When you stop recording, it reads what you do, what you say and the place around you, and the assets respond to all of it. The final is regenerated from the recording as a new performance, not a copy of the footage.
Why it matters: it points to a way of making visual effects that starts from a phone and a real room instead of a studio pipeline. It is available now on iPhone, with Android coming.
Credit: @diveshnaidoo x.com/diveshnaidoo/s…
1
3
8
628
Jeremy van Reenen retweeted
Check out this Reality-Aware rendering feature from the new @Simulon 2.0. This is a game changer.
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
0
4
11
956
Jeremy van Reenen retweeted
How it works x.com/diveshnaidoo/s…
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
9
26
146
17,947
Jeremy van Reenen retweeted
Simulon is insanely good.
Anyone remotely interested in 3D, CG, and cinema should toy with it for fun.
You can do this in 3 minutes, app download included. Try it.
Anyone remotely interested in 3D, CG, and cinema should toy with it for fun.
You can do this in 3 minutes, app download included. Try it.
Here’s how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how he’d respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance es and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
3
9
82
6,142
Let the force be with you @Simulon
You can try this right now for free. We are live on the AppStore - apps.apple.com/us/app/simulon…
0
1
7
183
Jeremy van Reenen retweeted
确实有趣😁
供桌上的蟾蜍也是我的小宠物
这种互动方式让人印象深刻
效果真的不可思议˶╹ꇴ╹˶！
供桌上的蟾蜍也是我的小宠物
这种互动方式让人印象深刻
效果真的不可思议˶╹ꇴ╹˶！
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
0
3
8
482