Pinned Tweet
Things that aren’t there can now see and hear you.
Reality-Aware Rendering is now live in Simulon. Place anything in the real world, act out the scene, and it responds to you.
We made this short in an afternoon. Watch to the end to see what was really there.
Available now on iPhone. How it works 👇
Reality-Aware Rendering is now live in Simulon. Place anything in the real world, act out the scene, and it responds to you.
We made this short in an afternoon. Watch to the end to see what was really there.
Available now on iPhone. How it works 👇
56
143
1,176
126,220
Simulon retweeted
A few of you noticed a sync difference between our @Simulon reality-aware rendering demo and the original footage.
That comes down to the mode we used.
Interaction Mode favors simulated physical contact over sync accuracy. This demo uses Precision Mode, releasing this week, for eed it.
A virtual mouse adds sugar to a real glass of water. I stir it with a virtual spoon. The rendered water responds to both of us while staying closely synced to the original footage.
Just like the previous demo, no prompting was used. The interactions were generated through spatial reasoning.
We’re still scratching the surface. We’ve got some exciting stuff to share this week 👀
That comes down to the mode we used.
Interaction Mode favors simulated physical contact over sync accuracy. This demo uses Precision Mode, releasing this week, for eed it.
A virtual mouse adds sugar to a real glass of water. I stir it with a virtual spoon. The rendered water responds to both of us while staying closely synced to the original footage.
Just like the previous demo, no prompting was used. The interactions were generated through spatial reasoning.
We’re still scratching the surface. We’ve got some exciting stuff to share this week 👀
21
33
223
10,988
Simulon retweeted
A little Halloween treat from @Simulon. 🎃
We’re giving everyone 500 free credits to bring something impossible to life.
That includes all existing creators and anyone who signs up this weekend.
We’ve also added a collection of Halloween creatures and characters ready to bring dits are valid through Sunday, November 1.
Happy Halloween!
We’re giving everyone 500 free credits to bring something impossible to life.
That includes all existing creators and anyone who signs up this weekend.
We’ve also added a collection of Halloween creatures and characters ready to bring dits are valid through Sunday, November 1.
Happy Halloween!
18
20
145
8,315
Simulon retweeted
Ok @Simulon… that’s just crazy. The shadows!!! It understands that there are multiple light sources, casting multiple shadows, and it matches the other shadows in the room.
3
8
80
4,113
Simulon retweeted
In @Simulon, you can turn any image into a 3D neural asset and bring it into the real world.
Dracula started as a single image. A minute later, he’s riding a real RC car across my dining table, with his cape swinging through the turns. When the car goes over the edge, he jumps n the table.
All of this happens procedurally, with no prompting. He responds to the space and what’s happening around him. The inset shows the original footage.
What would you bring into the world? Drop an image in the replies and tell me what you’d like to see it do. I’ll pick a few and bring your ideas to life.
Dracula started as a single image. A minute later, he’s riding a real RC car across my dining table, with his cape swinging through the turns. When the car goes over the edge, he jumps n the table.
All of this happens procedurally, with no prompting. He responds to the space and what’s happening around him. The inset shows the original footage.
What would you bring into the world? Drop an image in the replies and tell me what you’d like to see it do. I’ll pick a few and bring your ideas to life.
38
73
669
28,343
Simulon retweeted
Playing around with Simulon today, video coming up later.
As a preview: Mech Vs Cat.
I know who I have my money on...
As a preview: Mech Vs Cat.
I know who I have my money on...
13
10
105
5,460
Simulon retweeted
Took my baby dragon out for shopping @Decathlon
He loved his time over there.
Made with the new @Simulon Reality aware rendering which is out on IOS now.
Android release very soon.
He loved his time over there.
Made with the new @Simulon Reality aware rendering which is out on IOS now.
Android release very soon.
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
2
15
95
5,723
Simulon retweeted
This morning I cloned Dune with @Simulon. Naturally and obviously, the next step was turning him into a kaiju and filming him in the city using reality-aware rendering.
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
3
9
54
3,922
Simulon retweeted
The whole short was made with zero prompting. Just real footage, 3D neural assets and reality-aware rendering.
Here are a few moments side by side. Watch the full short for the ending.
Top: Simulon Bottom: what I actually filmed
Here are a few moments side by side. Watch the full short for the ending.
Top: Simulon Bottom: what I actually filmed
Things that aren’t there can now see and hear you.
Reality-Aware Rendering is now live in Simulon. Place anything in the real world, act out the scene, and it responds to you.
We made this short in an afternoon. Watch to the end to see what was really there.
Available now on iPhone. How it works 👇
16
57
398
20,867
How it works x.com/diveshnaidoo/s…
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
9
26
147
17,897
Simulon retweeted
Working on a new garage build, made with @Simulon Reality-Aware Rendering. Just blows my mind that this is based on my real video recording and performance.
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
2
13
55
4,383
Simulon retweeted
Introducing Reality-Aware Rendering in @Simulon, a completely new way to create with the real world.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place ssets respond to all of it.
The final is regenerated from your recording: a new performance of the scene, not a copy of the footage.
Available now on iPhone. Coming to Android soon.
941
2,569
15,613
1,671,132
Simulon retweeted
Simulon is insanely good.
Anyone remotely interested in 3D, CG, and cinema should toy with it for fun.
You can do this in 3 minutes, app download included. Try it.
Anyone remotely interested in 3D, CG, and cinema should toy with it for fun.
You can do this in 3 minutes, app download included. Try it.
Here’s how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how he’d respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance es and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
3
9
82
6,135
Simulon retweeted
Here’s how @Simulon Reality-Aware Rendering works. I placed my raptor next to the water and dropped a stone in to see how he’d respond.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance es and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
His 3D placement sets his starting position and scale. When the recording starts, he becomes a ghost, leaving me to shape the performance es and spoken instructions. Simulon uses the recorded scene to generate his behaviour and integrate him into the footage afterward.
Instead of typing a prompt, spinning the slot machine and hoping for the best, you can show it, say it and perform it. Your intent, timing and spatial context are right there in the recording. It’s a much more intuitive way to create.
This breakdown is generated procedurally, summarising the actual reasoning behind the result.
12
21
171
14,261
Simulon retweeted
Meet Nigel. He’s not enjoying our cause-and-effect demo.
So I let him sit in the DeLorean. Still not happy.
I didn’t write his lines. What he says is generated from his personality and the context of the shot.
It’s an entirely new way to create: place imaginary characters in performance, and let Simulon generate their reactions and realistically integrate them into your footage.
Reality-Aware Rendering is coming to @Simulon this week.
So I let him sit in the DeLorean. Still not happy.
I didn’t write his lines. What he says is generated from his personality and the context of the shot.
It’s an entirely new way to create: place imaginary characters in performance, and let Simulon generate their reactions and realistically integrate them into your footage.
Reality-Aware Rendering is coming to @Simulon this week.
23
35
220
11,446
Simulon retweeted
This wasn’t animated by hand. And it wasn’t generated from a prompt either.
It was created from real world footage.
It’s something entirely new.
We call it Reality-Aware Rendering.
Coming to @Simulon next week.
It was created from real world footage.
It’s something entirely new.
We call it Reality-Aware Rendering.
Coming to @Simulon next week.
23
33
259
14,348
Simulon retweeted
That first morning coffee just hits different. ☕️
Made this morning on my iPhone with @Simulon, at a real café. There’s something about being there and finding the frames yourself that you can’t get from a purely generative workflow.
Featuring the famous Cape Town wind, of course.
Made this morning on my iPhone with @Simulon, at a real café. There’s something about being there and finding the frames yourself that you can’t get from a purely generative workflow.
Featuring the famous Cape Town wind, of course.
6
15
49
3,214
