The Jev Doom demo by @CompleteSkeptic is really cool, so while I’m waiting for access I tried the same thing with Gemma 4 E2B from @googlegemma.

Mine takes 640×480 frames directly, with no intermediate text description of the scene. It shares the image prefill across batched ads the controls directly from logits.

It sort of works.