cross-posted from: https://sh.itjust.works/post/26097055
If you can run something on a pregnancy test, running it on a GPU is not really that impressive
The doom pregnancy test was technically doom displaying on an oled screen added to the pregnancy test and it was running on a separate machine.
Recently someone even managed to make a proof of concept doom running on a neural network.
If I’m thinking of the same thing you are, I believe they were/are working on making biological neuron chips play a traditionally-running game of doom, less making doom run on a neural network.
Nope, a neural network:
https://arxiv.org/abs/2408.14837 “Diffusion Models Are Real-Time Game Engines”
We present GameNGen, the first game engine powered entirely by a neural model that enables real-time interaction with a complex environment over long trajectories at high quality. GameNGen can interactively simulate the classic game DOOM at over 20 frames per second on a single TPU. Next frame prediction achieves a PSNR of 29.4, comparable to lossy JPEG compression. Human raters are only slightly better than random chance at distinguishing short clips of the game from clips of the simulation. GameNGen is trained in two phases: (1) an RL-agent learns to play the game and the training sessions are recorded, and (2) a diffusion model is trained to produce the next frame, conditioned on the sequence of past frames and actions. Conditioning augmentations enable stable auto-regressive generation over long trajectories.
