Walkthrough mode · embodied eval
Drop the model into a synthetic room.
Each model stands inside a synthetic 360° room, starts facing away from the seeded fall hazard, and has 8 moves to turn, look, zoom and flag. We grade where it chose to look, not just what it said.
World
Model
Seeded hazard (ground truth)Where the model looked (numbered)Flag (miss)Flag (hit)
What it saw, and what it thought