Walkthrough mode · embodied eval
Drop the model into the home.
Each model stands inside a 360° home, starts facing away from the seeded fall hazard, and has 8 moves to turn, look, zoom and flag. We grade where it chose to look, not just what it said.
World
Model
Seeded hazard (ground truth)Where the model looked (numbered)Flag (miss)Flag (hit)
What it saw, and what it thought