One row per trial; click a trial for its frames, prompt, model responses and four-clock record. Results file: see data/.
| trial | condition | policy / memory / binding | cell | outcome | labels | B→D (s) |
|---|---|---|---|---|---|---|
| cal_s100_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=100 | valid | 5.21 | |
| cal_s101_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=101 | valid | 5.21 | |
| cal_s102_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=102 | valid | 5.19 | |
| cal_s103_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=103 | valid | 5.23 | |
| cal_s104_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=104 | not valid | semantic_error | 5.24 |
| cal_s105_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=105 | valid | 5.23 | |
| cal_s106_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=106 | valid | 5.24 | |
| cal_s107_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=107 | not valid | ||
| cal_s108_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=108 | valid | 5.23 | |
| cal_s109_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=109 | valid | 5.23 | |
| eval_w1000000000_s200_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=200 | not valid | semantic_error, late | 5.24 |
| eval_w1000000000_s200_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=200 | not valid | semantic_error | 5.20 |
| eval_w1000000000_s200_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=200 | not valid | semantic_error | 5.20 |
| eval_w1000000000_s201_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=201 | not valid | semantic_error, late | 5.25 |
| eval_w1000000000_s201_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w1000000000_s201_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w1000000000_s202_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=202 | not valid | late, outdated_at_commitment | 5.25 |
| eval_w1000000000_s202_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w1000000000_s202_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w1000000000_s203_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=203 | not valid | semantic_error, late | 5.25 |
| eval_w1000000000_s203_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w1000000000_s203_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w1000000000_s204_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=204 | not valid | late, outdated_at_commitment | 5.25 |
| eval_w1000000000_s204_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w1000000000_s204_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w1000000000_s205_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=205 | not valid | late, outdated_at_commitment | 5.25 |
| eval_w1000000000_s205_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w1000000000_s205_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w1000000000_s206_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=206 | not valid | semantic_error, late | 5.03 |
| eval_w1000000000_s206_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w1000000000_s206_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w1000000000_s207_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=207 | not valid | late, outdated_at_commitment | 5.24 |
| eval_w1000000000_s207_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w1000000000_s207_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w1000000000_s208_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=208 | not valid | late, outdated_at_commitment | 5.24 |
| eval_w1000000000_s208_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w1000000000_s208_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w1000000000_s209_live | live | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=209 | not valid | semantic_error, late | 5.25 |
| eval_w1000000000_s209_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w1000000000_s209_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=1000000000 scenario_seed=209 | not valid | semantic_error | 5.22 |
| eval_w16000000000_s200_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s200_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=200 | not valid | semantic_error | 5.22 |
| eval_w16000000000_s200_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s201_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s201_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s201_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=201 | not valid | semantic_error | 5.22 |
| eval_w16000000000_s202_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w16000000000_s202_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w16000000000_s202_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w16000000000_s203_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s203_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s203_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s204_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w16000000000_s204_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w16000000000_s204_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w16000000000_s205_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w16000000000_s205_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=205 | valid | 5.22 | |
| eval_w16000000000_s205_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w16000000000_s206_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w16000000000_s206_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=206 | not valid | semantic_error | 5.00 |
| eval_w16000000000_s206_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=206 | not valid | semantic_error | 5.00 |
| eval_w16000000000_s207_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w16000000000_s207_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w16000000000_s207_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=207 | valid | 5.22 | |
| eval_w16000000000_s208_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=208 | valid | 5.22 | |
| eval_w16000000000_s208_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w16000000000_s208_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w16000000000_s209_live | live | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s209_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w16000000000_s209_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=16000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s200_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=200 | not valid | semantic_error, late | 5.21 |
| eval_w2000000000_s200_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s200_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s201_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=201 | not valid | semantic_error, late | 5.21 |
| eval_w2000000000_s201_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s201_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s202_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=202 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w2000000000_s202_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w2000000000_s202_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w2000000000_s203_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=203 | not valid | semantic_error, late | 5.21 |
| eval_w2000000000_s203_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s203_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s204_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=204 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w2000000000_s204_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w2000000000_s204_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w2000000000_s205_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=205 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w2000000000_s205_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=205 | valid | 5.22 | |
| eval_w2000000000_s205_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w2000000000_s206_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=206 | not valid | semantic_error, late | 4.99 |
| eval_w2000000000_s206_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w2000000000_s206_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w2000000000_s207_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=207 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w2000000000_s207_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w2000000000_s207_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w2000000000_s208_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=208 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w2000000000_s208_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w2000000000_s208_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w2000000000_s209_live | live | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=209 | not valid | semantic_error, late | 5.21 |
| eval_w2000000000_s209_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w2000000000_s209_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=2000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s200_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=200 | not valid | semantic_error, late | 5.21 |
| eval_w4000000000_s200_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s200_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s201_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=201 | not valid | semantic_error, late | 5.21 |
| eval_w4000000000_s201_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s201_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s202_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=202 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w4000000000_s202_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w4000000000_s202_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w4000000000_s203_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=203 | not valid | semantic_error, late | 5.21 |
| eval_w4000000000_s203_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s203_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s204_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=204 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w4000000000_s204_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w4000000000_s204_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w4000000000_s205_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=205 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w4000000000_s205_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w4000000000_s205_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w4000000000_s206_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=206 | not valid | semantic_error, late | 4.99 |
| eval_w4000000000_s206_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w4000000000_s206_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=206 | not valid | semantic_error | 5.00 |
| eval_w4000000000_s207_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=207 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w4000000000_s207_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w4000000000_s207_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w4000000000_s208_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=208 | not valid | late, outdated_at_commitment | 5.21 |
| eval_w4000000000_s208_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w4000000000_s208_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w4000000000_s209_live | live | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=209 | not valid | semantic_error, late | 5.21 |
| eval_w4000000000_s209_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w4000000000_s209_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=4000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s200_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s200_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=200 | not valid | semantic_error | 5.22 |
| eval_w8000000000_s200_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=200 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s201_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s201_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s201_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=201 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s202_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w8000000000_s202_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=202 | valid | 5.22 | |
| eval_w8000000000_s202_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=202 | valid | 5.21 | |
| eval_w8000000000_s203_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s203_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s203_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=203 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s204_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w8000000000_s204_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w8000000000_s204_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=204 | valid | 5.21 | |
| eval_w8000000000_s205_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=205 | valid | 5.22 | |
| eval_w8000000000_s205_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w8000000000_s205_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=205 | valid | 5.21 | |
| eval_w8000000000_s206_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w8000000000_s206_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w8000000000_s206_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=206 | not valid | semantic_error | 4.99 |
| eval_w8000000000_s207_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w8000000000_s207_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=207 | valid | 5.21 | |
| eval_w8000000000_s207_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=207 | valid | 5.22 | |
| eval_w8000000000_s208_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w8000000000_s208_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w8000000000_s208_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=208 | valid | 5.21 | |
| eval_w8000000000_s209_live | live | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s209_paused | paused | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |
| eval_w8000000000_s209_replay | replay | vlm_direct | irrelevant_motion=False response_window_ns=8000000000 scenario_seed=209 | not valid | semantic_error | 5.21 |