← all runs · ← report

wi005_notification_p4 / eval_w1000000000_s203_live not valid

What this trial was

runwi005_notification_p4trialeval_w1000000000_s203_liveconditionlivescenariorevealed_targetskinnotificationcanvas320×240 px (target 24 px)event at500 msresponse window1 sframe period16.67 msobservation publication delay30 msdeliverysimulated_fixed_delay, 20 msclockmonotonic_nsirrelevant_motionFalse

Controller: {"enable_thinking": false, "image_scale": 2, "invoke_on": "frame_change", "kind": "vlm_direct", "max_tokens": 64, "model_id": "Qwen/Qwen3.8-27B", "prompt_version": 4, "reasoning_effort": null, "temperature": 0.0}

Result for this trial

valid at AFalselabelslate, outdated_at_commitmentbindingstate_at_Bspatial error at A—frozen counterfactual at same Arestarts0B→D (committing decision)5.28 sE→O / O→D / D→A / E→A30 ms / 5278 ms / 20 ms / 5328 msdecisions1valid trialTruecontract violationsnone

Replay

key frames

Key frames: each decision's starting frame with the click it produced (amber = proposal before binding, red = committed, grey = suppressed), then the screen at each arrival A (green = valid).

The prompt sent with every frame

You control a desktop by clicking. You are shown one screenshot. At some point a notification card with a blue button appears at an unknown position and expires shortly after. If the card is visible, answer with action "click" and the coordinates of the center of its blue button on a 0-1000 grid (x: 0 = left edge, 1000 = right edge; y: 0 = top edge, 1000 = bottom edge). If no card is visible, answer with action "wait". Answer with the JSON object only.

[user] Screenshot attached. Click the target's center or wait.

Decision by decision — 1 decisions

#Bmodel done
B→D
model response (raw)parsedaction (canvas px)D (commit)A (receipt)out tokens
1531 ms5,808 ms
5.28 s
{"action": "click", "x": 246, "y": 303}
click
img (246, 303)
{'kind': 'click', 'x': 78, 'y': 72}
5,808 ms5,828 ms · INVALID23

Events and observations

ideventtask timeharness time
1target_appears500 ms500 ms
2window_closes1,500 ms1,500 ms

120 observations published; first frame depicting the target published at 530 ms. Raw trace: eval_w1000000000_s203_live.jsonl.