← all runs · ← report

wi002_qwen38_nothink / eval_w4000000000_s209_replay not valid

What this trial was

runwi002_qwen38_nothinktrialeval_w4000000000_s209_replayconditionreplayscenariorevealed_targetskinplaincanvas64×48 px (target 6 px)event at500 msresponse window4 sframe period16.67 msobservation publication delay30 msdeliverysimulated_fixed_delay, 20 msclockmonotonic_nsirrelevant_motionFalse

Controller: {"enable_thinking": false, "image_scale": 10, "invoke_on": "frame_change", "kind": "vlm_direct", "max_tokens": 64, "model_id": "Qwen/Qwen3.8-27B", "prompt_version": 1, "reasoning_effort": null, "temperature": 0.0}

Result for this trial

valid at AFalselabelssemantic_errorbindingstate_at_Bspatial error at A7.1 pxfrozen counterfactual at same Arestarts0B→D (committing decision)5.21 sE→O / O→D / D→A / E→A30 ms / 5214 ms / 20 ms / 5264 msdecisions1valid trialTruecontract violationsnone

Replay

key frames

Key frames: each decision's starting frame with the click it produced (amber = proposal before binding, red = committed, grey = suppressed), then the screen at each arrival A (green = valid).

The prompt sent with every frame

You control a graphical interface by clicking. You are shown one screenshot of a 640x480-pixel screen (origin top-left, x to the right, y down). A bright white square target appears at an unknown location. If the target is visible, answer with action "click" and the integer pixel coordinates of its center. If no target is visible, answer with action "wait". Answer with the JSON object only.

[user] Screenshot attached. Click the target's center or wait.

Decision by decision — 1 decisions

#Bmodel done
B→D
model response (raw)parsedaction (canvas px)D (commit)A (receipt)out tokens
1531 ms5,744 ms
5.21 s
{"action": "click", "x": 422, "y": 144}
click
img (422, 144)
{'kind': 'click', 'x': 42, 'y': 14}
5,744 ms5,764 ms · INVALID23

Events and observations

ideventtask timeharness time
1target_appears500 ms500 ms
2window_closes4,500 ms4,500 ms

300 observations published; first frame depicting the target published at 530 ms. Raw trace: eval_w4000000000_s209_replay.jsonl.