← Timeline

SWE-bench Multimodal v2 · GPT-6 Luna xhigh · no images

Ten traces without images

The full traces of the ten tasks from my SWE-bench Multimodal post, from the run where GPT-6 Luna got no images. Luna resolved each of these tasks with native images, with OCR text and with no images.

“Resolved” is the benchmark’s own grading. The hidden tests run on the final diff after the agent stops, so a task can be resolved even when the agent couldn’t run the tests itself (next-2984 had no Node.js). Thinking rows are the reasoning summaries the harness recorded, not the model’s full reasoning.

Loading traces…