ZShot Gym

← Back to Scoreboard

parcel_redelivery

By Label

Label Runs Pass Rate Avg Calls Avg Tokens In Avg Tokens Out Tokens In per Pass
sonnet@titles 1 100.0% 27 137,987 5,674 137,987
opus@titles 1 100.0% 26 128,660 3,999 128,660
scout-clef@app-0.49 1 100.0% 42 162,842 2,663 162,842
scout-sonnet-opus@app-0.49 1 0.0% 95 628,451 16,779 —
deepseek@app-0.49 1 0.0% 31 115,504 24,356 —
luna@app-0.49 1 100.0% 59 283,929 6,862 283,929
gpt@app-0.49 1 100.0% 44 168,122 1,575 168,122
haiku@app-0.49 1 100.0% 29 158,275 13,191 158,275
sonnet@app-0.49 1 100.0% 43 281,568 17,054 281,568
opus@app-0.49 1 100.0% 33 144,140 5,028 144,140
scout-clef@app049 1 (0 metered) 0.0% — — — —
scout-sonnet-opus@app049 1 (0 metered) 0.0% — — — —
deepseek@app049 1 (0 metered) 0.0% — — — —
luna@app049 1 (0 metered) 0.0% — — — —
gpt@app049 1 (0 metered) 0.0% — — — —
haiku@app049 1 (0 metered) 0.0% — — — —
sonnet@app049 1 (0 metered) 0.0% — — — —
opus@app049 1 (0 metered) 0.0% — — — —
tags-ar 2 (1 metered) 50.0% 47 212,056 12,718 212,056
tags-ko 2 (1 metered) 50.0% 38 205,863 9,539 205,863
tags-ja 2 (1 metered) 50.0% 27 131,855 6,555 131,855
tags-en 2 100.0% 30 157,775 6,876 157,775
captions-ar 3 100.0% 28 151,056 6,124 151,056
captions-ko 3 100.0% 28 155,993 6,446 155,993
captions-ja 3 100.0% 27 139,062 5,221 139,062
captions-en 3 100.0% 27 138,919 4,818 138,919
sonnet@captions2-1015 1 100.0% 8 33,228 1,096 33,228
sonnet@captions-1015 1 0.0% 7 29,669 1,464 —
scout-sonnet-opus@ts-off2-1015 2 50.0% 81 334,366 12,349 668,732
scout-sonnet-opus@ts-img2-1015 2 50.0% 67 388,934 11,561 777,868
scout-sonnet-opus@ts-off-1015 2 50.0% 86 424,899 14,300 849,799
scout-sonnet-opus@ts-img-1015 2 0.0% 49 242,418 7,537 —
opus@pointer-1015 1 100.0% 26 120,859 3,714 120,859
scout-clef@regress-1011 1 100.0% 76 335,354 3,963 335,354
scout-decisions@regress-1011 1 0.0% 133 709,826 2,027 —
scout-sonnet-opus@regress-1011 1 0.0% 56 189,056 9,129 —
scout-sonnet@regress-1011 1 0.0% 133 737,057 18,891 —
gemini@regress-1011 1 0.0% 12 30,782 8,866 —
deepseek@regress-1011 1 0.0% 38 123,990 33,166 —
luna@regress-1011 1 0.0% 29 104,710 3,589 —
gpt@regress-1011 1 100.0% 107 520,743 4,664 520,743
sonnet@regress-1011 1 100.0% 33 179,916 5,634 179,916
haiku@regress-1011 1 0.0% 52 289,764 28,773 —
opus@regress-1011 1 100.0% 32 174,059 5,059 174,059
scout-decisions@rel5-1011 3 66.7% 49 195,972 1,719 293,958
luna-openrouter@rel5-1010 2 50.0% 38 168,414 7,294 336,829
scout-decision1@rel5-1010 2 0.0% 43 183,894 4,689 —
scout-jev-1.13-openrouter@rel5-1010 2 100.0% 61 243,242 9,833 243,242
scout-microsoft-decision-1-openrouter@rel5-1010 2 50.0% 33 116,502 2,519 233,005
luna@rel5-1010 2 50.0% 41 166,788 3,917 333,576
scout-clef@rel5-1010 2 50.0% 88 539,008 13,602 1,078,016
scout-sonnet-opus@rel5-1010 2 100.0% 51 199,230 7,781 199,230
haiku@rel5-1010 2 100.0% 38 271,453 17,583 271,453
deepseek@rel5-1010 2 0.0% 31 102,227 24,965 —
gpt@rel5-1010 2 100.0% 63 281,097 2,369 281,097
opus@rel5-1010 2 100.0% 24 116,490 3,144 116,490
sonnet@rel5-1010 2 100.0% 28 152,405 4,494 152,405
luna@rel-1010 2 50.0% 39 162,690 5,100 325,381
scout-clef@rel-1010 2 50.0% 48 180,531 2,205 361,062
scout-sonnet-opus@rel-1010 2 0.0% 23 64,572 4,390 —
haiku@rel-1010 2 0.0% 8 31,295 2,094 —
deepseek@rel-1010 2 0.0% 37 112,088 39,236 —
gpt@rel-1010 2 100.0% 58 256,391 1,888 256,391
opus@rel-1010 2 100.0% 32 151,273 5,062 151,273
sonnet@rel-1010 2 0.0% 8 33,257 1,529 —
haiku@visual-memory-1010 2 50.0% 17 86,714 5,349 173,428
scout-clef@visual-memory-1010 2 50.0% 48 172,626 1,744 345,253
scout-sonnet-opus@visual-memory-1010 2 50.0% 34 123,753 5,925 247,507
deepseek@visual-memory-1010 2 50.0% 25 78,842 13,685 157,685
gpt@visual-memory-1010 2 100.0% 60 260,536 2,038 260,536
opus@visual-memory-1010 2 100.0% 38 223,810 9,470 223,810
sonnet@visual-memory-1010 2 50.0% 19 91,670 3,391 183,340
haiku@local-1009 1 100.0% 36 225,997 15,669 225,997
scout-clef@local-1009 1 100.0% 42 166,772 1,726 166,772
scout-sonnet-opus@local-1009 1 100.0% 49 208,007 7,490 208,007
deepseek@local-1009 1 0.0% 26 79,081 13,676 —
gpt@local-1009 1 100.0% 64 286,523 2,516 286,523
opus@local-1009 1 100.0% 25 130,264 3,613 130,264
sonnet@local-1009 1 100.0% 26 140,153 4,934 140,153
haiku-replay@1008 4 (0 metered) 25.0% — — — —
haiku@replay-1008 3 100.0% 27 144,465 9,933 144,465
deepseek@local-1002 3 66.7% 44 193,598 104,073 290,397
gpt@local-1002 3 100.0% 41 206,031 1,119 206,031
opus@local-1002 3 100.0% 30 181,123 4,418 181,123
sonnet@local-1002 3 100.0% 27 166,038 5,170 166,038
scout-sonnet-opus@local-1002 3 66.7% 45 171,970 6,463 257,956
scout-sonnet 9 11.1% 44 179,887 7,557 1,618,984
scout-sonnet-opus 7 71.4% 43 163,169 5,801 228,437
sonnet 7 28.6% 46 313,229 16,507 1,096,304
scout-mercury 14 (10 metered) 35.7% 43 183,373 9,845 366,746
scout-mercury-deepseek 5 0.0% 50 156,482 47,298 —
scout-deepseek 18 16.7% 34 103,148 22,961 618,888
scout-gemini 18 0.0% 28 75,676 13,248 —
scout-qwen 8 0.0% 49 188,452 4,504 —
scout-gpt 4 25.0% 39 121,387 3,711 485,548
scout-opus 4 100.0% 44 184,473 5,918 184,473
opus-thinking 4 25.0% 43 246,920 10,717 987,682
deepseek 4 0.0% 49 196,120 115,382 —
deepseek-low 4 0.0% 67 284,869 85,248 —
gemini 4 0.0% 40 171,364 97,668 —
qwen-noreasoning 4 0.0% 62 342,610 3,564 —
opus 4 50.0% 37 220,583 8,974 441,166
deepseek-noreasoning 6 0.0% 47 179,503 3,655 —
gpt 2 100.0% 44 209,114 1,752 209,114
scout-local 2 0.0% 7 6,772 637 —
local 2 0.0% 1 0 0 —
scout+writer-turns-v3-no-captcha 1 0.0% 128 279,904 35,978 —
scout+writer-turns-v2-no-captcha 1 0.0% 50 197,821 13,116 —
scout+writer-turns-no-captcha 1 0.0% 112 252,803 32,430 —
scout+writer-turns 1 0.0% 98 465,984 11,258 —
scout+writer 1 0.0% 28 56,197 3,067 —

Sessions

ID Label Result Furthest Tokens Est. Cost Took Created
86 scout-gemini fail done 91,100 in / 11,012 out $0.077 2m 19s 2026-09-28 13:20
85 scout-gpt pass done 171,995 in / 4,856 out $0.754 2m 28s 2026-09-28 13:20
84 scout-qwen fail confirm 144,694 in / 4,482 out $0.028 4m 18s 2026-09-28 13:17
83 scout-gpt fail done 205,635 in / 4,558 out $1.18 3m 20s 2026-09-28 13:17
82 scout-gemini fail done 115,151 in / 28,198 out $0.159 3m 56s 2026-09-28 13:16
81 scout-deepseek fail done 137,890 in / 44,903 out $0.095 5m 15s 2026-09-28 13:16
80 scout-qwen fail preferences 347,696 in / 6,159 out $0.026 7m 10s 2026-09-28 11:52
79 scout-deepseek fail confirm 201,365 in / 87,506 out $0.162 7m 33s 2026-09-28 11:49
78 scout-deepseek fail done 119,996 in / 18,440 out $0.058 2m 4s 2026-09-28 11:47
77 scout-qwen fail preferences 346,850 in / 6,319 out $0.023 7m 22s 2026-09-28 11:45
76 scout-sonnet fail done 248,899 in / 10,790 out $0.433 2m 55s 2026-09-28 11:44
75 scout-gemini fail done 85,981 in / 10,077 out $0.070 1m 13s 2026-09-28 11:44
74 scout-gemini fail done 81,444 in / 15,939 out $0.089 1m 36s 2026-09-28 11:42
73 scout-sonnet fail done 177,088 in / 7,698 out $0.302 2m 5s 2026-09-28 11:42
72 scout-sonnet-opus pass done 171,985 in / 5,384 out $0.476 1m 49s 2026-09-28 11:39
71 scout-sonnet-opus pass done 241,606 in / 8,203 out $0.689 2m 21s 2026-09-28 11:37
70 scout-sonnet fail done 149,784 in / 5,209 out $0.225 1m 23s 2026-09-28 11:35
69 scout-sonnet fail done 265,073 in / 10,550 out $0.485 2m 57s 2026-09-28 11:32
68 scout-opus pass done 192,639 in / 6,065 out $0.600 2m 13s 2026-09-28 11:30
67 scout-opus pass done 232,613 in / 8,199 out $0.792 2m 55s 2026-09-28 11:27
66 opus-thinking fail confirm 212,288 in / 7,537 out $1.000 4m 10s 2026-09-28 11:23
65 scout-gemini fail confirm 62,117 in / 8,157 out $0.050 59s 2026-09-28 11:21
64 opus-thinking pass done 179,970 in / 4,873 out $0.817 2m 52s 2026-09-28 11:20
63 deepseek fail done 190,480 in / 95,029 out $0.154 8m 32s 2026-09-28 11:20
62 scout-gemini fail done 166,289 in / 32,128 out $0.209 3m 36s 2026-09-28 11:18
61 deepseek fail preferences 93,764 in / 31,350 out $0.059 3m 18s 2026-09-28 11:16
60 sonnet fail preferences 467,846 in / 22,981 out $1.17 7m 2s 2026-09-28 11:13
59 scout-qwen fail confirm 110,097 in / 3,369 out $0.023 1m 46s 2026-09-28 11:11
58 deepseek-low fail done 233,042 in / 68,628 out $0.133 7m 9s 2026-09-28 11:09
57 scout-qwen fail done 207,231 in / 4,764 out $0.039 3m 18s 2026-09-28 11:07
56 gemini fail preferences 300,334 in / 143,388 out $0.763 13m 1s 2026-09-28 11:05
55 sonnet fail preferences 537,973 in / 26,686 out $1.34 10m 13s 2026-09-28 11:03
54 deepseek-low fail preferences 339,288 in / 53,147 out $0.143 6m 32s 2026-09-28 11:03
53 qwen-noreasoning fail preferences 260,715 in / 2,361 out $0.000 6m 15s 2026-09-28 11:01
52 opus pass done 202,780 in / 5,898 out $0.929 3m 27s 2026-09-28 10:59
51 scout-deepseek fail confirm 203,700 in / 38,398 out $0.112 3m 56s 2026-09-28 10:59
50 scout-deepseek fail done 120,121 in / 29,604 out $0.071 2m 56s 2026-09-28 10:56
49 deepseek-noreasoning fail done 79,364 in / 1,108 out $0.018 1m 1s 2026-09-28 10:55
48 opus fail slot 373,988 in / 23,506 out $1.97 7m 18s 2026-09-28 10:52
47 deepseek-noreasoning fail done 264,069 in / 3,700 out $0.068 2m 36s 2026-09-28 10:52
46 qwen-noreasoning fail preferences 384,036 in / 4,240 out $0.000 9m 6s 2026-09-28 10:52
45 gemini fail preferences 275,572 in / 145,978 out $0.754 12m 26s 2026-09-28 10:52
44 deepseek fail preferences 235,861 in / 179,575 out $0.263 15m 5s 2026-09-28 03:51
43 scout-sonnet-opus fail done 59,126 in / 3,177 out $0.033 31s 2026-09-28 03:40
42 scout-sonnet-opus fail done 83,382 in / 4,192 out $0.043 37s 2026-09-28 03:39
41 scout-sonnet fail done 60,473 in / 2,835 out $0.058 38s 2026-09-28 03:38
40 scout-sonnet fail done 80,560 in / 3,646 out $0.042 38s 2026-09-28 03:38
39 scout-opus pass done 148,140 in / 4,430 out $0.424 1m 33s 2026-09-28 03:36
38 deepseek fail preferences 264,375 in / 155,574 out $0.249 15m 6s 2026-09-28 03:35
37 scout-opus pass done 164,501 in / 4,978 out $0.437 1m 36s 2026-09-28 03:35