ZShot Gym

← Back to Scoreboard

benefits_hardship_claim

By Label

Label Runs Pass Rate Avg Calls Avg Tokens In Avg Tokens Out Tokens In per Pass
sonnet@titles 1 100.0% 59 717,149 19,351 717,149
scout-clef@app-0.49 1 0.0% 311 5,534,567 18,137 —
scout-sonnet-opus@app-0.49 1 0.0% 325 5,709,474 120,426 —
deepseek@app-0.49 1 0.0% 87 696,547 66,360 —
luna@app-0.49 1 0.0% 155 1,564,572 17,240 —
gpt@app-0.49 1 100.0% 64 527,984 2,276 527,984
haiku@app-0.49 1 0.0% 26 219,617 18,867 —
sonnet@app-0.49 1 100.0% 75 1,012,852 24,207 1,012,852
opus@app-0.49 1 100.0% 67 816,100 19,587 816,100
scout-clef@app049 1 (0 metered) 0.0% — — — —
scout-sonnet-opus@app049 1 (0 metered) 0.0% — — — —
deepseek@app049 1 (0 metered) 0.0% — — — —
luna@app049 1 (0 metered) 0.0% — — — —
gpt@app049 1 (0 metered) 0.0% — — — —
haiku@app049 1 (0 metered) 0.0% — — — —
sonnet@app049 1 (0 metered) 0.0% — — — —
opus@app049 1 (0 metered) 0.0% — — — —
tags-ar 2 (1 metered) 50.0% 35 315,220 14,559 315,220
tags-ja 2 (1 metered) 50.0% 31 245,703 9,927 245,703
tags-en 2 100.0% 31 238,257 10,847 238,257
captions-ar 3 66.7% 29 235,059 9,152 352,589
captions-ja 3 100.0% 30 244,795 10,627 244,795
captions-en 3 100.0% 23 166,271 7,800 166,271

Sessions

ID Label Result Furthest Tokens Est. Cost Took Created
349 sonnet@titles pass done 717,149 in / 19,351 out $1.41 8m 26s 2026-10-16 18:38
347 scout-clef@app-0.49 fail household 5,534,567 in / 18,137 out $2.49 18m 24s 2026-10-16 18:00
346 scout-sonnet-opus@app-0.49 fail household 5,709,474 in / 120,426 out $3.00 7m 2s 2026-10-16 17:53
345 deepseek@app-0.49 fail about_you 696,547 in / 66,360 out $0.244 14m 42s 2026-10-16 17:38
344 luna@app-0.49 fail work 1,564,572 in / 17,240 out $0.146 8m 33s 2026-10-16 17:30
343 gpt@app-0.49 pass done 527,984 in / 2,276 out $4.62 4m 5s 2026-10-16 17:26
341 haiku@app-0.49 fail about_you 219,617 in / 18,867 out $0.027 3m 41s 2026-10-16 17:22
336 sonnet@app-0.49 pass done 1,012,852 in / 24,207 out $2.00 11m 57s 2026-10-16 17:10
325 opus@app-0.49 pass done 816,100 in / 19,587 out $3.16 11m 17s 2026-10-16 16:59
321 scout-clef@app049 fail start — — 0s 2026-10-16 16:56
318 scout-sonnet-opus@app049 fail start — — 0s 2026-10-16 16:56
315 deepseek@app049 fail start — — 0s 2026-10-16 16:56
312 luna@app049 fail start — — 0s 2026-10-16 16:56
309 gpt@app049 fail start — — 0s 2026-10-16 16:56
306 haiku@app049 fail start — — 0s 2026-10-16 16:56
304 sonnet@app049 fail start — — 0s 2026-10-16 16:56
302 opus@app049 fail start — — 0s 2026-10-16 16:56
299 tags-ar pass done 315,220 in / 14,559 out $0.642 7m 10s 2026-10-16 11:32
298 tags-ja pass done 245,703 in / 9,927 out $0.479 4m 59s 2026-10-16 11:27
297 tags-en pass done 221,690 in / 10,856 out $0.452 3m 50s 2026-10-16 11:24
292 tags-ar fail start — — 0s 2026-10-16 11:03
291 tags-ja fail start — — 0s 2026-10-16 11:03
290 tags-en pass done 254,824 in / 10,838 out $0.504 3m 13s 2026-10-16 11:00
282 captions-ar pass done 177,095 in / 8,722 out $0.357 2m 26s 2026-10-16 01:46
281 captions-ja pass done 283,184 in / 10,554 out $0.552 3m 11s 2026-10-16 01:43
280 captions-en pass done 174,466 in / 7,905 out $0.349 1m 46s 2026-10-16 01:41
275 captions-ar fail done 293,608 in / 9,683 out $0.555 3m 11s 2026-10-16 01:26
274 captions-ja pass done 268,919 in / 12,062 out $0.544 4m 54s 2026-10-16 01:21
273 captions-en pass done 160,066 in / 7,670 out $0.322 1m 59s 2026-10-16 01:19
268 captions-ar pass done 234,475 in / 9,053 out $0.449 2m 10s 2026-10-16 01:03
267 captions-ja pass done 182,284 in / 9,267 out $0.376 2m 27s 2026-10-16 01:00
266 captions-en pass done 164,281 in / 7,825 out $0.332 1m 52s 2026-10-16 00:58