ralphReview statistics

Limits

Where review allowances may be worth increasing.

Saved stage runs only; live work and overwritten retry attempts are excluded. Reaching a cap does not prove that review quality suffered. Compare affected reports before changing allowances. Skipped stages are excluded.

2,285 historical stage runs without limit telemetry excluded.

Token and tool limits

Work limited counts observed output truncations, forced final answers or refused tool calls. The tool allowance also bounds model turns, so a forced final answer can occur below the tool call cap. Reached cap counts measured usage at or above the cap. Fractions use runs with known observations only. Output tokens and web searches show the maximum in one response, not the stage total. Web searches also consume the total tool allowance; reaching that smaller remaining allowance is counted under tool calls. Providers do not report whether the web search cap stopped additional searches, so work limited is unknown.

ProfileStageModelLimitConfigured capSaved runsWork limited / observedReached cap / measuredMaximum used
defaultadversarialgpt-6-astraDiscussion lookups81260 / 1260 / 1262
defaultadversarialgpt-6-astraHistory lookups81260 / 1260 / 1260
defaultadversarialgpt-6-astraOutput tokens per response25,0001260 / 1260 / 1263,606
defaultadversarialgpt-6-astraTool calls / turns7212613 / 12613 / 12672
defaultadversarialgpt-6.1-solDiscussion lookups81230 / 1230 / 1236
defaultadversarialgpt-6.1-solHistory lookups81230 / 1230 / 1230
defaultadversarialgpt-6.1-solOutput tokens per response25,0001230 / 1230 / 1227,687
defaultadversarialgpt-6.1-solTool calls / turns482817 / 2817 / 2848
defaultadversarialgpt-6.1-solTool calls / turns729510 / 9510 / 9572
defaultadversarial_claudeclaude-opus-5-5Discussion lookups82230 / 2230 / 2235
defaultadversarial_claudeclaude-opus-5-5History lookups82230 / 2230 / 2234
defaultadversarial_claudeclaude-opus-5-5Output tokens per response64,0002230 / 2230 / 22335,837
defaultadversarial_claudeclaude-opus-5-5Tool calls / turns4821 / 21 / 248
defaultadversarial_claudeclaude-opus-5-5Tool calls / turns7222119 / 22119 / 22172
defaultadversarial_geminigoogle/gemini-4-argonDiscussion lookups8260 / 261 / 268
defaultadversarial_geminigoogle/gemini-4-argonHistory lookups8260 / 260 / 265
defaultadversarial_geminigoogle/gemini-4-argonOutput tokens per response32,000260 / 260 / 269,360
defaultadversarial_geminigoogle/gemini-4-argonTool calls / turns482618 / 2618 / 2648
defaultalternativesgpt-6-lunaOutput tokens per response4,0003300 / 3300 / 330771
defaultalternativesgpt-6-lunaTool calls / turns123301 / 3301 / 33012
defaultarchaeologistgpt-6-lunaDiscussion lookups834852 / 34893 / 3488
defaultarchaeologistgpt-6-lunaHistory lookups83480 / 3480 / 3481
defaultarchaeologistgpt-6-lunaOutput tokens per response4,0003480 / 3480 / 3421,773
defaultarchaeologistgpt-6-lunaTool calls / turns12348193 / 348201 / 34813
defaultarchaeologistgpt-6-lunaWeb searches per response2348Unknown30 / 3483
defaultbuildgpt-6-lunaOutput tokens per response4,0001420 / 1420 / 140842
defaultbuildgpt-6-lunaTool calls / turns24340 / 340 / 3415
defaultbuildgpt-6-lunaTool calls / turns481080 / 1080 / 10826
defaultchallengergpt-6.1-solDiscussion lookups8430 / 430 / 435
defaultchallengergpt-6.1-solHistory lookups8430 / 430 / 432
defaultchallengergpt-6.1-solOutput tokens per response25,000430 / 430 / 422,334
defaultchallengergpt-6.1-solTool calls / turns1244 / 44 / 412
defaultchallengergpt-6.1-solTool calls / turns2465 / 65 / 624
defaultchallengergpt-6.1-solTool calls / turns483310 / 3310 / 3348
defaultcollatorgpt-6-lunaOutput tokens per response6,0002240 / 2240 / 2245,063
defaultconcurrencygpt-6-lunaOutput tokens per response8,0002100 / 2100 / 2077,327
defaultconcurrencygpt-6-lunaTool calls / turns1240 / 40 / 48
defaultconcurrencygpt-6-lunaTool calls / turns24210 / 210 / 2110
defaultconcurrencygpt-6-lunaTool calls / turns481852 / 1852 / 18548
defaultdead_codegpt-6-lunaHistory lookups83400 / 3400 / 3400
defaultdead_codegpt-6-lunaOutput tokens per response8,0003400 / 3400 / 3384,176
defaultdead_codegpt-6-lunaTool calls / turns483405 / 3405 / 34048
defaultdesigngpt-6-lunaOutput tokens per response25,0003091 / 3091 / 30625,000
defaultdesigngpt-6-lunaTool calls / turns121814 / 1814 / 1812
defaultdesigngpt-6-lunaTool calls / turns244631 / 4631 / 4624
defaultdesigngpt-6-lunaTool calls / turns4824541 / 24541 / 24548
defaultfeedbackgpt-6-lunaOutput tokens per response4,0002450 / 2450 / 2442,514
defaultindependentgpt-6-lunaDiscussion lookups83480 / 3480 / 3481
defaultindependentgpt-6-lunaHistory lookups83480 / 3480 / 3480
defaultindependentgpt-6-lunaOutput tokens per response4,0003480 / 3480 / 346998
defaultindependentgpt-6-lunaTool calls / turns12451 / 451 / 4512
defaultindependentgpt-6-lunaTool calls / turns24560 / 560 / 5613
defaultindependentgpt-6-lunaTool calls / turns482470 / 2470 / 24745
defaultmajor_verifiergpt-6.1-solHistory lookups8340 / 340 / 343
defaultmajor_verifiergpt-6.1-solOutput tokens per response25,000340 / 340 / 343,809
defaultmajor_verifiergpt-6.1-solTool calls / turns4880 / 80 / 825
defaultmajor_verifiergpt-6.1-solTool calls / turns72260 / 260 / 2634
defaultpublic_contractgpt-6.1-solOutput tokens per response25,0002580 / 2580 / 2561,726
defaultpublic_contractgpt-6.1-solTool calls / turns24340 / 340 / 3419
defaultpublic_contractgpt-6.1-solTool calls / turns482240 / 2240 / 22432
defaultpublic_contractgpt-6.1-terraOutput tokens per response25,00010 / 10 / 1167
defaultpublic_contractgpt-6.1-terraTool calls / turns4810 / 10 / 112
defaultroutergpt-6-lunaOutput tokens per response4,000910 / 910 / 90693
defaultroutergpt-6-lunaTool calls / turns0100 / 1010 / 100
defaultroutergpt-6.1-solOutput tokens per response8,0002330 / 2330 / 2331,718
defaultroutergpt-6.1-solTool calls / turns823332 / 23332 / 2338
defaultscriptgpt-6.1-solHistory lookups8240 / 240 / 240
defaultscriptgpt-6.1-solOutput tokens per response25,000240 / 240 / 243,876
defaultscriptgpt-6.1-solTool calls / turns48245 / 245 / 2448
defaultstategpt-6-lunaOutput tokens per response4,0002100 / 2100 / 208657
defaultstategpt-6-lunaTool calls / turns1210 / 10 / 111
defaultstategpt-6-lunaTool calls / turns24150 / 150 / 1512
defaultstategpt-6-lunaTool calls / turns481940 / 1940 / 19431
defaulttestsgpt-6-lunaOutput tokens per response4,0003390 / 3390 / 337818
defaulttestsgpt-6-lunaTool calls / turns12360 / 360 / 3611
defaulttestsgpt-6-lunaTool calls / turns24550 / 550 / 5516
defaulttestsgpt-6-lunaTool calls / turns482480 / 2480 / 24822
defaultverifierclaude-opus-5-5Discussion lookups82582 / 2583 / 2588
defaultverifierclaude-opus-5-5History lookups82580 / 2580 / 2587
defaultverifierclaude-opus-5-5Output tokens per response64,0002580 / 2580 / 25743,924
defaultverifierclaude-opus-5-5Tool calls / turns722583 / 2583 / 25872
defaultverifierclaude-opus-5-5Web searches per response2258Unknown10 / 2586
defaultverifiergpt-6-lunaDiscussion lookups8905 / 907 / 908
defaultverifiergpt-6-lunaHistory lookups8900 / 900 / 900
defaultverifiergpt-6-lunaOutput tokens per response128,000900 / 900 / 8443,408
defaultverifiergpt-6-lunaTool calls / turns483717 / 3717 / 3748
defaultverifiergpt-6-lunaTool calls / turns72538 / 539 / 5374
defaultverifiergpt-6-lunaWeb searches per response290Unknown10 / 9012
defaultwrite_verifiergpt-6.1-solHistory lookups8230 / 230 / 230
defaultwrite_verifiergpt-6.1-solOutput tokens per response12,000230 / 230 / 232,462
defaultwrite_verifiergpt-6.1-solTool calls / turns48231 / 231 / 2348

Recent affected stage runs

Newest job IDs first. Reports show the recorded limits for each stage.

ReviewProfileStageObservationReport
#36704 / job 1788defaultchallengerTool calls / turns: work limitedreport
#36437 / job 1787defaultarchaeologistTool calls / turns: work limited, Discussion lookups: reached capreport
#36703 / job 1786defaultchallengerTool calls / turns: work limitedreport
#36594 / job 1784defaultarchaeologistTool calls / turns: reached cap, Web searches per response: reached capreport
#36702 / job 1783defaultrouterTool calls / turns: work limitedreport
#36702 / job 1783defaultarchaeologistTool calls / turns: work limitedreport
#36167 / job 1782defaultrouterTool calls / turns: work limitedreport
#36167 / job 1782defaultarchaeologistTool calls / turns: work limited, Discussion lookups: work limitedreport
#36167 / job 1782defaultadversarial_claudeTool calls / turns: work limitedreport
#36701 / job 1781defaultarchaeologistTool calls / turns: work limitedreport
#36641 / job 1780defaultarchaeologistTool calls / turns: work limitedreport
#36618 / job 1778defaultarchaeologistTool calls / turns: work limitedreport
#36618 / job 1778defaultdesignTool calls / turns: work limitedreport
#36618 / job 1778defaultchallengerTool calls / turns: work limitedreport
#29491 / job 1774defaultscriptTool calls / turns: work limitedreport
#29491 / job 1774defaultarchaeologistTool calls / turns: work limited, Discussion lookups: reached capreport
#36699 / job 1773defaultarchaeologistTool calls / turns: work limitedreport
#36699 / job 1773defaultdesignTool calls / turns: work limitedreport
#36699 / job 1773defaultchallengerTool calls / turns: work limitedreport
#35728 / job 1772defaultrouterTool calls / turns: work limitedreport