Code Generation - LiveCodeBench v1 AtCoder (set 1)
6 passed1 failed1 broken |
75.0% |
IN74 040
OUT108 722 |
| ! |
LcbAntiDdosCountLiveCodeBench / atcoder abc301_f / hard: Anti (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 280
OUT62 144 |
| ✓ |
LcbAtCoderCardsLiveCodeBench / atcoder abc301_c / medium: AtCoder Cards (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 212
OUT5 999 |
| ✓ |
LcbAttackCountLiveCodeBench / atcoder abc302_a / easy: Attack (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 166
OUT1 062 |
| ✓ |
LcbBitmaskLeqNLiveCodeBench / atcoder abc301_d / medium: Bitmask (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 240
OUT28 290 |
| ✓ |
LcbFillTheGapsLiveCodeBench / atcoder abc301_b / easy: Fill the Gaps (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 275
OUT2 360 |
| ✓ |
LcbFindSnukeLiveCodeBench / atcoder abc302_b / medium: Find snuke (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 316
OUT2 453 |
| ✓ |
LcbOverallWinnerLiveCodeBench / atcoder abc301_a / easy: Overall Winner (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 226
OUT1 204 |
| × |
LcbPacCandyPathLiveCodeBench / atcoder abc301_e / hard: Pac (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: PacCandyPath case2 runtime error: The script exceeded the timeout of 30000 ms.
Values:
run.Success = false |
Failed |
IN9 325
OUT5 210 |
Code Generation - LiveCodeBench v1 AtCoder (set 10)
5 passed1 broken2 skipped |
83.3% |
IN55 271
OUT82 472 |
| ✓ |
LcbBlueSpringPassesLiveCodeBench / atcoder / medium: abc318_c Blue Spring (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 215
OUT5 091 |
| – |
LcbBookPrerequisitesLiveCodeBench / atcoder / hard: abc315_e Prerequisites (Pattern B, stdin) FLAG: non-unique output (any valid reading order accepted); exact-string driver can reject a correct answer -> SkipTest.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: non-unique output: multiple valid reading orders accepted; exact-string driver would reject correct answers |
Skipped |
IN0
OUT0 |
| – |
LcbCheckpointShortcutsLiveCodeBench / atcoder / hard: abc315_f Shortcuts (Pattern B, stdin) FLAG: float output (Euclidean distance sum); exact-string driver cannot do tolerance -> SkipTest.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: SC# stdin driver: floating-point distance output needs tolerance comparison; exact string compare unsafe |
Skipped |
IN0
OUT0 |
| ✓ |
LcbFullMoonDaysLiveCodeBench / atcoder / easy: abc318_a Full Moon (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 185
OUT958 |
| ! |
LcbIceCreamFlavorsLiveCodeBench / atcoder / medium: abc315_c Flavors (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 209
OUT16 060 |
| ✓ |
LcbMagicalCookiesLiveCodeBench / atcoder / medium: abc315_d Magical Cookies (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 249
OUT40 705 |
| ✓ |
LcbMiddleDayLiveCodeBench / atcoder / easy: abc315_b The Middle Day (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 227
OUT1 559 |
| ✓ |
LcbOverlappingSheetsLiveCodeBench / atcoder / easy: abc318_b Overlapping sheets (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 186
OUT18 099 |
Code Generation - LiveCodeBench v1 AtCoder (set 11)
7 passed1 skipped |
100.0% |
IN64 449
OUT92 271 |
| ✓ |
LcbBusStopsQueriesLiveCodeBench / atcoder / hard: abc319_e Bus Stops (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 304
OUT55 314 |
| – |
LcbFalseHopeProbabilityLiveCodeBench / atcoder / medium: abc319_c False Hope (Pattern B, stdin) FLAG: float output (probability); exact-string driver cannot do tolerance -> SkipTest.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: SC# stdin driver: probability (float) output needs tolerance comparison; exact string compare unsafe |
Skipped |
IN0
OUT0 |
| ✓ |
LcbLeylandNumberLiveCodeBench / atcoder / easy: abc320_a Leyland Number (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 150
OUT1 372 |
| ✓ |
LcbLongestPalindromeSubLiveCodeBench / atcoder / easy: abc320_b Longest Palindrome (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 159
OUT3 176 |
| ✓ |
LcbMeasureDivisorsLiveCodeBench / atcoder / easy: abc319_b Measure (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 212
OUT2 662 |
| ✓ |
LcbMinimumWindowWidthLiveCodeBench / atcoder / medium: abc319_d Minimum Width (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 231
OUT12 321 |
| ✓ |
LcbSandwichTriplesLiveCodeBench / atcoder / hard: abc318_e Sandwiches (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 178
OUT7 287 |
| ✓ |
LcbWeightedMaxMatchingLiveCodeBench / atcoder / medium: abc318_d General Weighted Max Matching (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 215
OUT10 139 |
Code Generation - LiveCodeBench v1 AtCoder (set 12)
8 passed1 failed |
88.9% |
IN83 111
OUT117 442 |
| ✓ |
Lcb321LikeLiveCodeBench / atcoder / easy: abc321_a 321-like Number (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 243
OUT696 |
| ✓ |
LcbCompleteBinaryTreeLiveCodeBench / atcoder / hard: abc321_e Complete Binary Tree (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 233
OUT30 406 |
| ✓ |
LcbCutoffLiveCodeBench / atcoder / easy: abc321_b Cutoff (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 261
OUT14 895 |
| ✓ |
LcbFirstAbc2LiveCodeBench / atcoder / easy: abc322_a First ABC 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 184
OUT488 |
| ✓ |
LcbKth321LikeLiveCodeBench / atcoder / medium: abc321_c K-th 321-like Number (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 220
OUT6 336 |
| ✓ |
LcbRelativePositionLiveCodeBench / atcoder / medium: abc320_d Relative Position (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 241
OUT10 235 |
| ✓ |
LcbSetMenuLiveCodeBench / atcoder / medium: abc321_d Set Menu (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 219
OUT7 863 |
| × |
LcbSlotStrategy2LiveCodeBench / atcoder / medium: abc320_c Slot Strategy 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: SlotStrategy2 case0: expected [6] got [5] |
Failed |
IN9 258
OUT20 263 |
| ✓ |
LcbSomenNagashiLiveCodeBench / atcoder / hard: abc320_e Somen Nagashi (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 252
OUT26 260 |
Code Generation - LiveCodeBench v1 AtCoder (set 13)
7 passed2 broken |
77.8% |
IN83 141
OUT211 517 |
| ✓ |
LcbFestivalLiveCodeBench / atcoder / medium: abc322_c Festival (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 218
OUT8 373 |
| ✓ |
LcbMergeSlimesLiveCodeBench / atcoder / hard: abc323_d Merge Slimes (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 200
OUT44 507 |
| ! |
LcbPlaylistProbLiveCodeBench / atcoder / hard: abc323_e Playlist (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 295
OUT62 144 |
| ✓ |
LcbPolyominoLiveCodeBench / atcoder / medium: abc322_d Polyomino (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 272
OUT13 560 |
| ✓ |
LcbPrefixSuffixLiveCodeBench / atcoder / easy: abc322_b Prefix and Suffix (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 230
OUT2 097 |
| ! |
LcbProductDevelopmentLiveCodeBench / atcoder / hard: abc322_e Product Development (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 233
OUT62 144 |
| ✓ |
LcbRoundRobinRankLiveCodeBench / atcoder / easy: abc323_b Round (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 241
OUT1 640 |
| ✓ |
LcbWeakBeatsLiveCodeBench / atcoder / easy: abc323_a Weak Beats (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 186
OUT500 |
| ✓ |
LcbWorldTourFinalsLiveCodeBench / atcoder / medium: abc323_c World Tour Finals (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 266
OUT16 552 |
Code Generation - LiveCodeBench v1 AtCoder (set 14)
4 passed1 failed1 broken1 skipped |
66.7% |
IN55 068
OUT94 692 |
| ✓ |
Lcb2x3yLiveCodeBench / atcoder / easy: abc324_b 2^x 3^y (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 150
OUT457 |
| ✓ |
LcbAllValuesEqualLiveCodeBench / atcoder / easy: abc324_a Same (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 147
OUT1 475 |
| – |
LcbBeautifulPathLiveCodeBench / atcoder / hard: abc324_f Beautiful Path (Pattern B, stdin)0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: float stdout: stdin driver compares stdout by exact trimmed string, cannot tolerance-match a floating-point ratio like 0.7500000000000000 |
Skipped |
IN0
OUT0 |
| × |
LcbErrorCorrectionLiveCodeBench / atcoder / medium: abc324_c Error Correction (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: ErrorCorrection case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
13:13: Unknown function 'CanBeConverted'.
Values:
run.Compiled = false |
Failed |
IN9 266
OUT8 095 |
| ✓ |
LcbJointTwoStringsLiveCodeBench / atcoder / hard: abc324_e Joint Two Strings (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 200
OUT22 148 |
| ! |
LcbSquarePermutationLiveCodeBench / atcoder / hard: abc324_d Square Permutation (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 163
OUT62 144 |
| ✓ |
LcbSurnameSanLiveCodeBench / atcoder / easy: abc325_a Takahashi san (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 142
OUT373 |
Code Generation - LiveCodeBench v1 AtCoder (set 15)
6 passed1 failed1 broken1 skipped |
75.0% |
IN74 277
OUT103 532 |
| ✓ |
Lcb326LikeNumberLiveCodeBench / atcoder / abc326_b: 3261 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 223
OUT1 248 |
| – |
LcbAbcPuzzleLiveCodeBench / atcoder / abc326_d: ABC Puzzle NOTE: output is NON-UNIQUE (any valid grid is accepted); exact string compare is unsafe -> SkipTest.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: non-unique output: any valid grid is accepted, exact string compare unsafe |
Skipped |
IN0
OUT0 |
| ✓ |
LcbCarTrainTravelLiveCodeBench / atcoder / abc325_e: Our clients, please wait a moment1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 355
OUT7 251 |
| ✓ |
LcbGiftIntervalLiveCodeBench / atcoder / abc326_c: Peak1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 247
OUT2 550 |
| ! |
LcbPrintingMachineLiveCodeBench / atcoder / abc325_d: Printing Machine1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 284
OUT62 144 |
| ✓ |
LcbSensorClustersLiveCodeBench / atcoder / abc325_c: Sensors1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 308
OUT12 799 |
| × |
LcbSensorCostDilemmaLiveCodeBench / atcoder / abc325_f: Sensor Optimization Dilemma1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: SensorCostDilemma case0: expected [17] got [15] |
Failed |
IN9 378
OUT10 353 |
| ✓ |
LcbStairsOrElevatorLiveCodeBench / atcoder / abc326_a: 2UP3DOWN1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 199
OUT1 086 |
| ✓ |
LcbWorldMeetingLiveCodeBench / atcoder / abc325_b: World Meeting1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 283
OUT6 101 |
Code Generation - LiveCodeBench v1 AtCoder (set 16)
7 passed1 skipped |
100.0% |
IN64 697
OUT22 890 |
| ✓ |
LcbAdjacentABLiveCodeBench / atcoder / abc327_a: ab1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 196
OUT815 |
| ✓ |
LcbGoodTupleLiveCodeBench / atcoder / abc327_d: Good Tuple Problem1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 277
OUT4 579 |
| – |
LcbMaximizeRatingLiveCodeBench / atcoder / abc327_e: Maximize Rating NOTE: output is a FLOAT with tolerance 1e-6; exact trimmed string compare is unsafe -> SkipTest.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: floating-point output with 1e-6 tolerance; exact string compare unsafe |
Skipped |
IN0
OUT0 |
| ✓ |
LcbNotTooHardLiveCodeBench / atcoder / abc328_a: Not Too Hard1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 197
OUT765 |
| ✓ |
LcbNumberPlaceLiveCodeBench / atcoder / abc327_c: Number Place1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 295
OUT2 465 |
| ✓ |
LcbPerfectPowerAALiveCodeBench / atcoder / abc327_b: A^A1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 177
OUT3 361 |
| ✓ |
LcbRepdigitDatesLiveCodeBench / atcoder / abc328_b: 11/111 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 214
OUT2 082 |
| ✓ |
LcbSalaryExpectationLiveCodeBench / atcoder / abc326_e: Revenge of "The Salary of AtCoder Inc."1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 341
OUT8 823 |
Code Generation - LiveCodeBench v1 AtCoder (set 17)
8 passed |
100.0% |
IN73 838
OUT85 338 |
| ✓ |
LcbConsecutivePairsLiveCodeBench / atcoder / abc328_c: Consecutive1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 281
OUT3 821 |
| ✓ |
LcbCountRepeatsLiveCodeBench / atcoder / abc329_c: Count xxx1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 196
OUT2 679 |
| ✓ |
LcbElectionReportLiveCodeBench / atcoder / abc329_d: Election Quick Report1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 260
OUT5 392 |
| ✓ |
LcbModuloMstLiveCodeBench / atcoder / abc328_e: Modulo MST1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 292
OUT25 660 |
| ✓ |
LcbSecondLargestLiveCodeBench / atcoder / abc329_b: Next1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 185
OUT4 310 |
| ✓ |
LcbSpreadCharsLiveCodeBench / atcoder / abc329_a: Spread1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 173
OUT512 |
| ✓ |
LcbStampMatchLiveCodeBench / atcoder / abc329_e: Stamp1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 252
OUT38 932 |
| ✓ |
LcbTakeAbcLiveCodeBench / atcoder / abc328_d: Take ABC1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 199
OUT4 032 |
Code Generation - LiveCodeBench v1 AtCoder (set 18)
9 passed |
100.0% |
IN82 878
OUT69 705 |
| ✓ |
LcbColoredBallLiveCodeBench / atcoder / hard: Colored Ball [LCB id: abc329_f]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 245
OUT16 530 |
| ✓ |
LcbCountingLsLiveCodeBench / atcoder / medium: Counting Ls [LCB id: abc330_d]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 294
OUT2 682 |
| ✓ |
LcbCountingPassesLiveCodeBench / atcoder / easy: Counting Passes [LCB id: abc330_a]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 164
OUT559 |
| ✓ |
LcbEggPacksLiveCodeBench / atcoder / easy: Buy One Carton of Milk (egg packs) [LCB id: abc331_b]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 176
OUT11 625 |
| ✓ |
LcbMexAndUpdateLiveCodeBench / atcoder / hard: Mex and Update [LCB id: abc330_e]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 250
OUT7 882 |
| ✓ |
LcbMinimizeAbs1LiveCodeBench / atcoder / easy: Minimize Abs 1 [LCB id: abc330_b]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 238
OUT1 191 |
| ✓ |
LcbMinimizeAbs2LiveCodeBench / atcoder / medium: Minimize Abs 2 [LCB id: abc330_c]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 144
OUT23 911 |
| ✓ |
LcbSumGreaterThanMeLiveCodeBench / atcoder / medium: Sum of Numbers Greater Than Me [LCB id: abc331_c]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 186
OUT4 146 |
| ✓ |
LcbTomorrowCalendarLiveCodeBench / atcoder / easy: Tomorrow [LCB id: abc331_a]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 181
OUT1 179 |
Code Generation - LiveCodeBench v1 AtCoder (set 19)
5 passed2 failed1 broken |
62.5% |
IN74 295
OUT147 577 |
| ! |
LcbGlassAndMugLiveCodeBench / atcoder / easy: Glass and Mug [LCB id: abc332_b]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 267
OUT62 144 |
| ✓ |
LcbOnlineShoppingLiveCodeBench / atcoder / easy: Online Shopping [LCB id: abc332_a]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 236
OUT820 |
| ✓ |
LcbPentagonDiagonalLiveCodeBench / atcoder / easy: Pentagon [LCB id: abc333_b]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 248
OUT1 844 |
| ✓ |
LcbSetMealLiveCodeBench / atcoder / hard: Set Meal [LCB id: abc331_e]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 304
OUT19 959 |
| × |
LcbSwappingPuzzleLiveCodeBench / atcoder / hard: Swapping Puzzle [LCB id: abc332_d]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: SwappingPuzzle case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
226:5: Expected ';' after the statement, found '{'.
Values:
run.Compiled = false |
Failed |
IN9 362
OUT27 267 |
| ✓ |
LcbThreeThreesLiveCodeBench / atcoder / easy: Three Threes [LCB id: abc333_a]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 140
OUT213 |
| × |
LcbTilePatternLiveCodeBench / atcoder / hard: Tile Pattern [LCB id: abc331_d]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: TilePattern case1: expected [621
167
44
344
500000000000000000] got [644
167
65
344
500000000000000000] |
Failed |
IN9 344
OUT29 333 |
| ✓ |
LcbTShirtsLiveCodeBench / atcoder / medium: T-Shirts [LCB id: abc332_c]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 394
OUT5 997 |
Code Generation - LiveCodeBench v1 AtCoder (set 2)
6 passed1 failed1 broken |
75.0% |
IN74 091
OUT143 818 |
| ! |
LcbAlmostEqualRearrangeLiveCodeBench / atcoder abc302_c / medium: Almost Equal (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 218
OUT62 144 |
| ✓ |
LcbDashHealthLiveCodeBench / atcoder abc303_c / medium: Dash (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 310
OUT11 019 |
| ✓ |
LcbDiscordBadMoodLiveCodeBench / atcoder abc303_b / easy: Discord (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 235
OUT7 391 |
| ✓ |
LcbImpartialGiftLiveCodeBench / atcoder abc302_d / medium: Impartial Gift (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 260
OUT11 341 |
| ✓ |
LcbIsolationQueriesLiveCodeBench / atcoder abc302_e / hard: Isolation (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 247
OUT16 925 |
| ✓ |
LcbMergeSetLiveCodeBench / atcoder abc302_f / hard: Merge Set (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 302
OUT18 923 |
| × |
LcbShiftVsCapsLockLiveCodeBench / atcoder abc303_d / medium: Shift vs. CapsLock (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: ShiftVsCapsLock case0: expected [9] got [7] |
Failed |
IN9 270
OUT14 981 |
| ✓ |
LcbSimilarStringLiveCodeBench / atcoder abc303_a / easy: Similar String (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 249
OUT1 094 |
Code Generation - LiveCodeBench v1 AtCoder (set 20)
6 passed1 failed1 skipped |
85.7% |
IN64 683
OUT97 038 |
| ✓ |
LcbChristmasColorGridLiveCodeBench / atcoder / hard: Christmas Color Grid 1 [LCB id: abc334_e]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 373
OUT22 154 |
| ✓ |
LcbChristmasPresentLiveCodeBench / atcoder / easy: Christmas Present [LCB id: abc334_a]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 157
OUT608 |
| ✓ |
LcbChristmasTreesLiveCodeBench / atcoder / medium: Christmas Trees [LCB id: abc334_b]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 234
OUT2 485 |
| ✓ |
LcbEraseLeavesLiveCodeBench / atcoder / medium: Erase Leaves [LCB id: abc333_d]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 236
OUT9 720 |
| ✓ |
LcbReindeerSleighLiveCodeBench / atcoder / medium: Reindeer and Sleigh [LCB id: abc334_d]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 252
OUT7 271 |
| ✓ |
LcbRepunitTrioLiveCodeBench / atcoder / medium: Repunit Trio [LCB id: abc333_c]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 178
OUT17 762 |
| × |
LcbSocks2LiveCodeBench / atcoder / medium: Socks 2 [LCB id: abc334_c]1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: Socks2 case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
11:23: Type 'StringBuilder' has no fields. Only struct values support '.Length'.
22:15: Type 'StringBuilder' has no fields. Only struct values support '.Length'.
Values:
run.Compiled = false |
Failed |
IN9 253
OUT37 038 |
| – |
LcbTakahashiQuestLiveCodeBench / atcoder / hard: Takahashi Quest [LCB id: abc333_e]0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: non-unique output: any valid pick-up sequence achieving K_min is accepted, cannot value-compare against a single oracle line |
Skipped |
IN0
OUT0 |
Code Generation - LiveCodeBench v1 AtCoder (set 21)
8 passed1 skipped |
100.0% |
IN73 592
OUT32 129 |
| ✓ |
Lcb2023To2024LiveCodeBench / atcoder / abc335_a: 2023 -> 2024 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 147
OUT288 |
| ✓ |
LcbCtzLiveCodeBench / atcoder / abc336_b: CTZ (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 174
OUT373 |
| ✓ |
LcbEvenDigitsLiveCodeBench / atcoder / abc336_c: Even Digits (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 231
OUT1 971 |
| ✓ |
LcbLongLoongLiveCodeBench / atcoder / abc336_a: Long Loong (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 174
OUT537 |
| – |
LcbLoongAndTakahashiLiveCodeBench / atcoder / abc335_d: Loong and Takahashi (Pattern B, stdin) [NON-UNIQUE output]0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbLoongTrackingLiveCodeBench / atcoder / abc335_c: Loong Tracking (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 240
OUT5 350 |
| ✓ |
LcbPyramidSequenceLiveCodeBench / atcoder / abc336_d: Pyramid (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 228
OUT22 315 |
| ✓ |
LcbScoreboardLiveCodeBench / atcoder / abc337_a: Scoreboard (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 193
OUT476 |
| ✓ |
LcbTetrahedralNumberLiveCodeBench / atcoder / abc335_b: Tetrahedral Number (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 205
OUT819 |
Code Generation - LiveCodeBench v1 AtCoder (set 22)
7 passed1 skipped |
100.0% |
IN64 412
OUT63 067 |
| – |
LcbBadJuiceLiveCodeBench / atcoder / abc337_e: Bad Juice (INTERACTIVE — not expressible as batch stdin)0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: SC# subset: interactive problem (two-way judge interaction + non-unique valid output) |
Skipped |
IN0
OUT0 |
| ✓ |
LcbCapitalizedLiveCodeBench / atcoder / abc338_a: Capitalized? (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 141
OUT643 |
| ✓ |
LcbCheatingGomokuLiveCodeBench / atcoder / abc337_d: Cheating Gomoku Narabe (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 230
OUT3 322 |
| ✓ |
LcbExtendedAbcLiveCodeBench / atcoder / abc337_b: Extended ABC (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 196
OUT881 |
| ✓ |
LcbFrequencyLiveCodeBench / atcoder / abc338_b: Frequency (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 144
OUT892 |
| ✓ |
LcbIslandTourLiveCodeBench / atcoder / abc338_d: Island Tour (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 282
OUT23 839 |
| ✓ |
LcbLeftoverRecipesLiveCodeBench / atcoder / abc338_c: Leftover Recipes (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 224
OUT30 964 |
| ✓ |
LcbLiningUp2LiveCodeBench / atcoder / abc337_c: Lining Up 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 195
OUT2 526 |
Code Generation - LiveCodeBench v1 AtCoder (set 23)
6 passed1 failed1 broken |
75.0% |
IN73 604
OUT161 750 |
| ✓ |
LcbAppendQueryLiveCodeBench / atcoder / abc340_b: Append (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 183
OUT3 270 |
| ✓ |
LcbArithmeticProgressionLiveCodeBench / atcoder / abc340_a: Arithmetic Progression (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 148
OUT1 193 |
| ✓ |
LcbChordsLiveCodeBench / atcoder / abc338_e: Chords (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 191
OUT19 033 |
| ! |
LcbLangtonsTakahashiLiveCodeBench / atcoder / abc339_b: Langton's Takahashi (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 253
OUT62 144 |
| × |
LcbNegativeTspLiveCodeBench / atcoder / abc338_f: Negative Traveling Salesman (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: NegativeTsp case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
163:21: Variable 'last' has type 'int' but its initializer has type 'byte'.
173:29: Variable 'nxt' has type 'int' but its initializer has type 'byte'.
181:33: Variable 'nloc' has type 'int' but its initializer has type 'byte'.
Values:
run.Compiled = false |
Failed |
IN9 242
OUT47 317 |
| ✓ |
LcbPerfectBusLiveCodeBench / atcoder / abc339_c: Perfect Bus (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 190
OUT2 658 |
| ✓ |
LcbSynchronizedPlayersLiveCodeBench / atcoder / abc339_d: Synchronized Players (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 240
OUT25 172 |
| ✓ |
LcbTldLiveCodeBench / atcoder / abc339_a: TLD (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 157
OUT963 |
Code Generation - LiveCodeBench v1 AtCoder (set 24)
9 passed1 failed |
90.0% |
IN92 488
OUT147 060 |
| ✓ |
LcbAlternatingStringLiveCodeBench / atcoder abc341_e / hard: Alternating String (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 261
OUT8 151 |
| ✓ |
LcbBreakdownLiveCodeBench / atcoder abc341_f / hard: Breakdown (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 324
OUT42 851 |
| ✓ |
LcbDivideAndDivideLiveCodeBench / atcoder abc340_c / medium: Divide and Divide (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 246
OUT3 073 |
| ✓ |
LcbForeignExchangeLiveCodeBench / atcoder abc341_b / easy: Foreign Exchange (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 299
OUT4 939 |
| ✓ |
LcbMancala2LiveCodeBench / atcoder abc340_e / hard: Mancala 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 301
OUT15 171 |
| ✓ |
LcbOnlyOneOfTwoLiveCodeBench / atcoder abc341_d / medium: Only one of two (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 185
OUT3 831 |
| ✓ |
LcbPrint341LiveCodeBench / atcoder abc341_a / easy: Print 341 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 146
OUT400 |
| ✓ |
LcbSuperTakahashiBrosLiveCodeBench / atcoder abc340_d / hard: Super Takahashi Bros. (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 290
OUT16 755 |
| × |
LcbTakahashiGetsLostLiveCodeBench / atcoder abc341_c / medium: Takahashi Gets Lost (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: TakahashiGetsLost case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
43:19: Expected ';' after the for initializer, found ','.
Values:
run.Compiled = false |
Failed |
IN9 275
OUT50 815 |
| ✓ |
LcbYayLiveCodeBench / atcoder abc342_a / easy: Yay! (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 161
OUT1 074 |
Code Generation - LiveCodeBench v1 AtCoder (set 25)
6 passed1 broken2 skipped |
85.7% |
IN64 813
OUT143 704 |
| ✓ |
LcbAdjacencyMatrixLiveCodeBench / atcoder abc343_b / easy: Adjacency Matrix (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 252
OUT2 729 |
| ✓ |
LcbDiversityOfScoresLiveCodeBench / atcoder abc343_d / medium: Diversity of Scores (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 272
OUT4 186 |
| ! |
LcbLastTrainLiveCodeBench / atcoder abc342_e / hard: Last Train (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 409
OUT62 144 |
| ✓ |
LcbManyReplacementLiveCodeBench / atcoder abc342_c / medium: Many Replacement (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 238
OUT2 913 |
| ✓ |
LcbPalindromicCubeLiveCodeBench / atcoder abc343_c / medium: 343 (palindromic cube) (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 183
OUT52 623 |
| – |
LcbSevenCubedLiveCodeBench / atcoder abc343_e / hard: 7x7x7 (Pattern B, stdin) Non-unique output: any valid 9-integer placement is accepted; exact-match oracle cannot judge the Yes case.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: Non-unique output: any valid tuple is accepted for the Yes case; exact-match oracle cannot judge |
Skipped |
IN0
OUT0 |
| ✓ |
LcbSquarePairLiveCodeBench / atcoder abc342_d / medium: Square Pair (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 222
OUT15 342 |
| ✓ |
LcbWhichIsAheadLiveCodeBench / atcoder abc342_b / easy: Which is ahead? (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 237
OUT3 767 |
| – |
LcbWrongAnswerLiveCodeBench / atcoder abc343_a / easy: Wrong Answer (Pattern B, stdin) Non-unique output: ANY integer 0..9 not equal to A+B is accepted; exact-match oracle cannot judge it.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBenchSkipped: Non-unique output: any integer 0..9 != A+B is a valid answer; exact-match oracle cannot judge |
Skipped |
IN0
OUT0 |
Code Generation - LiveCodeBench v1 AtCoder (set 3)
7 passed2 failed |
77.8% |
IN83 141
OUT94 822 |
| ✓ |
LcbAbcdefgDistLiveCodeBench / atcoder abc305_b / easy: ABCDEFG (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 210
OUT941 |
| ✓ |
LcbCookiePickerLiveCodeBench / atcoder abc305_c / medium: Snuke the Cookie Picker (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 234
OUT2 508 |
| ✓ |
LcbFirstPlayerLiveCodeBench / atcoder abc304_a / easy: First Player (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 206
OUT3 569 |
| ✓ |
LcbGiftFromStarsLiveCodeBench / atcoder abc303_e / hard: A Gift From the Stars (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 262
OUT34 566 |
| ✓ |
LcbGoodGraphLiveCodeBench / atcoder abc304_e / hard: Good Graph (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 258
OUT15 382 |
| ✓ |
LcbPieceOfCakeLiveCodeBench / atcoder abc304_d / medium: A Piece of Cake (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 256
OUT8 870 |
| × |
LcbSubscribersLiveCodeBench / atcoder abc304_b / easy: Subscribers (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: Subscribers case0: expected [20200000] got [202] |
Failed |
IN9 314
OUT1 039 |
| × |
LcbVirusSpreadLiveCodeBench / atcoder abc304_c / medium: Virus (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: VirusSpread case0 runtime error: List index 6 is out of range. The list has 6 element(s).
Values:
run.Success = false |
Failed |
IN9 205
OUT26 983 |
| ✓ |
LcbWaterStationLiveCodeBench / atcoder abc305_a / easy: Water Station (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 196
OUT964 |
Code Generation - LiveCodeBench v1 AtCoder (set 4)
8 passed |
100.0% |
IN73 777
OUT71 817 |
| ✓ |
LcbArtGalleryLiveCodeBench / atcoder abc305_e / hard: Art Gallery on Graph (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 252
OUT30 089 |
| ✓ |
LcbBase2LiveCodeBench / atcoder abc306_b / easy: Base 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 195
OUT1 020 |
| ✓ |
LcbBestPerformancesLiveCodeBench / atcoder abc306_e / hard: Best Performances (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 230
OUT13 772 |
| ✓ |
LcbCentersLiveCodeBench / atcoder abc306_c / medium: Centers (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 206
OUT3 860 |
| ✓ |
LcbEchoStringLiveCodeBench / atcoder abc306_a / easy: Echo (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 170
OUT324 |
| ✓ |
LcbPoisonousFullLiveCodeBench / atcoder abc306_d / medium: Poisonous Full (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 257
OUT10 112 |
| ✓ |
LcbSleepLogLiveCodeBench / atcoder abc305_d / hard: Sleep Log (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 259
OUT11 875 |
| ✓ |
LcbWeeklyRecordsLiveCodeBench / atcoder abc307_a / easy: Weekly Records (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 208
OUT765 |
Code Generation - LiveCodeBench v1 AtCoder (set 5)
7 passed1 failed |
87.5% |
IN73 771
OUT179 349 |
| ✓ |
LcbDefaultPriceLiveCodeBench / atcoder abc308_b / easy: Default Price (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 211
OUT1 591 |
| ✓ |
LcbDistinctAdjacentLiveCodeBench / atcoder abc307_e / hard: Distinct Adjacent (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 212
OUT7 164 |
| × |
LcbIdealSheetLiveCodeBench / atcoder abc307_c / medium: Ideal Sheet (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: IdealSheet case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
112:28: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('.
Values:
run.Compiled = false |
Failed |
IN9 301
OUT58 911 |
| ✓ |
LcbMismatchedParensLiveCodeBench / atcoder abc307_d / medium: Mismatched Parentheses (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 184
OUT19 712 |
| ✓ |
LcbNewSchemeLiveCodeBench / atcoder abc308_a / easy: New Scheme (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 203
OUT964 |
| ✓ |
LcbRacecarPalindromeLiveCodeBench / atcoder abc307_b / easy: racecar (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 210
OUT30 709 |
| ✓ |
LcbSnukeMazeLiveCodeBench / atcoder abc308_d / medium: Snuke Maze (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 252
OUT37 029 |
| ✓ |
LcbStandingsLiveCodeBench / atcoder abc308_c / medium: Standings (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 198
OUT23 269 |
Code Generation - LiveCodeBench v1 AtCoder (set 6)
8 passed1 failed |
88.9% |
IN83 422
OUT118 488 |
| ✓ |
LcbAddEdgeMaxDistanceLiveCodeBench / atcoder / medium: abc309_d Add One Edge1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 355
OUT3 374 |
| ✓ |
LcbDrinkCouponLiveCodeBench / atcoder / easy: abc310_a Order Something Else1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 225
OUT1 201 |
| × |
LcbFamilyInsuranceLiveCodeBench / atcoder / hard: abc309_e Family and Insurance1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: FamilyInsurance case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
33:28: Expected ']' to close the indexer, found '++'.
Values:
run.Compiled = false |
Failed |
IN9 215
OUT6 513 |
| ✓ |
LcbMedicineDayLiveCodeBench / atcoder / medium: abc309_c Medicine1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 236
OUT4 421 |
| ✓ |
LcbMexTriplesLiveCodeBench / atcoder / hard: abc308_e MEX1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 255
OUT22 345 |
| ✓ |
LcbNineAdjacentLiveCodeBench / atcoder / easy: abc309_a Nine1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 224
OUT821 |
| ✓ |
LcbRotateOuterLiveCodeBench / atcoder / easy: abc309_b Rotate1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 314
OUT5 753 |
| ✓ |
LcbStrictlySuperiorLiveCodeBench / atcoder / easy: abc310_b Strictly Superior1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 354
OUT47 389 |
| ✓ |
LcbVouchersDiscountLiveCodeBench / atcoder / hard: abc308_f Vouchers1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 244
OUT26 671 |
Code Generation - LiveCodeBench v1 AtCoder (set 7)
5 passed1 failed1 broken1 skipped |
71.4% |
IN64 943
OUT98 485 |
| – |
LcbFindCycleLiveCodeBench / atcoder / medium: abc311_c Find it! (NON-UNIQUE output: any valid directed cycle is accepted; exact-match unreliable)0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: non-unique output: any valid directed cycle is accepted, exact string match unreliable |
Skipped |
IN0
OUT0 |
| ✓ |
LcbFirstAbcLiveCodeBench / atcoder / easy: abc311_a First ABC1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 189
OUT658 |
| ✓ |
LcbGridIceFloorLiveCodeBench / atcoder / medium: abc311_d Grid Ice Floor1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 347
OUT21 869 |
| ✓ |
LcbMake10AgainLiveCodeBench / atcoder / hard: abc310_f Make 10 Again1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 328
OUT6 204 |
| ✓ |
LcbNandRepeatedlyLiveCodeBench / atcoder / hard: abc310_e NAND repeatedly1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 294
OUT4 085 |
| ! |
LcbPeacefulTeamsLiveCodeBench / atcoder / medium: abc310_d Peaceful Teams1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 271
OUT62 144 |
| × |
LcbReversibleSticksLiveCodeBench / atcoder / medium: abc310_c Reversible1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: ReversibleSticks case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
17:22: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var canonical = ...;'
Values:
run.Compiled = false |
Failed |
IN9 265
OUT1 185 |
| ✓ |
LcbVacationTogetherLiveCodeBench / atcoder / easy: abc311_b Vacation Together1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 249
OUT2 340 |
Code Generation - LiveCodeBench v1 AtCoder (set 8)
7 passed1 broken |
87.5% |
IN74 131
OUT178 833 |
| ✓ |
LcbBecomeStrongestLiveCodeBench / atcoder / easy: abc313_a To Be Saikyo1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 202
OUT1 524 |
| ✓ |
LcbCansOpenersLiveCodeBench / atcoder / hard: abc312_f Cans and Openers1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 293
OUT28 405 |
| ✓ |
LcbChordCheckLiveCodeBench / atcoder / easy: abc312_a Chord1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 154
OUT272 |
| ✓ |
LcbCountBracketsLiveCodeBench / atcoder / medium: abc312_d Count Bracket Sequences1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 251
OUT4 100 |
| ✓ |
LcbCuboidTangencyLiveCodeBench / atcoder / hard: abc312_e Tangency of Cuboids1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 341
OUT50 972 |
| ! |
LcbHolelessSquaresLiveCodeBench / atcoder / hard: abc311_e Defect1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 322
OUT62 144 |
| ✓ |
LcbInvisibleHandLiveCodeBench / atcoder / medium: abc312_c Invisible Hand1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 210
OUT13 060 |
| ✓ |
LcbTakCodeLiveCodeBench / atcoder / easy: abc312_b TaK Code1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 358
OUT18 356 |
Code Generation - LiveCodeBench v1 AtCoder (set 9)
7 passed1 failed1 skipped |
87.5% |
IN73 906
OUT73 962 |
| × |
LcbApproxEqualizationLiveCodeBench / atcoder / medium: abc313_c Approximate Equalization 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: ApproxEqualization case2: expected [2499999974] got [2399999977] |
Failed |
IN9 189
OUT4 745 |
| ✓ |
LcbCertainGameExpectedLiveCodeBench / atcoder / hard: abc314_f A Certain Game (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 304
OUT24 777 |
| ✓ |
LcbLowerUpperOpsLiveCodeBench / atcoder / medium: abc314_d LOWER (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 223
OUT9 645 |
| ✓ |
LcbPiTruncateLiveCodeBench / atcoder / easy: abc314_a 3.14 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 268
OUT823 |
| ✓ |
LcbRemoveVowelsLiveCodeBench / atcoder / easy: abc315_a tcdr (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 153
OUT393 |
| ✓ |
LcbRotateColoredSubsequenceLiveCodeBench / atcoder / medium: abc314_c Rotate Colored Subsequence (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 252
OUT18 353 |
| ✓ |
LcbRouletteFewestBetsLiveCodeBench / atcoder / easy: abc314_b Roulette (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 269
OUT9 613 |
| – |
LcbRoulettesExpectedLiveCodeBench / atcoder / hard: abc314_e Roulettes (Pattern B, stdin) FLAG: float output (expected value); exact-string driver cannot do tolerance -> SkipTest.0 AI queries
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: SC# stdin driver: float/expected-value output needs tolerance comparison; exact string compare unsafe |
Skipped |
IN0
OUT0 |
| ✓ |
LcbStrongestProgrammerLiveCodeBench / atcoder / medium: abc313_b Who is Saikyo? (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 248
OUT5 613 |
Code Generation - LiveCodeBench v1 Codeforces (set 1)
7 passed2 failed |
77.8% |
IN83 318
OUT72 368 |
| ✓ |
LcbChemistryPalindromeLiveCodeBench / codeforces 1883_B / medium: Chemistry (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Mediumsource:LiveCodeBench |
Passed |
IN9 250
OUT13 722 |
| ✓ |
LcbGameWithIntegersLiveCodeBench / codeforces 1899_A / easy: Game with Integers (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench |
Passed |
IN9 255
OUT2 430 |
| ✓ |
LcbGoodKidLiveCodeBench / codeforces 1873_B / easy: Good Kid (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench |
Passed |
IN9 244
OUT2 969 |
| ✓ |
LcbOneDEraserLiveCodeBench / codeforces 1873_D / easy: 1D Eraser (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench |
Passed |
IN9 240
OUT3 697 |
| ✓ |
LcbRaspberriesLiveCodeBench / codeforces 1883_C / medium: Raspberries (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Mediumsource:LiveCodeBench |
Passed |
IN9 248
OUT21 022 |
| ✓ |
LcbShortSortLiveCodeBench / codeforces 1873_A / easy: Short Sort (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench |
Passed |
IN9 227
OUT1 129 |
| × |
LcbTruckWeightDifferenceLiveCodeBench / codeforces 1899_B / hard: 250 Thousand Tons of TNT (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: TruckWeightDifference case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
12:15: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 306
OUT13 691 |
| × |
LcbYarikArrayAltParityLiveCodeBench / codeforces 1899_C / hard: Yarik and Array (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: YarikArrayAltParity case0: expected [15
17
8
4
-1000
101
10] got [15
17
7
4
-1000
101
10] |
Failed |
IN9 268
OUT5 610 |
| ✓ |
LcbYarikMusicalNotesLiveCodeBench / codeforces 1899_D / hard: Yarik and Musical Notes (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench |
Passed |
IN9 280
OUT8 098 |
Code Generation - LiveCodeBench v1 LeetCode (set 1)
9 passed |
100.0% |
IN82 618
OUT61 955 |
| ✓ |
LcbBuyChocoLiveCodeBench / leetcode / easy: buy-two-chocolates (LCB 2756)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 156
OUT853 |
| ✓ |
LcbColorTheArrayLiveCodeBench / leetcode / medium: number-of-adjacent-elements-with-the-same-color (LCB 2779)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 233
OUT1 635 |
| ✓ |
LcbCountOfIntegersLiveCodeBench / leetcode / hard: count-of-integers (LCB 2757)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 200
OUT33 873 |
| ✓ |
LcbCountSeniorsLiveCodeBench / leetcode / easy: number-of-senior-citizens (LCB 2727)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 236
OUT283 |
| ✓ |
LcbDistinctDifferenceArrayLiveCodeBench / leetcode / easy: find-the-distinct-difference-array (LCB 2777)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 177
OUT1 274 |
| ✓ |
LcbMatrixSumLiveCodeBench / leetcode / medium: sum-in-a-matrix (LCB 2728)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 151
OUT2 009 |
| ✓ |
LcbMaximumOrLiveCodeBench / leetcode / medium: maximum-or (LCB 2730)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 163
OUT13 373 |
| ✓ |
LcbMaxStrengthLiveCodeBench / leetcode / medium: maximum-strength-of-a-group (LCB 2754)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 142
OUT4 328 |
| ✓ |
LcbMinExtraCharLiveCodeBench / leetcode / medium: extra-characters-in-a-string (LCB 2755)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 160
OUT4 327 |
Code Generation - LiveCodeBench v1 LeetCode (set 10)
8 passed1 broken |
88.9% |
IN83 002
OUT140 409 |
| ✓ |
LcbCanBeEqualSwapLiveCodeBench / leetcode / easy: check-if-strings-can-be-made-equal-with-operations-i (id 2999)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 182
OUT1 481 |
| ✓ |
LcbCanMakeSubsequenceCyclicLiveCodeBench / leetcode / medium: make-string-a-subsequence-using-cyclic-increments (id 3018)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 247
OUT2 748 |
| ✓ |
LcbConstructProductMatrixLiveCodeBench / leetcode / medium: construct-product-matrix (id 3031)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 196
OUT8 437 |
| ✓ |
LcbFurthestDistanceFromOriginLiveCodeBench / leetcode / easy: furthest-point-from-origin (id 3019)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 194
OUT783 |
| ✓ |
LcbMaxBallPassingValueLiveCodeBench / leetcode / hard: maximize-value-of-function-in-a-ball-passing-game (id 3032)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 308
OUT16 302 |
| ✓ |
LcbMinAbsoluteDifferenceApartLiveCodeBench / leetcode / medium: minimum-absolute-difference-between-elements-with-constraint (id 3000)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 204
OUT16 328 |
| ! |
LcbMinOperationsSubsequenceSumLiveCodeBench / leetcode / hard: minimum-operations-to-form-subsequence-with-target-sum (id 3025)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 261
OUT62 144 |
| ✓ |
LcbNumberOfBeautifulIntegersLiveCodeBench / leetcode / hard: number-of-beautiful-integers-in-the-range (id 3017)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 182
OUT14 192 |
| ✓ |
LcbStringTransformationWaysLiveCodeBench / leetcode / hard: string-transformation (id 3024)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 228
OUT17 994 |
Code Generation - LiveCodeBench v1 LeetCode (set 11)
9 passed |
100.0% |
IN82 729
OUT84 999 |
| ✓ |
LcbMaximumCompleteSubsetSumLiveCodeBench / leetcode / hard: maximum-element-sum-of-a-complete-subset-of-indices (id 3047)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 234
OUT27 811 |
| ✓ |
LcbMaximumOddBinaryNumberLiveCodeBench / leetcode / easy: maximum-odd-binary-number (id 3055)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 150
OUT972 |
| ✓ |
LcbMinArrayLengthAfterRemovalsLiveCodeBench / leetcode / medium: minimum-array-length-after-pair-removals (id 3081)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 208
OUT2 644 |
| ✓ |
LcbMinCostMakeStringsEqualLiveCodeBench / leetcode / medium: apply-operations-to-make-two-strings-equal (id 3033)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 281
OUT25 780 |
| ✓ |
LcbMinimumRightShiftsLiveCodeBench / leetcode / easy: minimum-right-shifts-to-sort-the-array (id 3045)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 159
OUT2 075 |
| ✓ |
LcbMinOperationsCollectElementsLiveCodeBench / leetcode / easy: minimum-operations-to-collect-elements (id 3044)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 170
OUT2 689 |
| ✓ |
LcbMinOperationsSpecialNumberLiveCodeBench / leetcode / medium: minimum-operations-to-make-a-special-number (id 3046)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 158
OUT18 172 |
| ✓ |
LcbNumberOfPointsCarsLiveCodeBench / leetcode / easy: points-that-intersect-with-cars (id 3034)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 169
OUT2 196 |
| ✓ |
LcbSplitArrayMaxSubarraysLiveCodeBench / leetcode / medium: split-array-into-maximum-number-of-subarrays (id 3080)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 200
OUT2 660 |
Code Generation - LiveCodeBench v1 LeetCode (set 12)
8 passed |
100.0% |
IN73 724
OUT140 291 |
| ✓ |
LcbBeautifulTowersMaxSumLiveCodeBench / leetcode / medium: beautiful-towers-i (id 3114)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 264
OUT8 022 |
| ✓ |
LcbCountSubMultisetsBoundedSumLiveCodeBench / leetcode / hard: count-of-sub-multisets-with-bounded-sum (id 3091)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 291
OUT54 473 |
| ✓ |
LcbCountWaysHappyStudentsLiveCodeBench / leetcode / medium: happy-students (id 3104)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 200
OUT2 592 |
| ✓ |
LcbLongestSubsequenceSumTargetLiveCodeBench / leetcode / medium: length-of-the-longest-subsequence-that-sums-to-target (id 3106)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 200
OUT4 538 |
| ✓ |
LcbMinOperationsMakeArrayEmptyLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-array-empty (id 3094)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 175
OUT1 236 |
| ✓ |
LcbMinSizeSubarrayInfiniteLiveCodeBench / leetcode / medium: minimum-size-subarray-in-infinite-array (id 3141)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 181
OUT23 191 |
| ✓ |
LcbShortestBeautifulSubstringLiveCodeBench / leetcode / medium: shortest-and-lexicographically-smallest-beautiful-string (id 3150)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 225
OUT45 656 |
| ✓ |
LcbSumIndicesKSetBitsLiveCodeBench / leetcode / easy: sum-of-values-at-indices-with-k-set-bits (id 3093)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 188
OUT583 |
Code Generation - LiveCodeBench v1 LeetCode (set 13)
8 passed1 failed |
88.9% |
IN82 334
OUT46 189 |
| ✓ |
LcbDivisibleSumsDifferenceLiveCodeBench / leetcode / easy: 3172 divisible-and-non-divisible-sums-difference (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 116
OUT1 932 |
| ✓ |
LcbLastVisitedIntegersLiveCodeBench / leetcode / easy: 3164 last-visited-integers (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 200
OUT1 278 |
| ✓ |
LcbMaxOrderedTripletValueLiveCodeBench / leetcode / easy: 3154 maximum-value-of-an-ordered-triplet-i (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 129
OUT5 161 |
| ✓ |
LcbMaxSumOfSquaresLiveCodeBench / leetcode / hard: 3153 apply-operations-on-array-to-maximize-sum-of-squares (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 186
OUT4 056 |
| ✓ |
LcbMinChangesBinaryBeautifulLiveCodeBench / leetcode / medium: 3174 minimum-number-of-changes-to-make-binary-string-beautiful (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 122
OUT1 504 |
| ✓ |
LcbMinEqualSumReplaceZerosLiveCodeBench / leetcode / medium: 3171 minimum-equal-sum-of-two-arrays-after-replacing-zeros (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 119
OUT1 737 |
| ✓ |
LcbMinGroupsValidAssignmentLiveCodeBench / leetcode / medium: 3166 minimum-number-of-groups-to-create-a-valid-assignment (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 151
OUT4 256 |
| ✓ |
LcbMinProcessingTimeLiveCodeBench / leetcode / medium: 3151 minimum-processing-time (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 191
OUT2 709 |
| × |
LcbSumDistinctSquaresLiveCodeBench / leetcode / easy: 3163 subarrays-distinct-element-sum-of-squares-i (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: SumDistinctSquares case0 runtime error: List index 4 is out of range. The list has 4 element(s).
Values:
run.Success = false |
Failed |
IN9 120
OUT23 556 |
Code Generation - LiveCodeBench v1 LeetCode (set 14)
9 passed |
100.0% |
IN82 207
OUT78 914 |
| ✓ |
LcbFindChampionILiveCodeBench / leetcode / easy: 3188 find-champion-i (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 148
OUT1 669 |
| ✓ |
LcbFindKOrLiveCodeBench / leetcode / easy: 3183 find-the-k-or-of-an-array (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 139
OUT1 218 |
| ✓ |
LcbFindWordsContainingLiveCodeBench / leetcode / easy: 3194 find-words-containing-character (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 096
OUT282 |
| ✓ |
LcbMaxBalancedSubseqSumLiveCodeBench / leetcode / hard: 3184 maximum-balanced-subsequence-sum (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 157
OUT4 998 |
| ✓ |
LcbMaximumXorProductLiveCodeBench / leetcode / medium: 3192 maximum-xor-product (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 119
OUT38 195 |
| ✓ |
LcbMaxStrongPairXorLiveCodeBench / leetcode / easy: 3193 maximum-strong-pair-xor-i (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 147
OUT20 101 |
| ✓ |
LcbMinMountainTripletSumLiveCodeBench / leetcode / easy: 3176 minimum-sum-of-mountain-triplets-i (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 116
OUT8 037 |
| ✓ |
LcbMinOpsMaximizeLastLiveCodeBench / leetcode / medium: 3190 minimum-operations-to-maximize-last-elements-in-arrays (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 162
OUT3 904 |
| ✓ |
LcbSeparateBlackWhiteBallsLiveCodeBench / leetcode / medium: 3195 separate-black-and-white-balls (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 123
OUT510 |
Code Generation - LiveCodeBench v1 LeetCode (set 15)
7 passed1 failed |
87.5% |
IN73 154
OUT87 334 |
| × |
LcbCountBeautifulSubstringsLiveCodeBench / leetcode / medium: 3210 count-beautiful-substrings-i (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: CountBeautifulSubstrings case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
84:21: Cannot assign a value of type 'long' to an element of type 'int'.
Values:
run.Compiled = false |
Failed |
IN9 143
OUT13 317 |
| ✓ |
LcbDistributeCandiesILiveCodeBench / leetcode / easy: 3199 distribute-candies-among-children-i (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 084
OUT5 612 |
| ✓ |
LcbFindCommonElementsLiveCodeBench / leetcode / easy: 3206 find-common-elements-between-two-arrays (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 159
OUT494 |
| ✓ |
LcbGoodStringsLeetLiveCodeBench / leetcode / medium: 3200 number-of-strings-which-can-be-rearranged-to-contain-substring (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 115
OUT9 952 |
| ✓ |
LcbMakeThreeStringsEqualLiveCodeBench / leetcode / easy: 3207 make-three-strings-equal (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 146
OUT1 871 |
| ✓ |
LcbMaxFrequencyScoreLiveCodeBench / leetcode / hard: 3196 apply-operations-to-maximize-frequency-score (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 127
OUT4 220 |
| ✓ |
LcbMinCoinsForFruitsLiveCodeBench / leetcode / medium: 3209 minimum-number-of-coins-for-fruits (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 148
OUT17 869 |
| ✓ |
LcbPalindromeRearrangeQueriesLiveCodeBench / leetcode / hard: 3203 palindrome-rearrangement-queries (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 232
OUT33 999 |
Code Generation - LiveCodeBench v1 LeetCode (set 16)
9 passed |
100.0% |
IN82 336
OUT46 567 |
| ✓ |
LcbCompleteSubstringsLiveCodeBench / leetcode / hard: count-complete-substrings (id 3223)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 143
OUT9 932 |
| ✓ |
LcbCountTestedDevicesLiveCodeBench / leetcode / easy: count-tested-devices-after-test-operations (id 3220)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 190
OUT1 287 |
| ✓ |
LcbFindPeaksLiveCodeBench / leetcode / easy: find-the-peaks (id 3221)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 115
OUT390 |
| ✓ |
LcbGoodPartitionsCountLiveCodeBench / leetcode / hard: count-the-number-of-good-partitions (id 3212)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 116
OUT5 618 |
| ✓ |
LcbInfectionSequencesLiveCodeBench / leetcode / hard: count-the-number-of-infection-sequences (id 3224)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 215
OUT12 919 |
| ✓ |
LcbLexSmallestSwapLiveCodeBench / leetcode / medium: make-lexicographically-smallest-array-by-swapping-elements (id 3219)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 172
OUT5 943 |
| ✓ |
LcbLongestSubarrayKFreqLiveCodeBench / leetcode / medium: length-of-longest-subarray-with-at-most-k-frequency (id 3225)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 131
OUT1 634 |
| ✓ |
LcbMaxNonDecreasingLengthLiveCodeBench / leetcode / hard: find-maximum-non-decreasing-array-length (id 3211)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 155
OUT6 529 |
| ✓ |
LcbSubarraysMaxKTimesLiveCodeBench / leetcode / medium: count-subarrays-where-max-element-appears-at-least-k-times (id 3213)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 099
OUT2 315 |
Code Generation - LiveCodeBench v1 LeetCode (set 17)
8 passed1 broken |
88.9% |
IN82 438
OUT137 106 |
| ✓ |
LcbDoubleModExpLiveCodeBench / leetcode / medium: double-modular-exponentiation (id 3234)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 148
OUT18 548 |
| ✓ |
LcbEqualindromicCostLiveCodeBench / leetcode / medium: minimum-cost-to-make-array-equalindromic (id 3229)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 200
OUT27 929 |
| ! |
LcbMaxPartitionsOpsLiveCodeBench / leetcode / hard: maximize-the-number-of-partitions-after-operations (id 3233)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 164
OUT62 144 |
| ✓ |
LcbMaxSetSizeRemovalsLiveCodeBench / leetcode / medium: maximum-size-of-a-set-after-removals (id 3228)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 129
OUT11 704 |
| ✓ |
LcbMinCoinsToAddLiveCodeBench / leetcode / medium: minimum-number-of-coins-to-be-added (id 3231)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 161
OUT1 518 |
| ✓ |
LcbMinCostConvertStringLiveCodeBench / leetcode / medium: minimum-cost-to-convert-string-i (id 3235)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 232
OUT3 078 |
| ✓ |
LcbMinimumNumberGameLiveCodeBench / leetcode / easy: minimum-number-game (id 3226)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 137
OUT649 |
| ✓ |
LcbMissingAndRepeatedLiveCodeBench / leetcode / easy: find-missing-and-repeated-values (id 3227)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 151
OUT8 888 |
| ✓ |
LcbRemoveAlmostEqualLiveCodeBench / leetcode / medium: remove-adjacent-almost-equal-characters (id 3230)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 116
OUT2 648 |
Code Generation - LiveCodeBench v1 LeetCode (set 18)
8 passed |
100.0% |
IN73 230
OUT100 999 |
| ✓ |
LcbBeautifulIndicesLiveCodeBench / leetcode / medium: find-beautiful-indices-in-the-given-array-i (id 3245)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 172
OUT7 026 |
| ✓ |
LcbBitwiseOrTrailingZerosLiveCodeBench / leetcode / easy: check-if-bitwise-or-has-trailing-zeros (id 3246)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 157
OUT27 430 |
| ✓ |
LcbMaxFrequencyElementsLiveCodeBench / leetcode / easy: count-elements-with-maximum-frequency (id 3242)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 091
OUT1 712 |
| ✓ |
LcbMaxNumberPricesSumLiveCodeBench / leetcode / medium: maximum-number-that-sum-of-the-prices-is-less-than-or-equal-to-k (id 3240)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 191
OUT16 040 |
| ✓ |
LcbMinArrayLengthModLiveCodeBench / leetcode / medium: minimize-length-of-array-using-operations (id 3244)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 154
OUT16 491 |
| ✓ |
LcbMinOpsXYEqualLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-x-and-y-equal (id 3239)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 131
OUT12 991 |
| ✓ |
LcbMissingSeqPrefixSumLiveCodeBench / leetcode / easy: smallest-missing-integer-greater-than-sequential-prefix-sum (id 3236)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 130
OUT2 846 |
| ✓ |
LcbPowerfulIntegersLiveCodeBench / leetcode / hard: count-the-number-of-powerful-integers (id 3243)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 204
OUT16 463 |
Code Generation - LiveCodeBench v1 LeetCode (set 19)
8 passed1 failed |
88.9% |
IN82 269
OUT60 615 |
| ✓ |
LcbAreaOfMaxDiagonalLiveCodeBench / leetcode / easy: maximum-area-of-longest-diagonal-rectangle (id 3251)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 128
OUT696 |
| ✓ |
LcbCountMatchingSubarraysLiveCodeBench / leetcode / medium: number-of-subarrays-that-match-a-pattern-i (id 3269)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 201
OUT1 039 |
| ✓ |
LcbIncremovableSubarrayCountLiveCodeBench / leetcode / easy: count-the-number-of-incremovable-subarrays-i (id 3252)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 121
OUT16 599 |
| ✓ |
LcbLargestPerimeterLiveCodeBench / leetcode / medium: find-polygon-with-the-largest-perimeter (id 3262)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 187
OUT3 288 |
| ✓ |
LcbLongestSpecialThriceLiveCodeBench / leetcode / medium: find-longest-special-substring-that-occurs-thrice-i (id 3267)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 115
OUT15 806 |
| ✓ |
LcbMaximumGoodSubarraySumLiveCodeBench / leetcode / medium: maximum-good-subarray-sum (id 3265)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 132
OUT6 402 |
| ✓ |
LcbMinimumCostThreeSubarraysLiveCodeBench / leetcode / easy: divide-an-array-into-subarrays-with-minimum-cost-i (id 3263)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 096
OUT2 178 |
| ✓ |
LcbMinOpsXorEqualKLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-array-xor-equal-to-k (id 3249)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 139
OUT1 453 |
| × |
LcbMinOrAfterOperationsLiveCodeBench / leetcode / hard: minimize-or-of-remaining-elements-using-operations (id 3261)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: minOr case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
35:17: The if condition must be 'bool', but it has type 'int'.
47:24: Function 'CanFormEnoughSegments' must return 'int', but this return statement has type 'bool'.
65:41: Function 'CanFormEnoughSegments' must return 'int', but this return statement has type 'bool'.
71:5: Function 'CanFormEnoughSegments' must return 'int', but this return statement has type 'bool'.
Values:
run.Compiled = false |
Failed |
IN9 150
OUT13 154 |
Code Generation - LiveCodeBench v1 LeetCode (set 2)
9 passed |
100.0% |
IN82 494
OUT82 338 |
| ✓ |
LcbCircularGameLosersLiveCodeBench / leetcode / easy: find-the-losers-of-the-circular-game (LCB 2791)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 184
OUT1 743 |
| ✓ |
LcbCollectingChocolatesLiveCodeBench / leetcode / medium: collecting-chocolates (LCB 2810)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 182
OUT4 386 |
| ✓ |
LcbLongestSemiRepetitiveLiveCodeBench / leetcode / medium: find-the-longest-semi-repetitive-substring (LCB 2786)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 159
OUT1 713 |
| ✓ |
LcbMinLengthRemoveSubstrLiveCodeBench / leetcode / easy: minimum-string-length-after-removing-substrings (LCB 2800)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 127
OUT2 327 |
| ✓ |
LcbNeighboringXorLiveCodeBench / leetcode / medium: neighboring-bitwise-xor (LCB 2792)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 187
OUT589 |
| ✓ |
LcbPaintWallsLiveCodeBench / leetcode / hard: painting-the-walls (LCB 2808)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 193
OUT57 849 |
| ✓ |
LcbPowerOfHeroesLiveCodeBench / leetcode / hard: power-of-heroes (LCB 2784)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 154
OUT9 363 |
| ✓ |
LcbPunishmentNumberLiveCodeBench / leetcode / medium: find-the-punishment-number-of-an-integer (LCB 2802)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 147
OUT3 283 |
| ✓ |
LcbSemiOrderedPermutationLiveCodeBench / leetcode / easy: semi-ordered-permutation (LCB 2785)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 161
OUT1 085 |
Code Generation - LiveCodeBench v1 LeetCode (set 20)
8 passed |
100.0% |
IN73 149
OUT94 964 |
| ✓ |
LcbCanSortArrayBySetBitsLiveCodeBench / leetcode / medium: find-if-array-can-be-sorted (id 3291)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 115
OUT3 981 |
| ✓ |
LcbCountPrefixSuffixPairsLiveCodeBench / leetcode / easy: count-prefix-and-suffix-pairs-i (id 3309)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 131
OUT16 279 |
| ✓ |
LcbEarliestSecondToMarkLiveCodeBench / leetcode / medium: earliest-second-to-mark-indices-i (id 3292)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 192
OUT41 816 |
| ✓ |
LcbFlowerGameLiveCodeBench / leetcode / medium: alice-and-bob-playing-flower-game (id 3279)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 147
OUT1 129 |
| ✓ |
LcbLastNonEmptyStringLiveCodeBench / leetcode / medium: apply-operations-to-make-string-empty (id 3308)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 099
OUT3 027 |
| ✓ |
LcbMaxSelectedConsecutiveLiveCodeBench / leetcode / hard: maximize-consecutive-elements-in-an-array-after-modification (id 3298)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 146
OUT5 685 |
| ✓ |
LcbMaxSubsetPowerPatternLiveCodeBench / leetcode / medium: find-the-maximum-number-of-elements-in-subset (id 3299)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 193
OUT14 899 |
| ✓ |
LcbMinTimeRevertWordLiveCodeBench / leetcode / medium: minimum-time-to-revert-word-to-initial-state-i (id 3297)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 126
OUT8 148 |
Code Generation - LiveCodeBench v1 LeetCode (set 21)
8 passed |
100.0% |
IN73 166
OUT39 243 |
| ✓ |
LcbAntOnBoundaryLiveCodeBench / leetcode / easy: ant-on-the-boundary (id 3311)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 154
OUT383 |
| ✓ |
LcbCountKeyChangesLiveCodeBench / leetcode / easy: number-of-changing-keys (id 3312)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 124
OUT508 |
| ✓ |
LcbDistributeTwoArraysLiveCodeBench / leetcode / easy: distribute-elements-into-two-arrays-i (id 3347)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 178
OUT1 560 |
| ✓ |
LcbLongestCommonPrefixDigitsLiveCodeBench / leetcode / medium: find-the-length-of-the-longest-common-prefix (id 3329)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 190
OUT4 713 |
| ✓ |
LcbMaxOperationsSameScoreLiveCodeBench / leetcode / easy: maximum-number-of-operations-with-the-same-score-i (id 3320)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 124
OUT1 052 |
| ✓ |
LcbMaxPalindromesAfterOpsLiveCodeBench / leetcode / medium: maximum-palindromes-after-operations (id 3317)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 167
OUT30 012 |
| ✓ |
LcbMinOpsExceedThresholdLiveCodeBench / leetcode / easy: minimum-operations-to-exceed-threshold-value-i (id 3331)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 107
OUT248 |
| ✓ |
LcbSplitArrayDistinctLiveCodeBench / leetcode / easy: split-the-array (id 3324)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 122
OUT767 |
Code Generation - LiveCodeBench v1 LeetCode (set 3)
7 passed1 broken |
87.5% |
IN73 135
OUT41 278 |
| ✓ |
LcbGcdTraversalLiveCodeBench / leetcode / hard: greatest-common-divisor-traversal (LCB 2827)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 169
OUT16 199 |
| ✓ |
LcbIsFascinatingLiveCodeBench / leetcode / easy: check-if-the-number-is-fascinating (LCB 2824)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 136
OUT711 |
| ! |
LcbKAvoidingArrayLiveCodeBench / leetcode / medium: determine-the-minimum-sum-of-a-k-avoiding-array (LCB 2811)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 123
OUT14 963 |
| ✓ |
LcbMaxAchievableNumberLiveCodeBench / leetcode / easy: find-the-maximum-achievable-number (LCB 2812)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 137
OUT752 |
| ✓ |
LcbMinCostEqualCharsLiveCodeBench / leetcode / medium: minimum-cost-to-make-all-characters-equal (LCB 2817)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 165
OUT5 426 |
| ✓ |
LcbMinimizeStringLengthLiveCodeBench / leetcode / easy: minimize-string-length (LCB 2825)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 154
OUT1 421 |
| ✓ |
LcbRemoveTrailingZerosLiveCodeBench / leetcode / easy: remove-trailing-zeros-from-a-string (LCB 2819)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 107
OUT400 |
| ✓ |
LcbSmallestPalindromeLiveCodeBench / leetcode / easy: lexicographically-smallest-palindrome (LCB 2816)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 144
OUT1 406 |
Code Generation - LiveCodeBench v1 LeetCode (set 4)
9 passed |
100.0% |
IN82 989
OUT46 082 |
| ✓ |
LcbBeautifulPairsLiveCodeBench / leetcode / easy: number-of-beautiful-pairs (id 2831)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 189
OUT2 270 |
| ✓ |
LcbCountZeroRequestServersLiveCodeBench / leetcode / medium: count-zero-request-servers (id 2833)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 288
OUT17 114 |
| ✓ |
LcbLongestEqualSubarrayLiveCodeBench / leetcode / medium: find-the-longest-equal-subarray (id 2832)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 193
OUT2 492 |
| ✓ |
LcbMakeIntegerZeroLiveCodeBench / leetcode / medium: minimum-operations-to-make-the-integer-zero (id 2837)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 180
OUT5 928 |
| ✓ |
LcbMaximumSumQueriesLiveCodeBench / leetcode / hard: maximum-sum-queries (id 2839)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 340
OUT9 379 |
| ✓ |
LcbRelocateMarblesLiveCodeBench / leetcode / medium: relocate-marbles (id 2834)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 266
OUT1 918 |
| ✓ |
LcbSmallestStringOpLiveCodeBench / leetcode / medium: lexicographically-smallest-string-after-substring-operation (id 2828)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 205
OUT2 872 |
| ✓ |
LcbSumOfSquaresSpecialLiveCodeBench / leetcode / easy: sum-of-squares-of-special-elements (id 2844)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 154
OUT975 |
| ✓ |
LcbValueOfPartitionLiveCodeBench / leetcode / medium: find-the-value-of-the-partition (id 2845)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 174
OUT3 134 |
Code Generation - LiveCodeBench v1 LeetCode (set 5)
8 passed1 failed |
88.9% |
IN82 898
OUT132 929 |
| ✓ |
LcbCountCompleteSubarraysLiveCodeBench / leetcode / medium: count-complete-subarrays-in-an-array (id 2856)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 159
OUT3 833 |
| ✓ |
LcbDecrementalConcatLiveCodeBench / leetcode / medium: decremental-string-concatenation (id 2854)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 271
OUT14 573 |
| ✓ |
LcbLongestEvenOddThresholdLiveCodeBench / leetcode / easy: longest-even-odd-subarray-with-threshold (id 2866)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 243
OUT3 528 |
| ✓ |
LcbLongestNewStringLiveCodeBench / leetcode / medium: construct-the-longest-new-string (id 2850)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 195
OUT6 016 |
| ✓ |
LcbMaximumJumpsLiveCodeBench / leetcode / medium: maximum-number-of-jumps-to-reach-the-last-index (id 2855)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 242
OUT10 824 |
| ✓ |
LcbMaxStringPairsLiveCodeBench / leetcode / easy: find-maximum-number-of-string-pairs (id 2847)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 193
OUT1 221 |
| × |
LcbSpecialPermutationsLiveCodeBench / leetcode / medium: special-permutations (id 2848)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: specialPerm case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
51:39: Cannot call method 'Add' on nullable type 'List<bool>?'. Check it with '!= null' first.
52:9: Type 'List<bool>?' cannot be assigned by index. Only List and Dictionary elements can be assigned.
54:10: Cannot call method 'Add' on nullable type 'List<int>?'. Check it with '!= null' first.
56:17: Cannot access field 'Count' on nullable type 'List<int>?'. Check it with '!= null' first.
58:25: Cannot index nullable type 'List<int>?'. Check it with '!= null' first.
58:31: Cannot access field 'Count' on nullable type 'List<int>?'. Check it with '!= null' first.
59:14: Cannot call method 'RemoveAt' on nullable type 'List<int>?'. Check it with '!= null' first.
59:29: Cannot access field 'Count' on nullable type 'List<int>?'. Check it with '!= null' first.
64:22: Cannot index nullable type 'List<bool>?'. Check it with '!= null' first.
66:21: Type 'List<bool>?' cannot be assigned by index. Only List and Dictionary elements can be assigned.
67:22: Cannot call method 'Add' on nullable type 'List<int>?'. Check it with '!= null' first.
77:9: Type 'List<int>?' cannot be assigned by index. Only List and Dictionary elements can be assigned.
80:13: Type 'List<int>?' cannot be assigned by index. Only List and Dictionary elements can be assigned.
83:17: Type 'List<int>?' cannot be assigned by index. Only List and Dictionary elements can be assigned.
83:38: Cannot index nullable type 'List<int>?'. Check it with '!= null' first.
83:71: Cannot index nullable type 'List<int>?'. Check it with '!= null' first.
105:27: Cannot index nullable type 'List<int>?'. Check it with '!= null' first.
Values:
run.Compiled = false |
Failed |
IN9 176
OUT50 084 |
| ✓ |
LcbSumImbalanceNumbersLiveCodeBench / leetcode / hard: sum-of-imbalance-numbers-of-all-subarrays (id 2849)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 198
OUT37 208 |
| ✓ |
LcbTotalDistanceTraveledLiveCodeBench / leetcode / easy: total-distance-traveled (id 2857)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 221
OUT5 642 |
Code Generation - LiveCodeBench v1 LeetCode (set 6)
8 passed |
100.0% |
IN73 668
OUT72 340 |
| ✓ |
LcbContinuousSubarraysLiveCodeBench / leetcode / medium: continuous-subarrays (id 2868)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 184
OUT16 152 |
| ✓ |
LcbEmployeesMetTargetLiveCodeBench / leetcode / easy: number-of-employees-who-met-the-target (id 2876)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 198
OUT179 |
| ✓ |
LcbGoodSubarraySplitsLiveCodeBench / leetcode / medium: ways-to-split-array-into-good-subarrays (id 2867)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 179
OUT1 478 |
| ✓ |
LcbLongestAlternatingLiveCodeBench / leetcode / easy: longest-alternating-subarray (id 2870)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 263
OUT6 720 |
| ✓ |
LcbLongestNonDecreasingLiveCodeBench / leetcode / medium: longest-non-decreasing-subarray-from-two-arrays (id 2869)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 262
OUT1 910 |
| ✓ |
LcbMaxArrayValueMergeLiveCodeBench / leetcode / medium: largest-element-in-an-array-after-merge-operations (id 2872)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 191
OUT5 404 |
| ✓ |
LcbPrimePairsSumLiveCodeBench / leetcode / medium: prime-pairs-with-target-sum (id 2873)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 193
OUT2 394 |
| ✓ |
LcbShortestThreeStringsLiveCodeBench / leetcode / medium: shortest-string-that-contains-three-strings (id 2877)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 198
OUT38 103 |
Code Generation - LiveCodeBench v1 LeetCode (set 7)
9 passed |
100.0% |
IN82 426
OUT182 212 |
| ✓ |
LcbCheckArrayZeroableLiveCodeBench / leetcode / medium: apply-operations-to-make-all-array-elements-equal-to-zero (id 2878)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 153
OUT3 422 |
| ✓ |
LcbFaultyKeyboardLiveCodeBench / leetcode / easy: faulty-keyboard (id 2886)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 113
OUT4 772 |
| ✓ |
LcbLongestValidSubstringForbiddenLiveCodeBench / leetcode / hard: length-of-the-longest-valid-substring (id 2884)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 137
OUT50 241 |
| ✓ |
LcbMinBeautifulSubstringsLiveCodeBench / leetcode / medium: partition-string-into-minimum-beautiful-substrings (id 2883)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 147
OUT50 436 |
| ✓ |
LcbMinChangesKSemiPalindromesLiveCodeBench / leetcode / hard: minimum-changes-to-make-k-semi-palindromes (id 2879)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 176
OUT56 551 |
| ✓ |
LcbMinIndexValidSplitLiveCodeBench / leetcode / medium: minimum-index-of-a-valid-split (id 2888)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 211
OUT4 214 |
| ✓ |
LcbSortVowelsInStringLiveCodeBench / leetcode / medium: sort-vowels-in-a-string (id 2887)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 139
OUT1 960 |
| ✓ |
LcbSplitWordsBySeparatorLiveCodeBench / leetcode / easy: split-strings-by-separator (id 2881)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 177
OUT791 |
| ✓ |
LcbWaysSumOfPowersLiveCodeBench / leetcode / medium: ways-to-express-an-integer-as-sum-of-powers (id 2882)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 173
OUT9 825 |
Code Generation - LiveCodeBench v1 LeetCode (set 8)
9 passed |
100.0% |
IN82 550
OUT77 996 |
| ✓ |
LcbCanSplitArrayMLiveCodeBench / leetcode / medium: check-if-it-is-possible-to-split-array (id 2916)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 197
OUT8 874 |
| ✓ |
LcbCountInterestingSubarraysLiveCodeBench / leetcode / medium: count-of-interesting-subarrays (id 2915)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 184
OUT29 390 |
| ✓ |
LcbCountPairsSumLessTargetLiveCodeBench / leetcode / easy: count-pairs-whose-sum-is-less-than-target (id 2917)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 144
OUT960 |
| ✓ |
LcbIsArrayGoodLiveCodeBench / leetcode / easy: check-if-array-is-good (id 2892)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 192
OUT3 090 |
| ✓ |
LcbMaxBeautyAfterOpLiveCodeBench / leetcode / medium: maximum-beauty-of-an-array-after-applying-operation (id 2891)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 177
OUT963 |
| ✓ |
LcbMaxIncreasingGroupsLiveCodeBench / leetcode / hard: maximum-number-of-groups-with-increasing-length (id 2919)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 171
OUT19 447 |
| ✓ |
LcbMaxPairSumEqualDigitLiveCodeBench / leetcode / easy: max-pair-sum-in-an-array (id 2902)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 137
OUT3 239 |
| ✓ |
LcbMaxScoreVisitPositionsLiveCodeBench / leetcode / medium: visit-array-positions-to-maximize-score (id 2893)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 184
OUT7 803 |
| ✓ |
LcbMinSecondsCircularEqualLiveCodeBench / leetcode / medium: minimum-seconds-to-equalize-a-circular-array (id 2920)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 164
OUT4 230 |
Code Generation - LiveCodeBench v1 LeetCode (set 9)
8 passed |
100.0% |
IN73 467
OUT142 371 |
| ✓ |
LcbAccountBalanceRoundedLiveCodeBench / leetcode / easy: account-balance-after-rounded-purchase (id 2955)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 150
OUT349 |
| ✓ |
LcbCountPairsDistanceKLiveCodeBench / leetcode / medium: count-pairs-of-points-with-distance-k (id 2953)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 204
OUT39 946 |
| ✓ |
LcbCountSteppingNumbersLiveCodeBench / leetcode / hard: count-stepping-numbers-in-range (id 2921)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 156
OUT26 197 |
| ✓ |
LcbCountSymmetricIntegersLiveCodeBench / leetcode / easy: count-symmetric-integers (id 2998)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 149
OUT13 025 |
| ✓ |
LcbIsAcronymOfWordsLiveCodeBench / leetcode / easy: check-if-a-string-is-an-acronym-of-words (id 2977)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 163
OUT504 |
| ✓ |
LcbMaximizeSalesmanProfitLiveCodeBench / leetcode / medium: maximize-the-profit-as-the-salesman (id 2979)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 213
OUT22 449 |
| ✓ |
LcbMaxSumAlmostUniqueLiveCodeBench / leetcode / medium: maximum-sum-of-almost-unique-subarray (id 2954)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 208
OUT3 931 |
| ✓ |
LcbMinTimeSumAtMostXLiveCodeBench / leetcode / hard: minimum-time-to-make-array-sum-at-most-x (id 2952)1 AI query
0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 224
OUT35 970 |
Code Generation - LiveCodeBench v2 AtCoder (set 1)
5 passed2 failed1 broken |
62.5% |
IN73 800
OUT158 032 |
| ✓ |
LcbABCSumQueryLiveCodeBench / atcoder abc344_c / medium: A+B+C (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 261
OUT31 320 |
| ✓ |
LcbCeilDivTenLiveCodeBench / atcoder abc345_b / easy: Integer Division Returns (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 147
OUT733 |
| ✓ |
LcbDelimiterReverseLiveCodeBench / atcoder abc344_b / easy: Delimiter (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 194
OUT610 |
| ✓ |
LcbGomamayoSequenceLiveCodeBench / atcoder abc346_d / medium: Gomamayo Sequence (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 257
OUT8 237 |
| × |
LcbInsertOrEraseLiveCodeBench / atcoder abc344_e / hard: Insert or Erase (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: InsertOrErase case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
79:19: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first.
105:19: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first.
107:23: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first.
121:19: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first.
123:23: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first.
146:15: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first.
Values:
run.Compiled = false |
Failed |
IN9 249
OUT9 211 |
| ✓ |
LcbSpoilerRemoveLiveCodeBench / atcoder abc344_a / easy: Spoiler (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 149
OUT432 |
| × |
LcbStringBagsLiveCodeBench / atcoder abc344_d / hard: String Bags (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: StringBags case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
282:25: The if condition must be 'bool', but it has type 'void'.
Values:
run.Compiled = false |
Failed |
IN9 297
OUT45 345 |
| ! |
LcbTilingGridLiveCodeBench / atcoder abc345_d / hard: Tiling (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 246
OUT62 144 |
Code Generation - LiveCodeBench v2 AtCoder (set 2)
5 passed1 failed1 broken |
71.4% |
IN64 475
OUT94 699 |
| ✓ |
LcbAdjacentProductLiveCodeBench / atcoder abc346_a / easy: Adjacent Product (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 172
OUT2 362 |
| ✓ |
LcbDivisibleQuotientsLiveCodeBench / atcoder abc347_a / easy: Divisible (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 182
OUT2 284 |
| ✓ |
LcbIdealHolidaysLiveCodeBench / atcoder abc347_c / medium: Ideal Holidays (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 218
OUT12 565 |
| × |
LcbPaintGridLiveCodeBench / atcoder abc346_e / hard: Paint (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: PaintGrid case0: expected [3
0 5
2 4
5 3] got [30 5
2 4
5 3] |
Failed |
IN9 303
OUT16 097 |
| ✓ |
LcbPianoSubstringLiveCodeBench / atcoder abc346_b / easy: Piano (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 188
OUT26 368 |
| ✓ |
LcbSetAddQueryLiveCodeBench / atcoder abc347_e / hard: Set Add Query (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 247
OUT22 521 |
| ! |
LcbSigmaMissingSumLiveCodeBench / atcoder abc346_c / medium: Sigma (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 165
OUT12 502 |
Code Generation - LiveCodeBench v2 AtCoder (set 3)
7 passed1 failed |
87.5% |
IN74 415
OUT59 365 |
| ✓ |
LcbAirportCodeLiveCodeBench / atcoder / abc349_c: Airport Code (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 290
OUT3 525 |
| ✓ |
LcbColorfulBeansLiveCodeBench / atcoder / abc348_c: Colorful Beans (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 279
OUT3 857 |
| ✓ |
LcbDistinctSubstringsLiveCodeBench / atcoder / abc347_b: Substring (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 190
OUT501 |
| ✓ |
LcbFarthestPointLiveCodeBench / atcoder / abc348_b: Farthest Point (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 331
OUT1 886 |
| × |
LcbMedicinesOnGridLiveCodeBench / atcoder / abc348_d: Medicines on Grid (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: MedicinesOnGrid case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
103:36: Expected ']' to close the indexer, found '++'.
Values:
run.Compiled = false |
Failed |
IN9 510
OUT42 272 |
| ✓ |
LcbMinimizeSumOfDistancesLiveCodeBench / atcoder / abc348_e: Minimize Sum of Distances (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 321
OUT5 849 |
| ✓ |
LcbPenaltyKickLiveCodeBench / atcoder / abc348_a: Penalty Kick (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 224
OUT445 |
| ✓ |
LcbZeroSumGameLiveCodeBench / atcoder / abc349_a: Zero Sum Game (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 270
OUT1 030 |
Code Generation - LiveCodeBench v2 AtCoder (set 4)
5 passed2 skipped |
100.0% |
IN46 649
OUT30 001 |
| ✓ |
LcbCommencementLiveCodeBench / atcoder / abc349_b: Commencement (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 213
OUT3 159 |
| ✓ |
LcbDentistAokiLiveCodeBench / atcoder / abc350_b: Dentist Aoki (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 277
OUT821 |
| ✓ |
LcbDivideIntervalLiveCodeBench / atcoder / abc349_d: Divide Interval (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 411
OUT10 803 |
| ✓ |
LcbPastABCsLiveCodeBench / atcoder / abc350_a: Past ABCs (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 295
OUT812 |
| – |
LcbSortPermutationLiveCodeBench / atcoder / abc350_c: Sort (Pattern B, stdin) TRIAGE: 0 public tests in dump + non-unique output (any valid swap sequence accepted) — cannot oracle-compare.0 AI queries
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: no public tests in dump; output non-unique (any valid swap sequence is accepted) — exact-compare oracle inapplicable, coordinator triage |
Skipped |
IN0
OUT0 |
| – |
LcbTowardZeroLiveCodeBench / atcoder / abc350_e: Toward 0 (Pattern B, stdin) TRIAGE: float output (absolute/relative error <= 1e-6) — RunLcbStdin does exact string compare; needs tolerance.0 AI queries
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: float output requires error tolerance (<=1e-6); RunLcbStdin does exact string compare — coordinator triage |
Skipped |
IN0
OUT0 |
| ✓ |
LcbWeightedTicLiveCodeBench / atcoder / abc349_e: Weighted Tic (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 453
OUT14 406 |
Code Generation - LiveCodeBench v2 AtCoder (set 5)
8 passed |
100.0% |
IN74 244
OUT126 484 |
| ✓ |
LcbBottomNinthLiveCodeBench / atcoder / abc351_a: The bottom of the ninth (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 328
OUT1 145 |
| ✓ |
LcbCliqueConnectLiveCodeBench / atcoder / abc352_e: Clique Connect (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 339
OUT32 157 |
| ✓ |
LcbDoubleSumMaxDiffLiveCodeBench / atcoder / abc351_f: Double Sum (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 191
OUT31 147 |
| ✓ |
LcbGridAndMagnetLiveCodeBench / atcoder / abc351_d: Grid and Magnet (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 294
OUT19 871 |
| ✓ |
LcbJumpDistanceSumLiveCodeBench / atcoder / abc351_e: Jump Distance Sum (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 295
OUT15 353 |
| ✓ |
LcbMergeTheBallsLiveCodeBench / atcoder / abc351_c: Merge the balls (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 273
OUT9 736 |
| ✓ |
LcbNewFriendsLiveCodeBench / atcoder / abc350_d: New Friends (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 222
OUT16 486 |
| ✓ |
LcbSpotTheDifferenceLiveCodeBench / atcoder / abc351_b: Spot the Difference (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 302
OUT589 |
Code Generation - LiveCodeBench v2 AtCoder (set 6)
6 passed1 failed |
85.7% |
IN64 827
OUT60 501 |
| ✓ |
LcbAmusementParkLiveCodeBench / atcoder / abc353_b: AtCoder Amusement Park (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 284
OUT1 784 |
| ✓ |
LcbAtcoderLineLiveCodeBench / atcoder / abc352_a: AtCoder Line (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 237
OUT2 233 |
| ✓ |
LcbBuildingsTallerLiveCodeBench / atcoder / abc353_a: Buildings (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 211
OUT6 672 |
| × |
LcbPermutationSubsequenceLiveCodeBench / atcoder / abc352_d: Permutation Subsequence (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: PermutationSubsequence case0: expected [1] got [2147483647] |
Failed |
IN9 299
OUT13 959 |
| ✓ |
LcbSigmaRemainderSumLiveCodeBench / atcoder / abc353_c: Sigma Problem (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 217
OUT15 515 |
| ✓ |
LcbStandingOnShouldersLiveCodeBench / atcoder / abc352_c: Standing On The Shoulders (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 310
OUT7 528 |
| ✓ |
LcbTypingBackspaceLiveCodeBench / atcoder / abc352_b: Typing (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 269
OUT12 810 |
Code Generation - LiveCodeBench v2 AtCoder (set 7)
5 passed1 failed |
83.3% |
IN55 846
OUT31 473 |
| × |
LcbAnotherSigmaProblemLiveCodeBench / atcoder / abc353_d: Another Sigma Problem (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: AnotherSigmaProblem case0 runtime error: List index 3 is out of range. The list has 3 element(s).
Values:
run.Success = false |
Failed |
IN9 318
OUT3 735 |
| ✓ |
LcbAtcoderJanken2LiveCodeBench / atcoder / abc354_b: AtCoder Janken 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 302
OUT1 489 |
| ✓ |
LcbAtcoderMagicsLiveCodeBench / atcoder / abc354_c: AtCoder Magics (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 371
OUT7 805 |
| ✓ |
LcbExponentialPlantLiveCodeBench / atcoder / abc354_a: Exponential Plant (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 255
OUT1 191 |
| ✓ |
LcbRemovePairsLiveCodeBench / atcoder / abc354_e: Remove Pairs (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 348
OUT10 817 |
| ✓ |
LcbYetAnotherSigmaProblemLiveCodeBench / atcoder / abc353_e: Yet Another Sigma Problem (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 252
OUT6 436 |
Code Generation - LiveCodeBench v2 AtCoder (set 8)
4 passed1 failed1 skipped |
80.0% |
IN46 523
OUT38 627 |
| ✓ |
LcbAtcoderWallpaperLiveCodeBench / atcoder / abc354_d: AtCoder Wallpaper (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 363
OUT23 362 |
| ✓ |
LcbBingo2LiveCodeBench / atcoder / abc355_c: Bingo 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 376
OUT6 012 |
| – |
LcbGuessTheSumLiveCodeBench / atcoder / abc355_e: Guess the Sum (Pattern B, stdin) — INTERACTIVE, cannot run in the batch harness0 AI queries
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: SC# subset: interactive problem (adaptive query/response dialogue; not expressible as a single stdin->stdout Solve) |
Skipped |
IN0
OUT0 |
| ✓ |
LcbIntersectingIntervalsLiveCodeBench / atcoder / abc355_d: Intersecting Intervals (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 233
OUT5 957 |
| × |
LcbPiano2LiveCodeBench / atcoder / abc355_b: Piano 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: Piano2 case0 runtime error: List index 5 is out of range. The list has 5 element(s).
Values:
run.Success = false |
Failed |
IN9 301
OUT2 355 |
| ✓ |
LcbWhoAteTheCakeLiveCodeBench / atcoder / abc355_a: Who Ate the Cake? (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 250
OUT941 |
Code Generation - LiveCodeBench v2 LeetCode (set 1)
8 passed1 broken |
88.9% |
IN82 567
OUT140 746 |
| ✓ |
LcbCountSubstringsStartEndCharLiveCodeBench / leetcode / medium: count-substrings-starting-and-ending-with-given-character (LCB 3337)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 103
OUT506 |
| ✓ |
LcbMaximumHappinessSumLiveCodeBench / leetcode / medium: maximize-happiness-of-selected-children (LCB 3351)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 198
OUT734 |
| ✓ |
LcbMaximumStrengthSubarraysLiveCodeBench / leetcode / hard: maximum-strength-of-k-disjoint-subarrays (LCB 3313)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 253
OUT32 058 |
| ✓ |
LcbMaxLengthTwoOccurrencesLiveCodeBench / leetcode / easy: maximum-length-substring-with-two-occurrences (LCB 3349)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 085
OUT2 478 |
| ✓ |
LcbMinDeletionsKSpecialLiveCodeBench / leetcode / medium: minimum-deletions-to-make-string-k-special (LCB 3360)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 158
OUT3 751 |
| ✓ |
LcbMinimumBoxesApplesLiveCodeBench / leetcode / easy: apple-redistribution-into-boxes (LCB 3334)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 188
OUT1 162 |
| ✓ |
LcbMinMovesPickKOnesLiveCodeBench / leetcode / hard: minimum-moves-to-pick-k-ones (LCB 3327)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 312
OUT35 617 |
| ! |
LcbShortestUncommonSubstringsLiveCodeBench / leetcode / medium: shortest-uncommon-substring-in-an-array (LCB 3356)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 166
OUT62 144 |
| ✓ |
LcbSubstringInReverseLiveCodeBench / leetcode / easy: existence-of-a-substring-in-a-string-and-its-reverse (LCB 3353)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 104
OUT2 296 |
Code Generation - LiveCodeBench v2 LeetCode (set 2)
9 passed |
100.0% |
IN82 464
OUT42 289 |
| ✓ |
LcbCountAlternatingSubarraysLiveCodeBench / leetcode / medium: count-alternating-subarrays (LCB 3374)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 116
OUT551 |
| ✓ |
LcbHarshadDigitSumLiveCodeBench / leetcode / easy: harshad-number (LCB 3371)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 115
OUT782 |
| ✓ |
LcbLexSmallestWithinDistanceLiveCodeBench / leetcode / medium: lexicographically-smallest-string-after-operations-with-constraint (LCB 3346)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 211
OUT4 064 |
| ✓ |
LcbLongestCommonSuffixQueriesLiveCodeBench / leetcode / hard: longest-common-suffix-queries (LCB 3376)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 210
OUT8 515 |
| ✓ |
LcbLongestMonotonicSubarrayLiveCodeBench / leetcode / easy: longest-strictly-increasing-or-decreasing-subarray (LCB 3372)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 124
OUT1 963 |
| ✓ |
LcbMinimizeManhattanDistanceLiveCodeBench / leetcode / hard: minimize-manhattan-distances (LCB 3344)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 147
OUT9 067 |
| ✓ |
LcbMinOpsMedianKLiveCodeBench / leetcode / medium: minimum-operations-to-make-median-of-array-equal-to-k (LCB 3387)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 187
OUT4 458 |
| ✓ |
LcbMinOpsSumAtLeastKLiveCodeBench / leetcode / medium: apply-operations-to-make-sum-of-array-ge-k (LCB 3328)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 142
OUT6 297 |
| ✓ |
LcbMostFrequentIdsLiveCodeBench / leetcode / medium: most-frequent-ids (LCB 3363)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 212
OUT6 592 |
Code Generation - LiveCodeBench v2 LeetCode (set 3)
9 passed |
100.0% |
IN82 814
OUT191 516 |
| ✓ |
LcbKthSmallestAmountLiveCodeBench 3375 / leetcode / hard: kth-smallest-amount-with-single-denomination-combination (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 187
OUT44 044 |
| ✓ |
LcbLatestTimeReplaceLiveCodeBench 3361 / leetcode / easy: latest-time-you-can-obtain-after-replacing-characters (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 211
OUT2 325 |
| ✓ |
LcbMaximumPrimeDifferenceLiveCodeBench 3373 / leetcode / medium: maximum-prime-difference (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 156
OUT4 751 |
| ✓ |
LcbMinimizeStringValueLiveCodeBench 3354 / leetcode / medium: replace-question-marks-in-string-to-minimize-its-value (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 223
OUT26 497 |
| ✓ |
LcbMinSumValuesDividingLiveCodeBench 3364 / leetcode / hard: minimum-sum-of-values-by-dividing-array (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 275
OUT58 902 |
| ✓ |
LcbShortestSubarrayOrKLiveCodeBench 3381 / leetcode / easy: shortest-subarray-with-or-at-least-k-i (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 179
OUT3 846 |
| ✓ |
LcbSumOfEncryptedIntsLiveCodeBench 3367 / leetcode / easy: find-the-sum-of-encrypted-integers (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 157
OUT698 |
| ✓ |
LcbSumOfPowerSubsequencesLiveCodeBench 3345 / leetcode / hard: find-the-sum-of-the-power-of-all-subsequences (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 172
OUT42 986 |
| ✓ |
LcbUnmarkedSumArrayLiveCodeBench 3306 / leetcode / medium: mark-elements-on-array-by-performing-queries (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 254
OUT7 467 |
Code Generation - LiveCodeBench v2 LeetCode (set 4)
8 passed1 broken |
88.9% |
IN82 569
OUT91 577 |
| ✓ |
LcbAddedIntegerLiveCodeBench 3397 / leetcode / easy: find-the-integer-added-to-array-i (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 200
OUT673 |
| ✓ |
LcbMedianUniquenessArrayLiveCodeBench 3362 / leetcode / hard: find-the-median-of-the-uniqueness-array (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 220
OUT4 659 |
| ✓ |
LcbMinimumArrayEndLiveCodeBench 3394 / leetcode / medium: minimum-array-end (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 164
OUT8 290 |
| ✓ |
LcbMinimumLevelsGainPointsLiveCodeBench 3355 / leetcode / medium: minimum-levels-to-gain-more-points (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 223
OUT1 367 |
| ✓ |
LcbNumberOfSpecialCharsLiveCodeBench 3408 / leetcode / easy: count-the-number-of-special-characters-i (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 119
OUT1 039 |
| ✓ |
LcbScoreOfStringLiveCodeBench 3379 / leetcode / easy: score-of-a-string (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 170
OUT379 |
| ✓ |
LcbSubarraysBoundaryMaxLiveCodeBench 3382 / leetcode / hard: find-the-number-of-subarrays-where-boundary-elements-are-maximum (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 125
OUT12 190 |
| ! |
LcbSumOfSubsequencePowersLiveCodeBench 3316 / leetcode / hard: find-the-sum-of-subsequence-powers (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 180
OUT62 144 |
| ✓ |
LcbValidWordLiveCodeBench 3396 / leetcode / easy: valid-word (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 168
OUT836 |
Code Generation - LiveCodeBench v2 LeetCode (set 5)
9 passed |
100.0% |
IN82 705
OUT61 954 |
| ✓ |
LcbCanMakeSquareColorLiveCodeBench / leetcode / easy: make-a-square-with-the-same-color1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 215
OUT1 122 |
| ✓ |
LcbIsArraySpecialILiveCodeBench / leetcode / easy: special-array-i1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 125
OUT503 |
| ✓ |
LcbMakeWordKPeriodicLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-word-k-periodic1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 195
OUT1 780 |
| ✓ |
LcbMinAnagramLengthLiveCodeBench / leetcode / medium: minimum-length-of-anagram-concatenation1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 129
OUT8 004 |
| ✓ |
LcbMinCostEqualizeArrayLiveCodeBench / leetcode / hard: minimum-cost-to-equalize-array1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 259
OUT33 707 |
| ✓ |
LcbMysticDungeonEnergyLiveCodeBench / leetcode / medium: taking-maximum-energy-from-the-mystic-dungeon1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 186
OUT3 921 |
| ✓ |
LcbNumberOfRightTrianglesLiveCodeBench / leetcode / medium: right-triangles1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 221
OUT3 262 |
| ✓ |
LcbNumberOfStableArraysLiveCodeBench / leetcode / medium: find-all-possible-stable-binary-arrays-i1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 215
OUT9 285 |
| ✓ |
LcbPermutationDifferenceLiveCodeBench / leetcode / easy: permutation-difference-between-two-strings1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 160
OUT370 |
Code Generation - LiveCodeBench v2 LeetCode (set 6)
8 passed1 broken |
88.9% |
IN82 699
OUT194 323 |
| ✓ |
LcbMaxSumNonAdjacentQueriesLiveCodeBench / leetcode / hard: maximum-sum-of-subsequence-with-non-adjacent-elements1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 226
OUT26 879 |
| ! |
LcbMinBalancedPartitionLiveCodeBench / leetcode / medium: minimum-substring-partition-of-equal-character-frequency1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 123
OUT62 144 |
| ✓ |
LcbNumberOfGoodPairsILiveCodeBench / leetcode / easy: find-the-number-of-good-pairs-i1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 205
OUT37 960 |
| ✓ |
LcbOccurrencesOfElementLiveCodeBench / leetcode / medium: find-occurrences-of-an-element-in-an-array1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 203
OUT643 |
| ✓ |
LcbProductsBigArrayLiveCodeBench / leetcode / hard: find-products-of-elements-of-big-array1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 308
OUT43 932 |
| ✓ |
LcbStringCompressionIIILiveCodeBench / leetcode / medium: string-compression-iii1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 147
OUT1 024 |
| ✓ |
LcbSumDigitDifferencesLiveCodeBench / leetcode / medium: sum-of-digit-differences-of-all-pairs1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 145
OUT1 882 |
| ✓ |
LcbWaysToReachStairLiveCodeBench / leetcode / hard: find-number-of-ways-to-reach-the-k-th-stair1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 202
OUT18 480 |
| ✓ |
LcbXorAppearingTwiceLiveCodeBench / leetcode / easy: find-the-xor-of-numbers-which-appear-twice1 AI query
0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 140
OUT1 379 |
Code Generation - LiveCodeBench v3 AtCoder (set 1)
6 passed1 failed |
85.7% |
IN64 940
OUT38 442 |
| ✓ |
LcbKeysCombinationsLiveCodeBench / atcoder / medium: abc356_c Keys (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 390
OUT4 344 |
| ✓ |
LcbMaskedPopcountLiveCodeBench / atcoder / medium: abc356_d Masked Popcount (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 227
OUT3 815 |
| × |
LcbMaxMinFloorSumLiveCodeBench / atcoder / hard: abc356_e Max/Min (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: MaxMinFloorSum case0 runtime error: The script exceeded the timeout of 30000 ms.
Values:
run.Success = false |
Failed |
IN9 214
OUT24 576 |
| ✓ |
LcbNutrientsLiveCodeBench / atcoder / easy: abc356_b Nutrients (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 291
OUT1 757 |
| ✓ |
LcbSanitizeHandsLiveCodeBench / atcoder / easy: abc357_a Sanitize Hands (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 266
OUT806 |
| ✓ |
LcbSierpinskiCarpetLiveCodeBench / atcoder / medium: abc357_c Sierpinski carpet (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 319
OUT2 049 |
| ✓ |
LcbSubsegmentReverseLiveCodeBench / atcoder / easy: abc356_a Subsegment Reverse (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 233
OUT1 095 |
Code Generation - LiveCodeBench v3 AtCoder (set 2)
7 passed |
100.0% |
IN65 004
OUT53 350 |
| ✓ |
LcbAlphabetTilesLiveCodeBench / atcoder / hard: abc358_e Alphabet Tiles (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 287
OUT33 754 |
| ✓ |
LcbConcatModuloLiveCodeBench / atcoder / medium: abc357_d 88888888 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 278
OUT4 474 |
| ✓ |
LcbFunctionalGraphReachLiveCodeBench / atcoder / hard: abc357_e Reachability in Functional Graph (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 266
OUT7 095 |
| ✓ |
LcbPopcornStandsLiveCodeBench / atcoder / medium: abc358_c Popcorn (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 290
OUT3 117 |
| ✓ |
LcbSouvenirsLiveCodeBench / atcoder / medium: abc358_d Souvenirs (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 333
OUT2 463 |
| ✓ |
LcbTicketCounterLiveCodeBench / atcoder / easy: abc358_b Ticket Counter (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 331
OUT1 607 |
| ✓ |
LcbUppercaseLowercaseLiveCodeBench / atcoder / easy: abc357_b Uppercase and Lowercase (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 219
OUT840 |
Code Generation - LiveCodeBench v3 AtCoder (set 3)
3 passed1 failed3 broken |
42.9% |
IN64 621
OUT164 353 |
| ! |
LcbAvoidKPalindromeLiveCodeBench / atcoder abc359_d / hard: Avoid K Palindrome (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 221
OUT62 144 |
| × |
LcbCountTakahashiLiveCodeBench / atcoder abc359_a / easy: Count Takahashi (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: CountTakahashi case0: expected [2] got [1] |
Failed |
IN9 177
OUT389 |
| ✓ |
LcbCouplesBetweenLiveCodeBench / atcoder abc359_b / easy: Couples (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 190
OUT1 406 |
| ✓ |
LcbMoveItBoxesLiveCodeBench / atcoder abc360_c / medium: Move It (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 230
OUT15 467 |
| ! |
LcbTileDistance2TollLiveCodeBench / atcoder abc359_c / medium: Tile Distance 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 320
OUT21 980 |
| ! |
LcbWaterTankFillLiveCodeBench / atcoder abc359_e / hard: Water Tank (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 317
OUT62 144 |
| ✓ |
LcbWelcomeAtCoderLandLiveCodeBench / atcoder abc358_a / easy: Welcome to AtCoder Land (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 166
OUT823 |
Code Generation - LiveCodeBench v3 AtCoder (set 4)
4 passed3 broken |
57.1% |
IN64 699
OUT188 949 |
| ✓ |
LcbGhostAntsPassLiveCodeBench / atcoder abc360_d / medium: Ghost Ants (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 300
OUT21 323 |
| ! |
LcbGoStonePuzzleLiveCodeBench / atcoder abc361_d / hard: Go Stone Puzzle (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 286
OUT62 144 |
| ✓ |
LcbHealthyBreakfastLiveCodeBench / atcoder abc360_a / easy: A Healthy Breakfast (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 226
OUT480 |
| ✓ |
LcbInsertAfterKLiveCodeBench / atcoder abc361_a / easy: Insert (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 175
OUT3 091 |
| ! |
LcbIntersectCuboidsLiveCodeBench / atcoder abc361_b / medium: Intersection of Cuboids (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 207
OUT14 150 |
| ✓ |
LcbRandomSwapsBallsLiveCodeBench / atcoder abc360_e / hard: Random Swaps of Balls (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 280
OUT25 617 |
| ! |
LcbVerticalReadingPairLiveCodeBench / atcoder abc360_b / easy: Vertical Reading (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 225
OUT62 144 |
Code Generation - LiveCodeBench v3 AtCoder (set 5)
6 passed1 skipped |
100.0% |
IN55 358
OUT71 269 |
| ✓ |
LcbBuyAPenLiveCodeBench / atcoder / easy: abc362_a Buy a Pen (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 203
OUT605 |
| ✓ |
LcbCountArithmeticSubsequencesLiveCodeBench / atcoder / hard: abc362_e Count Arithmetic Subsequences (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 261
OUT17 962 |
| ✓ |
LcbMakeThemNarrowLiveCodeBench / atcoder / medium: abc361_c Make Them Narrow (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 213
OUT2 343 |
| ✓ |
LcbPerfectPowerCountLiveCodeBench / atcoder / hard: abc361_f x = a^b (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 156
OUT27 980 |
| ✓ |
LcbShortestPath3LiveCodeBench / atcoder / hard: abc362_d Shortest Path 3 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 280
OUT10 605 |
| – |
LcbSumZeroSequenceLiveCodeBench / atcoder / medium: abc362_c Sum = 0 (Pattern B, stdin)0 AI queries
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbTreeHamiltonPathLiveCodeBench / atcoder / hard: abc361_e Tree and Hamilton Path 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 245
OUT11 774 |
Code Generation - LiveCodeBench v3 AtCoder (set 6)
5 passed1 failed1 skipped |
83.3% |
IN55 512
OUT106 167 |
| ✓ |
LcbAvoidKPalindrome2LiveCodeBench / atcoder / medium: abc363_c Avoid K Palindrome 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 269
OUT61 142 |
| ✓ |
LcbCursedDollLiveCodeBench / atcoder / easy: abc363_b Japanese Cursed Doll (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 239
OUT1 764 |
| ✓ |
LcbNthPalindromeLiveCodeBench / atcoder / medium: abc363_d Palindromic Number (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 179
OUT14 699 |
| – |
LcbPalindromicExpressionLiveCodeBench / atcoder / hard: abc363_f Palindromic Expression (Pattern B, stdin)0 AI queries
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbPilingUpLiveCodeBench / atcoder / easy: abc363_a Piling Up (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 259
OUT716 |
| × |
LcbRightTriangleCheckLiveCodeBench / atcoder / easy: abc362_b Right Triangle (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: RightTriangleCheck case0 runtime error: List index 4 is out of range. The list has 4 element(s).
Values:
run.Success = false |
Failed |
IN9 209
OUT2 905 |
| ✓ |
LcbSinkingLandLiveCodeBench / atcoder / hard: abc363_e Sinking Land (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 357
OUT24 941 |
Code Generation - LiveCodeBench v3 AtCoder (set 7)
3 passed3 failed |
50.0% |
IN55 525
OUT132 381 |
| × |
LcbGluttonTakahashiLiveCodeBench / atcoder / easy: Glutton Takahashi (abc364_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: GluttonTakahashi case1: expected [Yes] got [No] |
Failed |
IN9 191
OUT629 |
| ✓ |
LcbGridWalkLiveCodeBench / atcoder / easy: Grid Walk (abc364_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 371
OUT1 506 |
| ✓ |
LcbKthClosestPointLiveCodeBench / atcoder / hard: K — k-th closest point (abc364_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 272
OUT15 690 |
| × |
LcbMaximumGluttonLiveCodeBench / atcoder / hard: Maximum Glutton (abc364_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: MaximumGlutton case0 runtime error: List index 1 is out of range. The list has 1 element(s).
Values:
run.Success = false |
Failed |
IN9 234
OUT61 690 |
| ✓ |
LcbMinimumGluttonLiveCodeBench / atcoder / medium: Minimum Glutton (abc364_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 198
OUT11 809 |
| × |
LcbRangeConnectMstLiveCodeBench / atcoder / hard: Range Connect MST (abc364_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: RangeConnectMst case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
100:28: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('.
Values:
run.Compiled = false |
Failed |
IN9 259
OUT41 057 |
Code Generation - LiveCodeBench v3 AtCoder (set 8)
4 passed1 failed |
80.0% |
IN46 110
OUT37 055 |
| ✓ |
LcbAtcoderJanken3LiveCodeBench / atcoder / medium: AtCoder Janken 3 (abc365_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 267
OUT3 861 |
| ✓ |
LcbLeapYearLiveCodeBench / atcoder / easy: Leap Year (abc365_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 241
OUT327 |
| ✓ |
LcbSecondBestLiveCodeBench / atcoder / easy: Second Best (abc365_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 173
OUT2 684 |
| ✓ |
LcbTransportationExpensesLiveCodeBench / atcoder / medium: Transportation Expenses (abc365_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 233
OUT19 082 |
| × |
LcbXorSigmaProblemLiveCodeBench / atcoder / hard: Xor Sigma Problem (abc365_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: XorSigmaProblem case0: expected [3] got [3.0000000] |
Failed |
IN9 196
OUT11 101 |
Code Generation - LiveCodeBench v3 LeetCode (set 1)
7 passed1 broken |
87.5% |
IN73 377
OUT106 838 |
| ✓ |
LcbChildWithBallLiveCodeBench / leetcode / easy: find-the-child-who-has-the-ball-after-k-seconds (id 3450)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 179
OUT684 |
| ✓ |
LcbCompleteDayPairsLiveCodeBench / leetcode / easy: count-pairs-that-form-a-complete-day-i (id 3421)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 138
OUT1 557 |
| ✓ |
LcbCountDaysWithoutMeetingsLiveCodeBench / leetcode / medium: count-days-without-meetings (id 3430)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 196
OUT6 337 |
| ✓ |
LcbMaxTotalDamageLiveCodeBench / leetcode / medium: maximum-total-damage-with-spell-casting (id 3437)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 158
OUT5 517 |
| ! |
LcbMaxTotalRewardLiveCodeBench / leetcode / medium: maximum-total-reward-using-operations-i (id 3442)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 172
OUT62 144 |
| ✓ |
LcbMinimumChairsLiveCodeBench / leetcode / easy: minimum-number-of-chairs-in-a-waiting-room (id 3426)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 161
OUT236 |
| ✓ |
LcbSubarrayOrClosestKLiveCodeBench / leetcode / hard: find-subarray-with-bitwise-or-closest-to-k (id 3436)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 180
OUT2 955 |
| ✓ |
LcbValueAfterKSecondsLiveCodeBench / leetcode / medium: find-the-n-th-value-after-k-seconds (id 3422)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 193
OUT27 408 |
Code Generation - LiveCodeBench v3 LeetCode (set 2)
8 passed |
100.0% |
IN73 547
OUT27 775 |
| ✓ |
LcbEncryptedStringLiveCodeBench / leetcode / easy: find-the-encrypted-string (id 3468)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 125
OUT675 |
| ✓ |
LcbMaxTotalCostAlternatingLiveCodeBench / leetcode / medium: maximize-total-cost-of-alternating-subarrays (id 3464)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 216
OUT3 164 |
| ✓ |
LcbMaxTriangleHeightLiveCodeBench / leetcode / easy: maximum-height-of-a-triangle (id 3469)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 182
OUT7 264 |
| ✓ |
LcbMaxValidSubsequenceLiveCodeBench / leetcode / medium: find-the-maximum-length-of-valid-subsequence-i (id 3490)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 183
OUT3 209 |
| ✓ |
LcbMinDiameterMergeTreesLiveCodeBench / leetcode / hard: find-minimum-diameter-after-merging-two-trees (id 3439)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 282
OUT5 403 |
| ✓ |
LcbMinimumAreaCoverOnesLiveCodeBench / leetcode / medium: find-the-minimum-area-to-cover-all-ones-i (id 3461)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 128
OUT1 115 |
| ✓ |
LcbMinimumAverageLiveCodeBench / leetcode / easy: minimum-average-of-smallest-and-largest-elements (id 3471)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 183
OUT1 506 |
| ✓ |
LcbPeaksInArrayLiveCodeBench / leetcode / hard: peaks-in-array (id 3438)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 248
OUT5 439 |
Code Generation - LiveCodeBench v3 LeetCode (set 3)
7 passed1 skipped |
100.0% |
IN64 783
OUT44 936 |
| ✓ |
LcbBitChangesEqualLiveCodeBench / leetcode / easy: 3508 number-of-bit-changes-to-make-two-integers-equal1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 221
OUT2 310 |
| ✓ |
LcbCountEqualXYSubmatricesLiveCodeBench / leetcode / medium: 3492 count-submatrices-with-equal-frequency-of-x-and-y1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 236
OUT2 960 |
| ✓ |
LcbMaxOpsMoveOnesLiveCodeBench / leetcode / medium: 3493 maximum-number-of-operations-to-move-ones-to-the-end1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 218
OUT7 136 |
| ✓ |
LcbMinCostConstructStringLiveCodeBench / leetcode / hard: 3482 construct-string-with-minimum-cost1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 332
OUT20 518 |
| ✓ |
LcbMinCostCutCakeLiveCodeBench / leetcode / medium: 3494 minimum-cost-for-cutting-cake-i1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 348
OUT4 081 |
| ✓ |
LcbSmallestStringAfterSwapLiveCodeBench / leetcode / easy: 3484 lexicographically-smallest-string-after-a-swap1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 214
OUT2 159 |
| – |
LcbValidBinaryStringsLiveCodeBench / leetcode / medium: 3453 generate-binary-strings-without-adjacent-zeros0 AI queries
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbVowelsGameLiveCodeBench / leetcode / medium: 3462 vowels-game-in-a-string1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 214
OUT5 772 |
Code Generation - LiveCodeBench v3 LeetCode (set 4)
7 passed1 failed |
87.5% |
IN74 281
OUT112 912 |
| × |
LcbAlternatingGroupsIIILiveCodeBench / leetcode / hard: 3527 alternating-groups-iii1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: numberOfAlternatingGroups case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
244:21: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 401
OUT46 843 |
| ✓ |
LcbDigitGameWinLiveCodeBench / leetcode / easy: 3515 find-if-digit-game-can-be-won1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 255
OUT430 |
| ✓ |
LcbDominantOnesSubstringsLiveCodeBench / leetcode / medium: 3479 count-the-number-of-substrings-with-dominant-ones1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 185
OUT25 965 |
| ✓ |
LcbMinOpsArrayToTargetLiveCodeBench / leetcode / hard: 3454 minimum-operations-to-make-array-equal-to-target1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 214
OUT2 729 |
| ✓ |
LcbNonSpecialCountLiveCodeBench / leetcode / medium: 3507 find-the-count-of-numbers-which-are-not-special1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 239
OUT2 956 |
| ✓ |
LcbRectangleCornerReachableLiveCodeBench / leetcode / hard: 3478 check-if-the-rectangle-corner-is-reachable1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 390
OUT31 842 |
| ✓ |
LcbShortestDistanceQueriesLiveCodeBench / leetcode / medium: 3517 shortest-distance-after-road-addition-queries-i1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 331
OUT1 700 |
| ✓ |
LcbSnakeFinalPositionLiveCodeBench / leetcode / easy: 3533 snake-in-matrix1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 266
OUT447 |
Code Generation - LiveCodeBench v3 LeetCode (set 5)
7 passed1 broken |
87.5% |
IN73 494
OUT99 282 |
| ✓ |
LcbAlternatingGroupsCircleLiveCodeBench / leetcode / easy: alternating-groups-i (LCB id 3463)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 178
OUT2 753 |
| ✓ |
LcbClearDigitsLiveCodeBench / leetcode / easy: clear-digits (LCB id 3447)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 125
OUT1 636 |
| ! |
LcbCountInversionPermutationsLiveCodeBench / leetcode / hard: count-the-number-of-inversions (LCB id 3460)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 280
OUT62 144 |
| ✓ |
LcbCountMonotonicPairsLiveCodeBench / leetcode / hard: find-the-count-of-monotonic-pairs-i (LCB id 3535)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 242
OUT6 073 |
| ✓ |
LcbFirstPlayerWinKGamesLiveCodeBench / leetcode / medium: find-the-first-player-to-win-k-games-in-a-row (LCB id 3413)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 226
OUT1 977 |
| ✓ |
LcbMaxGoodSubsequenceLengthLiveCodeBench / leetcode / medium: find-the-maximum-length-of-a-good-subsequence-i (LCB id 3456)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 165
OUT19 999 |
| ✓ |
LcbMinOpsBinaryToOneLiveCodeBench / leetcode / medium: minimum-operations-to-make-binary-array-elements-equal-to-one-i (LCB id 3475)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 159
OUT3 915 |
| ✓ |
LcbMinOpsDivisibleThreeLiveCodeBench / leetcode / easy: find-minimum-operations-to-make-all-elements-divisible-by-three (LCB id 3476)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 119
OUT785 |
Code Generation - LiveCodeBench v3 LeetCode (set 6)
6 passed2 failed |
75.0% |
IN73 659
OUT88 385 |
| ✓ |
LcbCoinGameWinnerLiveCodeBench / leetcode / easy: find-the-winning-player-in-coin-game (LCB id 3511)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 174
OUT843 |
| × |
LcbCountSubarraysAndKLiveCodeBench / leetcode / hard: number-of-subarrays-with-and-value-of-k (LCB id 3466)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: countSubarraysAndK case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
25:28: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 144
OUT4 436 |
| ✓ |
LcbCountWinningPlayersLiveCodeBench / leetcode / easy: find-the-number-of-winning-players (LCB id 3519)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 276
OUT2 845 |
| ✓ |
LcbMaxPointsEnemyBattlesLiveCodeBench / leetcode / medium: maximum-points-after-enemy-battles (LCB id 3264)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 241
OUT4 541 |
| ✓ |
LcbMinChangesEqualDiffsLiveCodeBench / leetcode / medium: minimum-array-changes-to-make-differences-equal (LCB id 3498)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 195
OUT52 705 |
| × |
LcbMinFlipsPalindromicGridLiveCodeBench / leetcode / medium: minimum-number-of-flips-to-make-binary-grid-palindromic-i (LCB id 3526)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i])
Context: minFlipsPalindromicGrid case0: expected 2 got 0 |
Failed |
IN9 190
OUT2 989 |
| ✓ |
LcbMinLengthAfterOpsLiveCodeBench / leetcode / medium: minimum-length-of-string-after-operations (LCB id 3455)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 162
OUT1 893 |
| ✓ |
LcbTimeTakenMarkNodesLiveCodeBench / leetcode / hard: time-taken-to-mark-all-nodes (LCB id 3532)1 AI query
0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 277
OUT18 133 |
Code Generation - LiveCodeBench v4 AtCoder (set 1)
8 passed1 skipped |
100.0% |
IN73 893
OUT97 059 |
| ✓ |
LcbBallsAndBagQueryLiveCodeBench / atcoder / medium: abc366_c Balls and Bag Query (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 211
OUT3 879 |
| ✓ |
LcbCuboidSumQueryLiveCodeBench / atcoder / medium: abc366_d Cuboid Sum Query (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 321
OUT24 765 |
| ✓ |
LcbCutTrailingZerosLiveCodeBench / atcoder / easy: abc367_b Cut .0 (Pattern B, stdin) NOTE (triage): float-formatting output — model must print X with no trailing zeros and no trailing decimal point. Compared as a trimmed string. Flagged for coordinator.1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 203
OUT1 267 |
| ✓ |
LcbElection2LiveCodeBench / atcoder / easy: abc366_a Election 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 217
OUT1 967 |
| ✓ |
LcbManhattanEllipseLiveCodeBench / atcoder / hard: abc366_e Manhattan Multifocal Ellipse (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 234
OUT20 644 |
| ✓ |
LcbMaximumCompositionLiveCodeBench / atcoder / hard: abc366_f Maximum Composition (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 238
OUT33 454 |
| ✓ |
LcbShoutEverydayLiveCodeBench / atcoder / easy: abc367_a Shout Everyday (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 198
OUT935 |
| ✓ |
LcbVerticalWritingLiveCodeBench / atcoder / easy: abc366_b Vertical Writing (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 271
OUT10 148 |
| – |
LcbXorNeighborsLiveCodeBench / atcoder / hard: abc366_g XOR Neighbors (Pattern B, stdin) NOTE (triage): non-unique answer — any valid assignment is accepted, so exact-string comparison against the sample output will reject other correct solutions. Flagged for coordinator.0 AI queries
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
Code Generation - LiveCodeBench v4 AtCoder (set 2)
3 passed4 failed1 broken |
37.5% |
IN74 028
OUT182 558 |
| × |
LcbAddMultiplyQueriesLiveCodeBench / atcoder / hard: abc368_g Add and Multiply Queries (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: AddMultiplyQueries case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
270:29: Expected ']' to close the indexer, found '++'.
Values:
run.Compiled = false |
Failed |
IN9 295
OUT56 859 |
| ✓ |
LcbCardCutLiveCodeBench / atcoder / easy: abc368_a Cut (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 217
OUT1 496 |
| × |
LcbDecreaseTwoMaxLiveCodeBench / atcoder / easy: abc368_b Decrease 2 max elements (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: DecreaseTwoMax case0: expected [4] got [3] |
Failed |
IN9 202
OUT7 624 |
| ✓ |
LcbEnumerateSequencesLiveCodeBench / atcoder / medium: abc367_c Enumerate Sequences (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 214
OUT4 219 |
| × |
LcbPedometerLiveCodeBench / atcoder / medium: abc367_d Pedometer (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: Pedometer case1 runtime error: The script exceeded the timeout of 30000 ms.
Values:
run.Success = false |
Failed |
IN9 267
OUT15 254 |
| ✓ |
LcbPermuteKTimesLiveCodeBench / atcoder / hard: abc367_e Permute K times (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 242
OUT15 236 |
| × |
LcbRearrangeQueryLiveCodeBench / atcoder / hard: abc367_f Rearrange Query (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: RearrangeQuery case0 runtime error: Integer overflow.
Values:
run.Success = false |
Failed |
IN9 295
OUT19 726 |
| ! |
LcbSumXorKLiveCodeBench / atcoder / hard: abc367_g Sum of (XOR^K or 0) (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 296
OUT62 144 |
Code Generation - LiveCodeBench v4 AtCoder (set 3)
8 passed1 broken |
88.9% |
IN83 475
OUT173 072 |
| ✓ |
LcbArrangeArithmeticLiveCodeBench / atcoder / abc369_a: 369 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 209
OUT3 705 |
| ✓ |
LcbAsFarAsPossibleLiveCodeBench / atcoder / abc369_g: As far as possible (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 368
OUT30 852 |
| ✓ |
LcbBonusExpLiveCodeBench / atcoder / abc369_d: Bonus EXP (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 273
OUT11 994 |
| ✓ |
LcbCountArithmeticSubarraysLiveCodeBench / atcoder / abc369_c: Count Arithmetic Subarrays (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 254
OUT4 586 |
| ! |
LcbDividingGameLiveCodeBench / atcoder / abc368_f: Dividing Game (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 258
OUT62 144 |
| ✓ |
LcbMinimumSteinerTreeLiveCodeBench / atcoder / abc368_d: Minimum Steiner Tree (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 216
OUT8 617 |
| ✓ |
LcbPiano3LiveCodeBench / atcoder / abc369_b: Piano 3 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 306
OUT8 292 |
| ✓ |
LcbTrainDelayLiveCodeBench / atcoder / abc368_e: Train Delay (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 340
OUT27 882 |
| ✓ |
LcbTripleAttackLiveCodeBench / atcoder / abc368_c: Triple Attack (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 251
OUT15 000 |
Code Generation - LiveCodeBench v4 AtCoder (set 4)
4 passed2 failed2 broken |
50.0% |
IN74 367
OUT209 267 |
| ✓ |
LcbAvoidKPartitionLiveCodeBench / atcoder / abc370_e: Avoid K Partition (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 316
OUT7 254 |
| ✓ |
LcbBinaryAlchemyLiveCodeBench / atcoder / abc370_b: Binary Alchemy (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 248
OUT17 513 |
| ! |
LcbCakeDivisionLiveCodeBench / atcoder / abc370_f: Cake Division (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 367
OUT62 144 |
| × |
LcbCrossExplosionLiveCodeBench / atcoder / abc370_d: Cross Explosion (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: CrossExplosion case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
87:19: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 344
OUT37 936 |
| × |
LcbDivisibleByThreeLiveCodeBench / atcoder / abc370_g: Divisible by 3 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: DivisibleByThree case3 runtime error: Cannot cast value to 'int' because it is outside the target type range.
Values:
run.Success = false |
Failed |
IN9 192
OUT12 518 |
| ✓ |
LcbRaiseBothHandsLiveCodeBench / atcoder / abc370_a: Raise Both Hands (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 263
OUT549 |
| ! |
LcbSightseeingTourLiveCodeBench / atcoder / abc369_e: Sightseeing Tour (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 364
OUT62 144 |
| ✓ |
LcbWordLadderLiveCodeBench / atcoder / abc370_c: Word Ladder (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 273
OUT9 209 |
Code Generation - LiveCodeBench v4 AtCoder (set 5)
8 passed1 broken |
88.9% |
IN83 437
OUT170 280 |
| ✓ |
LcbCountABCAgainLiveCodeBench / atcoder / medium: abc372_c Count ABC Again (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 239
OUT6 176 |
| ✓ |
LcbDistinctSubarraySumLiveCodeBench / atcoder / hard: abc371_e I Hate Sigma Problems (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 207
OUT5 095 |
| ✓ |
LcbKthLargestConnectedLiveCodeBench / atcoder / hard: abc372_e K (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 277
OUT12 575 |
| ✓ |
LcbLexSmallestPermLiveCodeBench / atcoder / hard: abc371_g Lexicographically Smallest Permutation (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 246
OUT59 181 |
| ✓ |
LcbMakeIsomorphicLiveCodeBench / atcoder / medium: abc371_c Make Isomorphic (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 400
OUT10 084 |
| ✓ |
LcbMiddleBrotherLiveCodeBench / atcoder / easy: abc371_a Jiro (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 226
OUT2 169 |
| ! |
LcbNarrowRoadLiveCodeBench / atcoder / hard: abc371_f Takahashi in Narrow Road (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 287
OUT62 144 |
| ✓ |
LcbOneDCountryLiveCodeBench / atcoder / medium: abc371_d 1D Country (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 279
OUT11 561 |
| ✓ |
LcbTaroNameLiveCodeBench / atcoder / easy: abc371_b Taro (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 276
OUT1 295 |
Code Generation - LiveCodeBench v4 AtCoder (set 6)
5 passed1 failed1 broken1 skipped |
71.4% |
IN64 717
OUT142 962 |
| ! |
LcbAxByLessCLiveCodeBench / atcoder / hard: abc372_g Ax + By < C (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 302
OUT62 144 |
| ✓ |
LcbDeleteDotsLiveCodeBench / atcoder / easy: abc372_a delete . (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 151
OUT276 |
| ✓ |
LcbDiminishingKnapsackLiveCodeBench / atcoder / hard: abc373_f Knapsack with Diminishing Values (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 243
OUT18 773 |
| – |
LcbNoCrossMatchingLiveCodeBench / atcoder / hard: abc373_g No Cross Matching (Pattern B, stdin) NOTE: non-unique answer — any non-crossing perfect matching R is valid; the exact-match oracle may reject a different valid R.0 AI queries
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbOneDKeyboardLiveCodeBench / atcoder / easy: abc373_b 1D Keyboard (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 244
OUT2 167 |
| ✓ |
LcbSeptemberLengthsLiveCodeBench / atcoder / easy: abc373_a September (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 181
OUT241 |
| ✓ |
LcbTeleportingWalksLiveCodeBench / atcoder / hard: abc372_f Teleporting Takahashi 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 362
OUT51 724 |
| × |
LcbVisibleBuildingsLiveCodeBench / atcoder / medium: abc372_d Buildings (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: VisibleBuildings case0: expected [3 2 2 1 0] got [2 2 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 0] |
Failed |
IN9 234
OUT7 637 |
Code Generation - LiveCodeBench v4 AtCoder (set 7)
5 passed1 broken1 skipped |
83.3% |
IN55 566
OUT226 501 |
| ✓ |
LcbAnnoyingStringLiveCodeBench / atcoder / hard: arc181_b Annoying String Problem (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 261
OUT23 915 |
| ✓ |
LcbIncDecAgainLiveCodeBench / atcoder / hard: arc182_d Increment Decrement Again (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 306
OUT40 085 |
| ✓ |
LcbMaxAiBjLiveCodeBench / atcoder / medium: abc373_c Max Ai+Bj (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 172
OUT1 750 |
| ✓ |
LcbPrefixBubbleSortLiveCodeBench / atcoder / hard: arc181_d Prefix Bubble Sort (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 292
OUT58 933 |
| – |
LcbRowColumnOrderLiveCodeBench / atcoder / hard: arc181_c Row and Column Order (Pattern B, stdin) TRIAGE: non-unique answer (any valid grid accepted) — exact string compare may fail correct solutions.0 AI queries
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ! |
LcbSortLeftRightLiveCodeBench / atcoder / medium: arc181_a Sort Left and Right (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 264
OUT62 144 |
| ✓ |
LcbWinElectionLiveCodeBench / atcoder / hard: abc373_e How to Win the Election (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 271
OUT39 674 |
Code Generation - LiveCodeBench v4 AtCoder (set 8)
2 passed1 failed3 broken1 skipped |
33.3% |
IN55 380
OUT270 128 |
| ✓ |
LcbChmaxRushLiveCodeBench / atcoder / hard: arc182_a Chmax Rush! (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 358
OUT40 764 |
| ! |
LcbDivisorsOfProductLiveCodeBench / atcoder / hard: arc182_c Sum of Number of Divisors of Product (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 203
OUT62 144 |
| – |
LcbKeepMatchedLiveCodeBench / atcoder / hard: arc183_d Keep Perfectly Matched (Pattern B, stdin) TRIAGE: non-unique answer (any maximizing procedure accepted) — exact string compare may fail correct solutions.0 AI queries
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbMedianGoodSeqLiveCodeBench / atcoder / medium: arc183_a Median of Good Sequences (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 175
OUT31 165 |
| ! |
LcbNearAssignmentLiveCodeBench / atcoder / hard: arc183_b Near Assignment (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 240
OUT62 144 |
| × |
LcbNotArgmaxLiveCodeBench / atcoder / hard: arc183_c Not Argmax (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: NotArgmax case2: expected [1598400] got [1719360] |
Failed |
IN9 225
OUT11 767 |
| ! |
LcbSumMinModLinearLiveCodeBench / atcoder / hard: arc182_e Sum of Min of Mod of Linear (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 179
OUT62 144 |
Code Generation - LiveCodeBench v4 LeetCode (set 1)
4 passed2 broken |
66.7% |
IN55 181
OUT116 838 |
| ✓ |
LcbAlmostEqualPairsLiveCodeBench / leetcode / medium: count-almost-equal-pairs-i (id 3534)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 198
OUT3 283 |
| ✓ |
LcbBeautifulArraySumLiveCodeBench / leetcode / medium: find-the-minimum-possible-sum-of-a-beautiful-array (id 3026)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 187
OUT5 083 |
| ! |
LcbFinalArrayStateLiveCodeBench / leetcode / easy: final-array-state-after-k-multiplication-operations-i (id 3555)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 210
OUT26 884 |
| ✓ |
LcbKConstraintSubstringsLiveCodeBench / leetcode / easy: count-substrings-that-satisfy-k-constraint-i (id 3543)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 191
OUT2 210 |
| ! |
LcbLargestKPalindromeLiveCodeBench / leetcode / hard: find-the-largest-palindrome-divisible-by-k (id 3552)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 162
OUT62 144 |
| ✓ |
LcbMaxEnergyBoostLiveCodeBench / leetcode / medium: maximum-energy-boost-from-two-drinks (id 3525)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 233
OUT17 234 |
Code Generation - LiveCodeBench v4 LeetCode (set 2)
6 passed |
100.0% |
IN55 268
OUT98 031 |
| ✓ |
LcbConvertDateBinaryLiveCodeBench / leetcode / easy: convert-date-to-binary (id 3567)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 181
OUT1 588 |
| ✓ |
LcbKthNearestObstacleLiveCodeBench / leetcode / medium: k-th-nearest-obstacle-queries (id 3495)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 250
OUT11 533 |
| ✓ |
LcbMaxCellScoreLiveCodeBench / leetcode / hard: select-cells-in-grid-with-maximum-score (id 3563)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 178
OUT23 183 |
| ✓ |
LcbMaxRangeScoreLiveCodeBench / leetcode / medium: maximize-score-of-numbers-in-ranges (id 3485)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 173
OUT9 798 |
| ✓ |
LcbMaxXorSubarrayLiveCodeBench / leetcode / hard: maximum-xor-score-subarray-queries (id 3551)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 313
OUT51 509 |
| ✓ |
LcbSameChessboardColorLiveCodeBench / leetcode / easy: check-if-two-chessboard-squares-have-the-same-color (id 3553)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 173
OUT420 |
Code Generation - LiveCodeBench v4 LeetCode (set 3)
5 passed1 failed |
83.3% |
IN55 509
OUT139 882 |
| ✓ |
LcbKnightKillPawnsLiveCodeBench / leetcode / hard: maximum-number-of-moves-to-kill-all-pawns (LCB 3560)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 343
OUT49 576 |
| ✓ |
LcbMaxMultiplicationScoreLiveCodeBench / leetcode / medium: maximum-multiplication-score (LCB 3518)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 288
OUT3 582 |
| ✓ |
LcbMinValidStringsLiveCodeBench / leetcode / medium: minimum-number-of-valid-strings-to-form-target-i (LCB 3559)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 185
OUT27 325 |
| ✓ |
LcbPowerKSizeSubarraysLiveCodeBench / leetcode / medium: find-the-power-of-k-size-subarrays-i (LCB 3522)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 253
OUT2 898 |
| ✓ |
LcbReachEndMaxScoreLiveCodeBench / leetcode / medium: reach-end-of-array-with-max-score (LCB 3528)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 209
OUT20 798 |
| × |
LcbThreeRooksMaxSumLiveCodeBench / leetcode / hard: maximum-value-sum-by-placing-three-rooks-i (LCB 3550)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: threeRooks case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
417:19: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 231
OUT35 703 |
Code Generation - LiveCodeBench v4 LeetCode (set 4)
5 passed1 broken |
83.3% |
IN55 660
OUT142 539 |
| ✓ |
LcbCountGoodIntegersLiveCodeBench / leetcode / hard: find-the-count-of-good-integers (LCB 3548)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 270
OUT52 460 |
| ✓ |
LcbGenerateKeyNumbersLiveCodeBench / leetcode / easy: find-the-key-of-the-numbers (LCB 3568)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 294
OUT2 870 |
| ✓ |
LcbHashDividedStringLiveCodeBench / leetcode / medium: hash-divided-string (LCB 3540)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 271
OUT526 |
| ! |
LcbMaxSequenceValueLiveCodeBench / leetcode / hard: find-the-maximum-sequence-value-of-array (LCB 3575)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 234
OUT62 144 |
| ✓ |
LcbMinDamageToBobLiveCodeBench / leetcode / hard: minimum-amount-of-damage-dealt-to-bob (LCB 3531)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 269
OUT12 127 |
| ✓ |
LcbSafeWalkGridLiveCodeBench / leetcode / medium: find-a-safe-walk-through-a-grid (LCB 3558)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 322
OUT12 412 |
Code Generation - LiveCodeBench v4 LeetCode (set 5)
6 passed |
100.0% |
IN55 275
OUT65 043 |
| ✓ |
LcbKthCharacterGameLiveCodeBench 3600 / leetcode / easy: find the k-th character in string game I (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 206
OUT2 016 |
| ✓ |
LcbLongestIncreasingPathLiveCodeBench 3571 / leetcode / hard: length of the longest increasing path (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 279
OUT13 422 |
| ✓ |
LcbMountainHeightZeroLiveCodeBench 3496 / leetcode / medium: minimum number of seconds to make mountain height zero (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 279
OUT23 317 |
| ✓ |
LcbReportSpamLiveCodeBench 3541 / leetcode / medium: report spam message (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 162
OUT411 |
| ✓ |
LcbSubstringsVowelsKConsonantsLiveCodeBench 3570 / leetcode / medium: count of substrings containing every vowel and k consonants I (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 166
OUT18 848 |
| ✓ |
LcbValidSubstringCountLiveCodeBench 3573 / leetcode / medium: count substrings that can be rearranged to contain a string I (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 183
OUT7 029 |
Code Generation - LiveCodeBench v4 LeetCode (set 6)
5 passed1 failed |
83.3% |
IN55 300
OUT118 758 |
| ✓ |
LcbFirstAlmostEqualSubstringLiveCodeBench 3580 / leetcode / hard: find the occurrence of first almost equal substring (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 198
OUT17 237 |
| × |
LcbLexSmallestValidSequenceLiveCodeBench 3584 / leetcode / medium: find the lexicographically smallest valid sequence (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: lexSmallestValidSequence case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
16:22: Type 'Dictionary<char, List<int>>' has no supported method named 'Add' with 2 argument(s).
Values:
run.Compiled = false |
Failed |
IN9 279
OUT35 094 |
| ✓ |
LcbMaxBinaryConcatenationLiveCodeBench 3579 / leetcode / medium: maximum possible number by binary concatenation (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 166
OUT20 859 |
| ✓ |
LcbMaxUniqueTowerHeightsLiveCodeBench 3510 / leetcode / medium: maximize the total height of unique towers (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 203
OUT5 301 |
| ✓ |
LcbMinAfterDigitSumLiveCodeBench 3606 / leetcode / easy: minimum element after replacement with digit sum (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 159
OUT770 |
| ✓ |
LcbSortedGcdPairQueriesLiveCodeBench 3583 / leetcode / hard: sorted GCD pair queries (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 295
OUT39 497 |
Code Generation - LiveCodeBench v5 AtCoder (set 1)
8 passed1 failed1 broken2 skipped |
80.0% |
IN92 203
OUT201 211 |
| ✓ |
LcbAbaPalindromeLiveCodeBench / atcoder / medium: abc375_d ABA (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 189
OUT2 446 |
| – |
LcbLaserMarkingLiveCodeBench / atcoder / medium: abc374_d Laser Marking (Pattern B, stdin) [float output, tolerance 1e-6]0 AI queries
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBenchSkipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected |
Skipped |
IN0
OUT0 |
| ! |
LcbOnlyOneProductNameLiveCodeBench / atcoder / hard: abc374_g Only One Product Name (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 227
OUT62 144 |
| ✓ |
LcbSeatsLiveCodeBench / atcoder / easy: abc375_a Seats (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 182
OUT664 |
| ✓ |
LcbSensorOptimizationLiveCodeBench / atcoder / hard: abc374_e Sensor Optimization Dilemma 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 278
OUT16 832 |
| × |
LcbSeparatedLunchLiveCodeBench / atcoder / medium: abc374_c Separated Lunch (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: SeparatedLunch case0 runtime error: List index 4 is out of range. The list has 4 element(s).
Values:
run.Success = false |
Failed |
IN9 199
OUT5 446 |
| ✓ |
LcbShippingLiveCodeBench / atcoder / hard: abc374_f Shipping (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 281
OUT31 019 |
| ✓ |
LcbSpiralRotationLiveCodeBench / atcoder / medium: abc375_c Spiral Rotation (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 249
OUT33 998 |
| ✓ |
LcbTakahashiSanLiveCodeBench / atcoder / easy: abc374_a Takahashi san 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 151
OUT225 |
| ✓ |
LcbThreeTeamDivisionLiveCodeBench / atcoder / hard: abc375_e 3 Team Division (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 268
OUT47 923 |
| – |
LcbTravelingTakahashiLiveCodeBench / atcoder / easy: abc375_b Traveling Takahashi Problem (Pattern B, stdin) [float output, tolerance 1e-6]0 AI queries
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBenchSkipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected |
Skipped |
IN0
OUT0 |
| ✓ |
LcbUnvarnishedReportLiveCodeBench / atcoder / easy: abc374_b Unvarnished Report (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 179
OUT514 |
Code Generation - LiveCodeBench v5 AtCoder (set 2)
7 passed1 failed3 broken |
63.6% |
IN102 080
OUT279 040 |
| ✓ |
LcbAvoidKnightAttackLiveCodeBench / atcoder / medium: abc377_c Avoid Knight Attack (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 305
OUT6 740 |
| ✓ |
LcbAvoidRookAttackLiveCodeBench / atcoder / easy: abc377_b Avoid Rook Attack (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 253
OUT1 376 |
| ✓ |
LcbCandyButtonLiveCodeBench / atcoder / easy: abc376_a Candy Button (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 221
OUT1 051 |
| ✓ |
LcbCycleMinEdgesLiveCodeBench / atcoder / medium: abc376_d Cycle (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 243
OUT9 812 |
| ✓ |
LcbHandsOnRingEasyLiveCodeBench / atcoder / medium: abc376_b Hands on Ring (Easy) (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 287
OUT12 693 |
| ! |
LcbHandsOnRingHardLiveCodeBench / atcoder / hard: abc376_f Hands on Ring (Hard) (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 292
OUT62 144 |
| × |
LcbMaxTimesSumLiveCodeBench / atcoder / hard: abc376_e Max x Sum (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: MaxTimesSum case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
139:21: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 279
OUT23 586 |
| ✓ |
LcbPrepareAnotherBoxLiveCodeBench / atcoder / medium: abc376_c Prepare Another Box (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 276
OUT12 738 |
| ✓ |
LcbRoadBlockedLiveCodeBench / atcoder / hard: abc375_f Road Blocked (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 302
OUT24 612 |
| ! |
LcbRoadBlocked2LiveCodeBench / atcoder / hard: abc375_g Road Blocked 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 291
OUT62 144 |
| ! |
LcbTreasureHuntingLiveCodeBench / atcoder / hard: abc376_g Treasure Hunting (Pattern B, stdin) [answer modulo 998244353]1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 331
OUT62 144 |
Code Generation - LiveCodeBench v5 AtCoder (set 3)
10 passed2 failed2 broken |
71.4% |
IN128 774
OUT281 247 |
| ✓ |
LcbAddOneEdge2LiveCodeBench / atcoder abc378_f: Add One Edge 2 (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 174
OUT22 709 |
| ! |
LcbAvoidQueenAttackLiveCodeBench / atcoder abc377_f: Avoid Queen Attack (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 245
OUT62 144 |
| × |
LcbCountSimplePathsLiveCodeBench / atcoder abc378_d: Count Simple Paths (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: CountSimplePaths case2: expected [218070] got [805] |
Failed |
IN9 193
OUT40 794 |
| ✓ |
LcbEditToMatchLiveCodeBench / atcoder abc377_g: Edit to Match (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 248
OUT16 315 |
| ! |
LcbEverlastingLidsLiveCodeBench / atcoder abc378_g: Everlasting LIDS (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 225
OUT62 144 |
| ✓ |
LcbGarbageCollectionLiveCodeBench / atcoder abc378_b: Garbage Collection (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 215
OUT5 714 |
| ✓ |
LcbManySegments2LiveCodeBench / atcoder abc377_d: Many Segments 2 (medium)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 205
OUT20 806 |
| × |
LcbModSigmaProblemLiveCodeBench / atcoder abc378_e: Mod Sigma Problem (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: ModSigmaProblem case0 runtime error: List index 4 is out of range. The list has 4 element(s).
Values:
run.Success = false |
Failed |
IN9 181
OUT15 298 |
| ✓ |
LcbPairingLiveCodeBench / atcoder abc378_a: Pairing (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 166
OUT1 981 |
| ✓ |
LcbPermuteKTimesLiveCodeBench / atcoder abc377_e: Permute K times 2 (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 201
OUT14 095 |
| ✓ |
LcbRearrangingAbcLiveCodeBench / atcoder abc377_a: Rearranging ABC (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 162
OUT555 |
| ✓ |
LcbRepeatingLiveCodeBench / atcoder abc378_c: Repeating (medium)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 183
OUT1 909 |
| ✓ |
LcbStrawberriesLiveCodeBench / atcoder abc379_b: Strawberries (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 186
OUT5 159 |
| ✓ |
LcbSumOfAllSubstringsLiveCodeBench / atcoder abc379_e: Sum of All Substrings (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 190
OUT11 624 |
Code Generation - LiveCodeBench v5 AtCoder (set 4)
11 passed1 failed2 broken |
78.6% |
IN128 983
OUT300 902 |
| ✓ |
Lcb1122StringLiveCodeBench / atcoder abc381_a: 11/22 String (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 271
OUT1 049 |
| ! |
Lcb1122SubsequenceLiveCodeBench / atcoder abc381_e: 11/22 Subsequence (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 266
OUT34 510 |
| ✓ |
LcbAnotherShuffleWindowLiveCodeBench / atcoder abc380_g: Another Shuffle Window (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 273
OUT23 369 |
| ✓ |
LcbBucketToolLiveCodeBench / atcoder abc380_e: 1D Bucket Tool (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 209
OUT21 086 |
| ✓ |
LcbBuildings2LiveCodeBench / atcoder abc379_f: Buildings 2 (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 219
OUT32 572 |
| ✓ |
LcbCountGrid3LiveCodeBench / atcoder abc379_g: Count Grid 3 (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 201
OUT34 739 |
| ✓ |
LcbCyclicLiveCodeBench / atcoder abc379_a: Cyclic (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 175
OUT741 |
| ✓ |
LcbDigitPattern123233LiveCodeBench / atcoder abc380_a: 123233 (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 162
OUT690 |
| ! |
LcbExchangeGameLiveCodeBench / atcoder abc380_f: Exchange Game (hard)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 253
OUT62 144 |
| ✓ |
LcbHomeGardenLiveCodeBench / atcoder abc379_d: Home Garden (medium)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 189
OUT2 753 |
| ✓ |
LcbHurdleParsingLiveCodeBench / atcoder abc380_b: Hurdle Parsing (easy)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 173
OUT1 553 |
| ✓ |
LcbMoveSegmentLiveCodeBench / atcoder abc380_c: Move Segment (medium)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 184
OUT14 607 |
| ✓ |
LcbSowingStonesLiveCodeBench / atcoder abc379_c: Sowing Stones (medium)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 216
OUT32 221 |
| × |
LcbStrangeMirroringLiveCodeBench / atcoder abc380_d: Strange Mirroring (medium)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: StrangeMirroring case0: expected [a B A b A b a B A b a B a B A b] got [1 6] |
Failed |
IN9 192
OUT38 868 |
Code Generation - LiveCodeBench v5 AtCoder (set 5)
11 passed1 failed1 broken |
84.6% |
IN121 097
OUT168 007 |
| ✓ |
Lcb1122StringLiveCodeBench / atcoder / easy: 1122 String (abc381_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 254
OUT925 |
| ✓ |
Lcb1122SubarrayLiveCodeBench / atcoder / hard: 1122 Substring (abc381_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 294
OUT9 156 |
| ✓ |
LcbDailyCookieLiveCodeBench / atcoder / easy: Daily Cookie (abc382_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 260
OUT841 |
| ✓ |
LcbDailyCookie2LiveCodeBench / atcoder / easy: Daily Cookie 2 (abc382_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 282
OUT1 624 |
| ✓ |
LcbFallingBarsLiveCodeBench / atcoder / hard: Falling Bars (abc382_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 403
OUT46 363 |
| ✓ |
LcbHumidifier1LiveCodeBench / atcoder / easy: Humidifier 1 (abc383_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 253
OUT3 177 |
| ✓ |
LcbHumidifier2LiveCodeBench / atcoder / medium: Humidifier 2 (abc383_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 317
OUT3 018 |
| ✓ |
LcbHumidifier3LiveCodeBench / atcoder / medium: Humidifier 3 (abc383_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 307
OUT6 818 |
| ✓ |
LcbKaitenSushiLiveCodeBench / atcoder / medium: Kaiten Sushi (abc382_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 313
OUT5 591 |
| × |
LcbKeepDistanceLiveCodeBench / atcoder / hard: Keep Distance (abc382_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: KeepDistance case0: expected [10
1 11 21
1 11 22
1 11 23
1 12 22
1 12 23
1 13 23
2 12 22
2 12 23
2 13 23
3 13 23] got [101 11 21
1 11 22
1 11 23
1 12 22
1 12 23
1 13 23
2 12 22
2 12 23
2 13 23
3 13 23] |
Failed |
IN9 276
OUT7 261 |
| ✓ |
LcbMax1122SubstringLiveCodeBench / atcoder / medium: 11/22 Substring (abc381_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 379
OUT4 148 |
| ✓ |
LcbSumOfMaxMatchingLiveCodeBench / atcoder / hard: Sum of Max Matching (abc383_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 365
OUT16 941 |
| ! |
LcbTileDistance3LiveCodeBench / atcoder / hard: Tile Distance 3 (abc382_g)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 394
OUT62 144 |
Code Generation - LiveCodeBench v5 AtCoder (set 6)
12 passed1 failed1 skipped |
92.3% |
IN120 901
OUT184 919 |
| ✓ |
LcbAbsSumLiveCodeBench / atcoder / hard: Abs Sum (abc384_g)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 314
OUT60 034 |
| ✓ |
LcbArcDivisionLiveCodeBench / atcoder / easy: ARC Division (abc384_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 361
OUT1 266 |
| × |
LcbDoubleSum2LiveCodeBench / atcoder / hard: Double Sum 2 (abc384_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: DoubleSum2 case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
89:25: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 251
OUT24 344 |
| ✓ |
LcbEquallyLiveCodeBench / atcoder / easy: Equally (abc385_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 184
OUT1 997 |
| ✓ |
LcbIlluminateBuildingsLiveCodeBench / atcoder / medium: Illuminate Buildings (abc385_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 224
OUT4 352 |
| ✓ |
LcbMaximizeXorLiveCodeBench / atcoder / hard: Maximize XOR (abc386_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 240
OUT10 220 |
| ✓ |
LcbPerfectStandingsLiveCodeBench / atcoder / medium: Perfect Standings (abc384_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 302
OUT4 362 |
| ✓ |
LcbRepeatedSequenceLiveCodeBench / atcoder / medium: Repeated Sequence (abc384_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 246
OUT17 221 |
| ✓ |
LcbReplaceExceptCharLiveCodeBench / atcoder / easy: aaaadaa (abc384_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 202
OUT625 |
| ✓ |
LcbSantaClaus1LiveCodeBench / atcoder / easy: Santa Claus 1 (abc385_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 467
OUT2 344 |
| ✓ |
LcbSantaClaus2LiveCodeBench / atcoder / hard: Santa Claus 2 (abc385_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 442
OUT18 372 |
| ✓ |
LcbSlime2LiveCodeBench / atcoder / hard: Takahashi is Slime 2 (abc384_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 376
OUT17 992 |
| ✓ |
LcbSnowflakeTreeLiveCodeBench / atcoder / hard: Snowflake Tree (abc385_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 292
OUT21 790 |
| – |
LcbVisibleBuildingsLiveCodeBench / atcoder / hard: Visible Buildings (abc385_f)0 AI queries
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected |
Skipped |
IN0
OUT0 |
Code Generation - LiveCodeBench v5 AtCoder (set 7)
9 passed1 failed2 broken1 skipped |
75.0% |
IN110 985
OUT387 878 |
| ! |
LcbAccumulatingManyTimesLiveCodeBench / atcoder / hard: arc184_e Accumulating Many Times (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 289
OUT62 144 |
| ✓ |
LcbAdjacentGcdLiveCodeBench / atcoder / hard: arc185_e Adjacent GCD (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 265
OUT51 625 |
| ✓ |
LcbCalculatorMinPressesLiveCodeBench / atcoder / easy: abc386_b Calculator (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 206
OUT2 517 |
| ✓ |
LcbDiagonalSeparationLiveCodeBench / atcoder / hard: abc386_d Diagonal Separation (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 285
OUT18 977 |
| ✓ |
LcbEraseBalls2DLiveCodeBench / atcoder / hard: arc184_d Erase Balls 2D (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 251
OUT42 833 |
| ✓ |
LcbFullHouse2LiveCodeBench / atcoder / easy: abc386_a Full House 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 200
OUT2 149 |
| ! |
LcbMountainValleyFoldsLiveCodeBench / atcoder / hard: arc184_c Mountain and Valley Folds (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 309
OUT62 144 |
| ✓ |
LcbOperate1LiveCodeBench / atcoder / medium: abc386_c Operate 1 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 209
OUT5 739 |
| ✓ |
LcbOperateKLiveCodeBench / atcoder / hard: abc386_f Operate K (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 213
OUT33 295 |
| ✓ |
LcbPlusOneAndLiveCodeBench / atcoder / hard: arc185_b +1 and (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 230
OUT33 535 |
| ✓ |
LcbRandomWalkOnTreeLiveCodeBench / atcoder / hard: arc185_d Random Walk on Tree (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 280
OUT42 568 |
| – |
LcbSumOfThreeIntegersLiveCodeBench / atcoder / hard: arc185_c Sum of Three Integers (Pattern B, stdin) NOTE: multiple valid triples may exist; exact-match oracle may reject a different valid answer.0 AI queries
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| × |
LcbUndercluedLiveCodeBench / atcoder / hard: arc186_a Underclued (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: Underclued case0: expected [Yes
Yes
No] got [Yes
No
No] |
Failed |
IN9 248
OUT30 352 |
Code Generation - LiveCodeBench v5 AtCoder (set 8)
6 passed1 failed5 broken1 skipped |
50.0% |
IN111 120
OUT603 966 |
| ! |
LcbAbcSymmetryLiveCodeBench / atcoder / hard: arc188_a ABC Symmetry (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 249
OUT62 144 |
| ! |
LcbBallAndBoxLiveCodeBench / atcoder / hard: arc186_c Ball and Box (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 286
OUT62 144 |
| ! |
LcbBallsAndBoxesLiveCodeBench / atcoder / hard: arc189_c Balls and Boxes (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 251
OUT57 395 |
| – |
LcbHonestLiarConfusedLiveCodeBench / atcoder / hard: arc188_c Honest or Liar or Confused (Pattern B, stdin) NOTE: multiple valid confused sets may exist; exact-match oracle may reject a different valid answer.0 AI queries
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbMinimizeSumLiveCodeBench / atcoder / hard: arc189_b Minimize Sum (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 235
OUT9 698 |
| × |
LcbMirrorAndOrderLiveCodeBench / atcoder / hard: arc188_d Mirror and Order (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: MirrorAndOrder case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
274:13: Expected ';' after the statement, found '{'.
Values:
run.Compiled = false |
Failed |
IN9 320
OUT60 785 |
| ! |
LcbMissingSubsequenceLiveCodeBench / atcoder / hard: arc186_e Missing Subsequence (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 243
OUT62 144 |
| ✓ |
LcbPolishManiaLiveCodeBench / atcoder / hard: arc186_d Polish Mania (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 264
OUT30 433 |
| ✓ |
LcbReversi2LiveCodeBench / atcoder / medium: arc189_a Reversi 2 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 277
OUT50 864 |
| ! |
LcbSumOfCCLiveCodeBench / atcoder / hard: arc187_b Sum of CC (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 282
OUT62 144 |
| ✓ |
LcbSymmetricPaintingLiveCodeBench / atcoder / hard: arc188_b Symmetric Painting (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 239
OUT35 177 |
| ✓ |
LcbTakahashiIsSlimeLiveCodeBench / atcoder / hard: arc189_d Takahashi is Slime (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 231
OUT61 247 |
| ✓ |
LcbTypicalPermutationDescriptorLiveCodeBench / atcoder / hard: arc186_b Typical Permutation Descriptor (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 243
OUT49 791 |
Code Generation - LiveCodeBench v5 LeetCode (set 1)
10 passed1 broken |
90.9% |
IN101 036
OUT273 288 |
| ✓ |
LcbCountWinningSequencesLiveCodeBench / leetcode / hard: count-the-number-of-winning-sequences1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 253
OUT60 636 |
| ✓ |
LcbDfsPalindromesLiveCodeBench / leetcode / hard: check-if-dfs-strings-are-palindromes1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 257
OUT21 739 |
| ✓ |
LcbFindXSumLiveCodeBench / leetcode / easy: find-x-sum-of-all-k-long-subarrays-i1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 229
OUT45 606 |
| ✓ |
LcbIsBalancedStringLiveCodeBench / leetcode / easy: check-balanced-string1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 119
OUT1 081 |
| ✓ |
LcbLengthAfterTransformationsLiveCodeBench / leetcode / medium: total-characters-in-string-after-transformations-i1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 171
OUT16 166 |
| ✓ |
LcbMaxFactorScoreLiveCodeBench / leetcode / medium: find-the-maximum-factor-score-of-array1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 164
OUT11 521 |
| ✓ |
LcbMinDivisionOperationsLiveCodeBench / leetcode / medium: minimum-division-operations-to-make-array-non-decreasing1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 153
OUT35 352 |
| ✓ |
LcbMinTimeToReachRoomLiveCodeBench / leetcode / medium: find-minimum-time-to-reach-last-room-i1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 223
OUT9 993 |
| ✓ |
LcbNumberOfSubstringsKFreqLiveCodeBench / leetcode / medium: count-substrings-with-k-frequency-characters-i1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 109
OUT4 106 |
| ✓ |
LcbStringSequenceLiveCodeBench / leetcode / medium: find-the-sequence-of-strings-appeared-on-the-screen1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 172
OUT4 944 |
| ! |
LcbSubsequencePairCountGcdLiveCodeBench / leetcode / hard: find-the-number-of-subsequences-with-equal-gcd1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 186
OUT62 144 |
Code Generation - LiveCodeBench v5 LeetCode (set 2)
7 passed3 broken |
70.0% |
IN92 092
OUT322 341 |
| ! |
LcbCountBalancedPermutationsLiveCodeBench / leetcode / hard: count-number-of-balanced-permutations1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 156
OUT62 144 |
| ! |
LcbCountKReducibleNumbersLiveCodeBench / leetcode / hard: count-k-reducible-numbers-less-than-n1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 183
OUT62 144 |
| ✓ |
LcbCountValidSelectionsLiveCodeBench / leetcode / easy: make-array-elements-equal-to-zero1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 239
OUT44 515 |
| ✓ |
LcbHasIncreasingSubarraysLiveCodeBench / leetcode / easy: adjacent-increasing-subarrays-detection-i1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 219
OUT3 711 |
| ✓ |
LcbIsZeroArrayLiveCodeBench / leetcode / medium: zero-array-transformation-i1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 211
OUT1 731 |
| ✓ |
LcbMaximizeSumOfWeightsLiveCodeBench / leetcode / hard: maximize-sum-of-weights-after-edge-removals1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 266
OUT12 155 |
| ! |
LcbMinAdjacentDifferenceLiveCodeBench / leetcode / hard: minimize-the-maximum-adjacent-element-difference1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 169
OUT62 144 |
| ✓ |
LcbMinArraySumLiveCodeBench / leetcode / medium: minimum-array-sum1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 280
OUT50 303 |
| ✓ |
LcbMinimumPositiveSumSubarrayLiveCodeBench / leetcode / easy: minimum-positive-sum-subarray1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 213
OUT13 422 |
| ✓ |
LcbSumOfGoodSubsequencesLiveCodeBench / leetcode / hard: sum-of-good-subsequences1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 156
OUT10 072 |
Code Generation - LiveCodeBench v5 LeetCode (set 3)
11 passed |
100.0% |
IN101 311
OUT209 541 |
| ✓ |
LcbMaxCollectedFruitsLiveCodeBench / leetcode / hard: find-the-maximum-number-of-fruits-collected (id 3648)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 356
OUT21 995 |
| ✓ |
LcbMaxFrequencyOpsLiveCodeBench / leetcode / medium: maximum-frequency-of-an-element-after-performing-operations-i (id 3622)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 175
OUT39 121 |
| ✓ |
LcbMaxRemovalsSourceLiveCodeBench / leetcode / medium: find-maximum-removals-from-source-string (id 3487)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 273
OUT54 523 |
| ✓ |
LcbMaxScoreTouristLiveCodeBench / leetcode / medium: maximum-points-tourist-can-earn (id 3587)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 265
OUT7 944 |
| ✓ |
LcbMinBitwiseArrayLiveCodeBench / leetcode / easy: construct-the-minimum-bitwise-array-i (id 3605)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 187
OUT9 040 |
| ✓ |
LcbNumberOfWaysEventLiveCodeBench / leetcode / hard: find-the-number-of-possible-ways-for-an-event (id 3604)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 214
OUT36 825 |
| ✓ |
LcbPossibleStringCountLiveCodeBench / leetcode / easy: find-the-original-typed-string-i (id 3617)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 133
OUT3 302 |
| ✓ |
LcbShiftDistanceLiveCodeBench / leetcode / medium: shift-distance-between-two-strings (id 3591)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 201
OUT3 607 |
| ✓ |
LcbSmallestDivisibleDigitProductLiveCodeBench / leetcode / easy: smallest-divisible-digit-product-i (id 3626)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 123
OUT5 470 |
| ✓ |
LcbStoneRemovalGameLiveCodeBench / leetcode / easy: stone-removal-game (id 3625)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 132
OUT2 158 |
| ✓ |
LcbZeroArrayTransformIIILiveCodeBench / leetcode / medium: zero-array-transformation-iii (id 3647)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 252
OUT25 556 |
Code Generation - LiveCodeBench v5 LeetCode (set 4)
7 passed2 failed1 broken |
70.0% |
IN91 849
OUT136 126 |
| ✓ |
LcbButtonLongestTimeLiveCodeBench / leetcode / easy: button-with-longest-push-time (id 3632)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 202
OUT2 379 |
| × |
LcbCountComponentsLcmLiveCodeBench / leetcode / hard: count-connected-components-in-lcm-graph (id 3680)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: countComponents case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
175:30: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s).
Values:
run.Compiled = false |
Failed |
IN9 171
OUT33 848 |
| ! |
LcbDigitOpsEqualLiveCodeBench / leetcode / medium: digit-operations-to-make-two-integers-equal (id 3655)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 197
OUT62 144 |
| ✓ |
LcbLargestOutlierLiveCodeBench / leetcode / medium: identify-the-largest-outlier-in-an-array (id 3594)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 196
OUT6 614 |
| ✓ |
LcbMaxRectangleAreaLiveCodeBench / leetcode / medium: maximum-area-rectangle-with-point-constraints-i (id 3681)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 210
OUT15 600 |
| ✓ |
LcbMaxSubarraySumDivKLiveCodeBench / leetcode / medium: maximum-subarray-sum-with-length-divisible-by-k (id 3653)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 146
OUT2 920 |
| ✓ |
LcbMinOpsEqualKLiveCodeBench / leetcode / easy: minimum-operations-to-make-array-values-equal-to-k (id 3621)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 185
OUT2 865 |
| × |
LcbMinTimeBreakLocksLiveCodeBench / leetcode / medium: minimum-time-to-break-locks-i (id 3649)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: findMinimumTime case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
Entry point 'findMinimumTime' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, FindMinimumTime.
Values:
run.Compiled = false |
Failed |
IN9 180
OUT6 533 |
| ✓ |
LcbSmallestAllSetBitsLiveCodeBench / leetcode / easy: smallest-number-with-all-set-bits (id 3676)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 119
OUT1 600 |
| ✓ |
LcbTransformedArrayLiveCodeBench / leetcode / easy: transformed-array (id 3651)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 243
OUT1 623 |
Code Generation - LiveCodeBench v5 LeetCode (set 5)
9 passed1 broken |
90.0% |
IN91 745
OUT229 274 |
| ! |
LcbBeautifulSplitsLiveCodeBench / leetcode / medium: count beautiful splits in an array (LCB id 3686)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 144
OUT62 144 |
| ✓ |
LcbCountGoodArraysLiveCodeBench / leetcode / hard: count arrays with k matching adjacent elements (LCB id 3682)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 181
OUT14 095 |
| ✓ |
LcbCountLen3SubarraysLiveCodeBench / leetcode / easy: count length-3 subarrays with a condition (LCB id 3685)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 113
OUT802 |
| ✓ |
LcbCountSpecialSubsequencesLiveCodeBench / leetcode / medium: count special subsequences (LCB id 3699)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 195
OUT16 080 |
| ✓ |
LcbLargestBoxStringLiveCodeBench / leetcode / medium: lexicographically largest string from the box I (LCB id 3683)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 145
OUT24 384 |
| ✓ |
LcbMakeStringGoodLiveCodeBench / leetcode / hard: minimum operations to make character frequencies equal (LCB id 3638)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 149
OUT44 174 |
| ✓ |
LcbMaxCurrencyAmountLiveCodeBench / leetcode / medium: maximize amount after two days of conversions (LCB id 3613)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 325
OUT15 685 |
| ✓ |
LcbMaxDistinctElementsLiveCodeBench / leetcode / medium: maximum number of distinct elements after operations (LCB id 3620)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 152
OUT6 316 |
| ✓ |
LcbMinIdenticalSubstringLiveCodeBench / leetcode / hard: smallest substring with identical characters I (LCB id 3690)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 174
OUT40 385 |
| ✓ |
LcbMinOpsDistinctLiveCodeBench / leetcode / easy: minimum operations to make elements distinct (LCB id 3656)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 167
OUT5 209 |
Code Generation - LiveCodeBench v5 LeetCode (set 6)
9 passed1 failed |
90.0% |
IN92 040
OUT302 715 |
| ✓ |
LcbCheckValidCutsLiveCodeBench / leetcode / medium: check if grid can be cut into sections (LCB id 3657)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 263
OUT22 442 |
| ✓ |
LcbCountXorPathsLiveCodeBench / leetcode / medium: count paths with the given xor value (LCB id 3659)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 248
OUT21 776 |
| ✓ |
LcbLongestDecreasingDiffLiveCodeBench / leetcode / medium: longest subsequence with decreasing adjacent difference (LCB id 3716)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 204
OUT24 415 |
| ✓ |
LcbMaxCoinsKBagsLiveCodeBench / leetcode / medium: maximum coins from k consecutive bags (LCB id 3715)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 193
OUT49 793 |
| ✓ |
LcbMaxIntervalScoreLiveCodeBench / leetcode / hard: maximum score of non-overlapping intervals (LCB id 3562)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 257
OUT43 615 |
| ✓ |
LcbMaxProductEquivalentLiveCodeBench / leetcode / easy: maximum subarray with equal products (LCB id 3702)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 181
OUT37 413 |
| × |
LcbMaxSubarrayAfterRemovalLiveCodeBench / leetcode / hard: maximize subarray sum after removing all occurrences of one element (LCB id 3688)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: maxSubarraySum case0 runtime error: List index 112 is out of range. The list has 64 element(s).
Values:
run.Success = false |
Failed |
IN9 152
OUT36 792 |
| ✓ |
LcbMiddleModeSubsequencesLiveCodeBench / leetcode / hard: subsequences with a unique middle mode I (LCB id 3700)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 209
OUT40 926 |
| ✓ |
LcbMirrorScoreLiveCodeBench / leetcode / medium: find mirror score of a string (LCB id 3634)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 182
OUT7 987 |
| ✓ |
LcbSubstringPatternLiveCodeBench / leetcode / easy: substring matching pattern (LCB id 3684)1 AI query
0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 151
OUT17 556 |
Code Generation - LiveCodeBench v6 AtCoder (set 1)
11 passed2 failed3 broken |
68.8% |
IN147 209
OUT360 772 |
| ✓ |
LcbComingOfAgeLiveCodeBench / atcoder abc388_d / medium: Coming of Age Celebration1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 206
OUT18 260 |
| ! |
LcbCountArraysLiveCodeBench / atcoder abc387_f / hard: Count Arrays1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 228
OUT62 144 |
| ! |
LcbDangerousSugorokuLiveCodeBench / atcoder abc388_f / hard: Dangerous Sugoroku1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 245
OUT62 144 |
| ✓ |
LcbDigitProductLiveCodeBench / atcoder abc389_a / easy: 9x91 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 146
OUT322 |
| ✓ |
LcbFactorialInverseLiveCodeBench / atcoder abc389_b / easy: tcaF1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 152
OUT747 |
| ✓ |
LcbHeavySnakeLiveCodeBench / atcoder abc388_b / easy: Heavy Snake1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 191
OUT43 638 |
| × |
LcbKagamimochi2LiveCodeBench / atcoder abc388_g / hard: Simultaneous Kagamimochi 21 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: Kagamimochi2 case0: expected [2
3
1
0
5] got [1
2
1
0
4] |
Failed |
IN9 255
OUT32 383 |
| ✓ |
LcbNotXSumLiveCodeBench / atcoder abc387_b / easy: 9x9 Sum1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 207
OUT789 |
| ✓ |
LcbOddEvenGraphLiveCodeBench / atcoder abc389_g / hard: Odd Even Graph1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 242
OUT52 448 |
| ✓ |
LcbQuestionUpcLiveCodeBench / atcoder abc388_a / easy: ?UPC1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 152
OUT459 |
| ! |
LcbRatedRangeLiveCodeBench / atcoder abc389_f / hard: Rated Range1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 201
OUT62 144 |
| × |
LcbSimultaneousKagamimochiLiveCodeBench / atcoder abc388_e / hard: Simultaneous Kagamimochi1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: SimultaneousKagamimochi case0: expected [3] got [2] |
Failed |
IN9 194
OUT2 993 |
| ✓ |
LcbSnakeNumbersLiveCodeBench / atcoder abc387_c / medium: Snake Numbers1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 201
OUT14 064 |
| ✓ |
LcbSquareOfSumLiveCodeBench / atcoder abc387_a / easy: Happy New Year 20251 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 133
OUT870 |
| ✓ |
LcbSquaresInCircleLiveCodeBench / atcoder abc389_d / medium: Squares in Circle1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 232
OUT4 336 |
| ✓ |
LcbVariousKagamimochiLiveCodeBench / atcoder abc388_c / medium: Various Kagamimochi1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 224
OUT3 031 |
Code Generation - LiveCodeBench v6 AtCoder (set 2)
12 passed1 failed2 broken |
80.0% |
IN138 184
OUT384 345 |
| ✓ |
LcbDoubleSum3LiveCodeBench / atcoder abc390_f / hard: Double Sum 31 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 231
OUT26 907 |
| ✓ |
LcbGeometricSequenceLiveCodeBench / atcoder abc390_b / easy: Geometric Sequence1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 162
OUT4 485 |
| ✓ |
LcbGravityLiveCodeBench / atcoder abc391_d / medium: Gravity1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 293
OUT46 033 |
| ! |
LcbKthLargestLiveCodeBench / atcoder abc391_f / hard: K1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 234
OUT62 144 |
| ✓ |
LcbMajorityVoteLiveCodeBench / atcoder abc391_e / hard: Hierarchical Majority Vote1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 220
OUT23 158 |
| ! |
LcbManyLcsLiveCodeBench / atcoder abc391_g / hard: Many LCS1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 211
OUT11 998 |
| ✓ |
LcbOneSwapSortLiveCodeBench / atcoder abc390_a / easy: 124351 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 195
OUT2 360 |
| ✓ |
LcbOppositeDirectionLiveCodeBench / atcoder abc391_a / easy: Lucky Direction1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 172
OUT377 |
| ✓ |
LcbPaintRectangleLiveCodeBench / atcoder abc390_c / medium: Paint to make a rectangle1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 218
OUT2 395 |
| × |
LcbPermutationConcatLiveCodeBench / atcoder abc390_g / hard: Permutation Concatenation1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: PermutationConcat case2 runtime error: The script exceeded the timeout of 30000 ms.
Values:
run.Success = false |
Failed |
IN9 243
OUT34 229 |
| ✓ |
LcbSeekGridLiveCodeBench / atcoder abc391_b / easy: Seek Grid1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 210
OUT29 455 |
| ✓ |
LcbShuffledEquationLiveCodeBench / atcoder abc392_a / easy: Shuffled Equation1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 187
OUT1 156 |
| ✓ |
LcbSquarePriceLiveCodeBench / atcoder abc389_e / hard: Square Price1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 194
OUT36 928 |
| ✓ |
LcbStoneXorLiveCodeBench / atcoder abc390_d / medium: Stone XOR1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 206
OUT49 302 |
| ✓ |
LcbVitaminBalanceLiveCodeBench / atcoder abc390_e / hard: Vitamin Balance1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 208
OUT53 418 |
Code Generation - LiveCodeBench v6 AtCoder (set 3)
6 passed3 failed1 broken |
60.0% |
IN92 267
OUT229 214 |
| ! |
LcbABCIntervalsLiveCodeBench / atcoder / abc393_b A..B..C (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 190
OUT62 144 |
| × |
LcbBibStaringLiveCodeBench / atcoder / abc392_c Bib (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: BibStaring case0 runtime error: List index 4 is out of range. The list has 4 element(s).
Values:
run.Success = false |
Failed |
IN9 233
OUT3 038 |
| × |
LcbDoublesProbabilityLiveCodeBench / atcoder / abc392_d Doubles (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: DoublesProbability case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
350:24: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 243
OUT45 019 |
| ✓ |
LcbFineTripletsLiveCodeBench / atcoder / abc392_g Fine Triplets (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 213
OUT37 741 |
| × |
LcbGcdOfSubsetLiveCodeBench / atcoder / abc393_e GCD of Subset (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: GcdOfSubset case0: expected [3
4
6
1
6] got [1
1
6
1
12] |
Failed |
IN9 212
OUT44 897 |
| ✓ |
LcbInsertSequenceLiveCodeBench / atcoder / abc392_f Insert (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 228
OUT6 024 |
| ✓ |
LcbPoisonousOysterLiveCodeBench / atcoder / abc393_a Poisonous Oyster (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 248
OUT635 |
| ✓ |
LcbPrefixLisQueryLiveCodeBench / atcoder / abc393_f Prefix LIS Query (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 258
OUT18 607 |
| ✓ |
LcbSwapToGatherLiveCodeBench / atcoder / abc393_d Swap to Gather (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 211
OUT1 645 |
| ✓ |
LcbWhoIsMissingLiveCodeBench / atcoder / abc392_b Who is Missing? (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 231
OUT9 464 |
Code Generation - LiveCodeBench v6 AtCoder (set 4)
7 passed3 broken |
70.0% |
IN92 337
OUT221 073 |
| ! |
LcbAlkaneSubtreeLiveCodeBench / atcoder / abc394_f Alkane (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 246
OUT62 144 |
| ✓ |
LcbCatConcatLiveCodeBench / atcoder / abc394_b cat (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 173
OUT3 299 |
| ✓ |
LcbColorfulBracketsLiveCodeBench / atcoder / abc394_d Colorful Bracket Sequence (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 186
OUT2 171 |
| ✓ |
LcbDebugWaAcLiveCodeBench / atcoder / abc394_c Debug (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 157
OUT6 663 |
| ✓ |
LcbDenseBuildingsLiveCodeBench / atcoder / abc394_g Dense Buildings (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 378
OUT53 558 |
| ✓ |
LcbFilterTwosLiveCodeBench / atcoder / abc394_a 22222 (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 149
OUT318 |
| ✓ |
LcbMakeTargetLiveCodeBench / atcoder / abc395_b Make Target (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 261
OUT16 281 |
| ! |
LcbPalindromicShortestPathLiveCodeBench / atcoder / abc394_e Palindromic Shortest Path (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 312
OUT62 144 |
| ✓ |
LcbShortestDuplicateSubarrayLiveCodeBench / atcoder / abc395_c Shortest Duplicate Subarray (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 214
OUT3 056 |
| ! |
LcbSmoothOcclusionLiveCodeBench / atcoder / abc395_f Smooth Occlusion (Pattern B, stdin)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 261
OUT11 439 |
Code Generation - LiveCodeBench v6 AtCoder (set 5)
12 passed2 failed1 broken1 skipped |
80.0% |
IN138 145
OUT292 451 |
| ✓ |
LcbBuyBallsLiveCodeBench / atcoder / medium: Buy Balls (abc396_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 229
OUT5 866 |
| ✓ |
LcbCardPileLiveCodeBench / atcoder / easy: Card Pile (abc396_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 208
OUT2 424 |
| – |
LcbCubesLiveCodeBench / atcoder / hard: Cubes (abc397_d)0 AI queries
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| × |
LcbFlipEdgeLiveCodeBench / atcoder / hard: Flip Edge (abc395_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: FlipEdge case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
181:17: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 222
OUT30 790 |
| × |
LcbFlipRowOrColLiveCodeBench / atcoder / hard: Flip Row or Col (abc396_g)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: FlipRowOrCol case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
578:9: Expected a variable name, found 'var'.
Values:
run.Compiled = false |
Failed |
IN9 218
OUT56 926 |
| ! |
LcbMaximizeDistanceLiveCodeBench / atcoder / hard: Maximize Distance (abc397_g)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 202
OUT62 144 |
| ✓ |
LcbMinRestrictedSumLiveCodeBench / atcoder / hard: Min of Restricted Sum (abc396_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 243
OUT18 170 |
| ✓ |
LcbMinXorPathLiveCodeBench / atcoder / medium: Minimum XOR Path (abc396_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 225
OUT4 044 |
| ✓ |
LcbPathDecompositionLiveCodeBench / atcoder / hard: Path Decomposition of a Tree (abc397_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 195
OUT50 185 |
| ✓ |
LcbRotatedInversionsLiveCodeBench / atcoder / hard: Rotated Inversions (abc396_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 231
OUT22 209 |
| ✓ |
LcbStrictlyIncreasingLiveCodeBench / atcoder / easy: Strictly Increasing? (abc395_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 190
OUT1 280 |
| ✓ |
LcbThermometerLiveCodeBench / atcoder / easy: Thermometer (abc397_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 185
OUT272 |
| ✓ |
LcbTicketGateLogLiveCodeBench / atcoder / medium: Ticket Gate Log (abc397_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 188
OUT3 424 |
| ✓ |
LcbTripleFourLiveCodeBench / atcoder / easy: Triple Four (abc396_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 193
OUT771 |
| ✓ |
LcbVarietySplitEasyLiveCodeBench / atcoder / medium: Variety Split Easy (abc397_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 201
OUT4 343 |
| ✓ |
LcbVarietySplitHardLiveCodeBench / atcoder / hard: Variety Split Hard (abc397_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 215
OUT29 603 |
Code Generation - LiveCodeBench v6 AtCoder (set 6)
11 passed3 failed1 broken |
73.3% |
IN138 168
OUT289 593 |
| ✓ |
LcbAbc400PartyLiveCodeBench / atcoder / easy: ABC400 Party (abc400_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 178
OUT312 |
| ✓ |
LcbAbcbaLiveCodeBench / atcoder / hard: ABCBA (abc398_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 143
OUT10 075 |
| × |
LcbBonfireLiveCodeBench / atcoder / hard: Bonfire (abc398_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim()
Context: Bonfire case0: expected [001010] got [] |
Failed |
IN9 327
OUT24 146 |
| ✓ |
LcbDoorsInCenterLiveCodeBench / atcoder / easy: Doors in the Center (abc398_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 158
OUT1 324 |
| ✓ |
LcbFullHouse3LiveCodeBench / atcoder / medium: Full House 3 (abc398_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 200
OUT1 412 |
| ✓ |
LcbGoodIntegersLiveCodeBench / atcoder / medium: 2^a b^2 good integers (abc400_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 198
OUT4 400 |
| ✓ |
LcbHammingDistanceLiveCodeBench / atcoder / easy: Hamming Distance (abc399_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 182
OUT496 |
| ✓ |
LcbMakeItForestLiveCodeBench / atcoder / medium: Make it Forest (abc399_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 180
OUT4 859 |
| ! |
LcbNotOnlyTreeGameLiveCodeBench / atcoder / hard: Not Only Tree Game (abc398_g)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 241
OUT62 144 |
| ✓ |
LcbRangePowerSumLiveCodeBench / atcoder / hard: Range Power Sum (abc399_f)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 215
OUT51 122 |
| × |
LcbRankingWithTiesLiveCodeBench / atcoder / easy: Ranking with Ties (abc399_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: RankingWithTies case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
15:76: Unknown escape sequence '\v'. Supported char escapes: \' \" \\ \n \r \t.
15:89: Unknown escape sequence '\f'. Supported char escapes: \' \" \\ \n \r \t.
Values:
run.Compiled = false |
Failed |
IN9 209
OUT4 788 |
| ✓ |
LcbReplaceLiveCodeBench / atcoder / hard: Replace (abc399_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 211
OUT50 258 |
| × |
LcbSwitchSeatsLiveCodeBench / atcoder / medium: Switch Seats (abc399_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: SwitchSeats case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
134:44: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported.
Values:
run.Compiled = false |
Failed |
IN9 256
OUT30 822 |
| ✓ |
LcbUniquenessLiveCodeBench / atcoder / medium: Uniqueness (abc398_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 184
OUT2 845 |
| ✓ |
LcbWallBreakerLiveCodeBench / atcoder / medium: Takahashi the Wall Breaker (abc400_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 286
OUT40 590 |
Code Generation - LiveCodeBench v6 AtCoder (set 7)
6 passed3 failed4 broken2 skipped |
46.2% |
IN121 079
OUT560 738 |
| – |
LcbAPowNLiveCodeBench / atcoder / hard: A^n (arc191_c) NOTE: special judge - any valid (A,M) pair is accepted; exact-match may unfairly fail a correct model output.0 AI queries
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ✓ |
LcbArcArcLiveCodeBench / atcoder / medium: ARC Arc (arc192_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 355
OUT49 422 |
| ! |
LcbBasicGridUpdatesLiveCodeBench / atcoder / hard: Basic Grid Problem with Updates (arc190_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 418
OUT62 144 |
| ! |
LcbBrokenWheelLiveCodeBench / atcoder / hard: Broken Wheel (arc193_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 335
OUT62 144 |
| × |
LcbComplementIntervalGraphLiveCodeBench / atcoder / hard: Complement Interval Graph (arc193_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: ComplementIntervalGraph case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
34:26: Expected ']' to close the indexer, found '++'.
Values:
run.Compiled = false |
Failed |
IN9 382
OUT40 710 |
| ✓ |
LcbFennecVsSnuke2LiveCodeBench / atcoder / hard: Fennec VS. Snuke 2 (arc192_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 275
OUT26 427 |
| ✓ |
LcbFractionLineLiveCodeBench / atcoder / hard: Fraction Line (arc192_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 318
OUT52 749 |
| – |
LcbInsideOrOutsideLiveCodeBench / atcoder / hard: Inside or Outside (arc190_a) NOTE: special judge - multiple minimum-cost operation sequences are accepted; exact-match may unfairly fail a correct model output.0 AI queries
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ! |
LcbMatrixPowSumLiveCodeBench / atcoder / hard: Matrix Pow Sum (arc190_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 303
OUT62 144 |
| ! |
LcbMovingPiecesOnGraphLiveCodeBench / atcoder / hard: Moving Pieces on Graph (arc191_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 312
OUT62 144 |
| × |
LcbPatisserieAbc3LiveCodeBench / atcoder / hard: Patisserie ABC 3 (abc400_g)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Compiled
Context: PatisserieAbc3 case0 did not compile: SC# compilation failed inside the script runner.
Compiler diagnostics:
33:33: Expected ']' to close the indexer, found '++'.
Values:
run.Compiled = false |
Failed |
IN9 332
OUT49 541 |
| ✓ |
LcbReplaceDigitsLiveCodeBench / atcoder / medium: Replace Digits (arc191_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 239
OUT34 807 |
| × |
LcbRingoFavoriteNumbers3LiveCodeBench / atcoder / hard: Ringo's Favorite Numbers 3 (abc400_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: RingoFavoriteNumbers3 case0 runtime error: The script exceeded the timeout of 30000 ms.
Values:
run.Success = false |
Failed |
IN9 281
OUT12 305 |
| ✓ |
LcbSnukeKyotoTripLiveCodeBench / atcoder / hard: Snuke's Kyoto Trip (arc192_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 298
OUT43 782 |
| ✓ |
LcbSumOfGeometricSeriesLiveCodeBench / atcoder / easy: Sum of Geometric Series (abc400_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench |
Passed |
IN9 231
OUT2 419 |
Code Generation - LiveCodeBench v6 AtCoder (set 8)
8 passed1 failed5 broken1 skipped |
57.1% |
IN130 396
OUT582 354 |
| ✓ |
LcbAdjacentDeleteLiveCodeBench / atcoder / hard: Adjacent Delete (arc196_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 203
OUT35 380 |
| × |
LcbCostToFlipLiveCodeBench / atcoder / hard: Cost to Flip (arc194_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: CostToFlip case0 runtime error: List index 41 is out of range. The list has 10 element(s).
Values:
run.Success = false |
Failed |
IN9 276
OUT53 898 |
| – |
LcbHamiltonianPiecesLiveCodeBench / atcoder / hard: Hamiltonian Pieces (arc195_c) NOTE: special judge - any valid placement is accepted; exact-match may unfairly fail a correct model output.0 AI queries
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer |
Skipped |
IN0
OUT0 |
| ! |
LcbMagnetsLiveCodeBench / atcoder / hard: Magnets (arc193_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 353
OUT62 144 |
| ✓ |
LcbMinimumCostSortLiveCodeBench / atcoder / hard: Minimum Cost Sort (arc194_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 216
OUT16 277 |
| ✓ |
LcbOperationsOnStackLiveCodeBench / atcoder / medium: Operations on a Stack (arc194_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 235
OUT18 620 |
| ✓ |
LcbRandomTreeDistanceLiveCodeBench / atcoder / hard: Random Tree Distance (arc195_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 367
OUT26 227 |
| ✓ |
LcbReverseBracketsLiveCodeBench / atcoder / hard: Reverse Brackets (arc194_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 278
OUT23 445 |
| ! |
LcbRoadwayLiveCodeBench / atcoder / hard: Roadway (arc196_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 424
OUT62 144 |
| ! |
LcbStronglyConnectedLiveCodeBench / atcoder / hard: Strongly Connected (arc196_c)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 299
OUT62 144 |
| ! |
LcbSwap0X1YLiveCodeBench / atcoder / hard: Swap 0^X and 1^Y (arc194_e)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 386
OUT62 144 |
| ! |
LcbSwapAndEraseLiveCodeBench / atcoder / hard: Swap and Erase (arc195_d)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 314
OUT62 144 |
| ✓ |
LcbTorusLoopLiveCodeBench / atcoder / hard: Torus Loop (arc196_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 491
OUT56 185 |
| ✓ |
LcbTwiceSubsequenceLiveCodeBench / atcoder / medium: Twice Subsequence (arc195_a)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench |
Passed |
IN9 256
OUT9 029 |
| ✓ |
LcbUniformSumLiveCodeBench / atcoder / hard: Uniform Sum (arc195_b)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench |
Passed |
IN9 298
OUT32 573 |
Code Generation - LiveCodeBench v6 LeetCode (set 1)
10 passed1 failed |
90.9% |
IN101 289
OUT158 847 |
| ✓ |
LcbCountEvenDiffPartitionsLiveCodeBench 3704 / leetcode / easy: count partitions with even sum difference (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 173
OUT951 |
| ✓ |
LcbCountMentionsPerUserLiveCodeBench 3721 / leetcode / medium: count mentions per user (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 293
OUT24 836 |
| ✓ |
LcbCountNonDecreasingSubarraysLiveCodeBench 3674 / leetcode / hard: count non-decreasing subarrays after k operations (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 212
OUT38 862 |
| ✓ |
LcbMaxFrequencyAfterOpLiveCodeBench 3751 / leetcode / medium: maximum frequency after subarray operation (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 178
OUT20 712 |
| × |
LcbMinimizeMaxEdgeWeightLiveCodeBench 3720 / leetcode / medium: minimize the maximum edge weight of graph (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: run.Success
Context: minimizeMaxEdgeWeight case0 runtime error: Cannot cast value to 'int' because it is outside the target type range.
Values:
run.Success = false |
Failed |
IN9 236
OUT14 610 |
| ✓ |
LcbMinMaxSubarraySumsLiveCodeBench 3725 / leetcode / hard: max and min sums of at most size k subarrays (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 122
OUT20 020 |
| ✓ |
LcbMinMaxSubsequenceSumsLiveCodeBench 3714 / leetcode / medium: max and min sums of at most size k subsequences (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 160
OUT13 518 |
| ✓ |
LcbPaintHouseIVLiveCodeBench 3737 / leetcode / medium: paint house IV (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 263
OUT14 175 |
| ✓ |
LcbRobotMaxCoinsLiveCodeBench 3677 / leetcode / medium: maximum amount of money robot can earn (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 262
OUT7 648 |
| ✓ |
LcbVariableLengthSubarraySumLiveCodeBench 3731 / leetcode / easy: sum of variable length subarrays (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 141
OUT1 912 |
| ✓ |
LcbZigzagGridSkipLiveCodeBench 3708 / leetcode / easy: zigzag grid traversal with skip (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 249
OUT1 603 |
Code Generation - LiveCodeBench v6 LeetCode (set 2)
9 passed1 broken |
90.0% |
IN91 905
OUT220 394 |
| ✓ |
LcbAssignElementsToGroupsLiveCodeBench 3760 / leetcode / medium: assign elements to groups with constraints (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 254
OUT560 |
| ✓ |
LcbCountSubstringsDivLastDigitLiveCodeBench 3696 / leetcode / hard: count substrings divisible by last digit (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 123
OUT16 401 |
| ✓ |
LcbEatPizzasMaxWeightLiveCodeBench 3779 / leetcode / medium: eat pizzas (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 225
OUT35 169 |
| ✓ |
LcbMaxEvenOddFreqDiffLiveCodeBench 3753 / leetcode / easy: maximum difference between even and odd frequency I (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 161
OUT3 674 |
| ✓ |
LcbMaximizeMinGameScoreLiveCodeBench 3762 / leetcode / hard: maximize the minimum game score (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 231
OUT34 104 |
| ✓ |
LcbMaxManhattanAfterKLiveCodeBench 3754 / leetcode / medium: maximum manhattan distance after k changes (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 231
OUT10 528 |
| ✓ |
LcbMinIncrementsTargetMultiplesLiveCodeBench 3697 / leetcode / hard: minimum increments for target multiples in an array (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 157
OUT54 406 |
| ! |
LcbSelectKDisjointSpecialLiveCodeBench 3771 / leetcode / medium: select k disjoint special substrings (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 176
OUT62 144 |
| ✓ |
LcbSortMatrixDiagonalsLiveCodeBench 3748 / leetcode / medium: sort matrix by diagonals (Pattern A, single-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 182
OUT2 244 |
| ✓ |
LcbSpecialSubstringLengthKLiveCodeBench 3709 / leetcode / easy: find special substring of length k (Pattern A, multi-arg)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 165
OUT1 164 |
Code Generation - LiveCodeBench v6 LeetCode (set 3)
10 passed1 broken |
90.9% |
IN101 383
OUT299 828 |
| ✓ |
LcbChooseKMaxSumLiveCodeBench / leetcode / medium / id 3759: for each i, sum of k largest nums2[j] where nums1[j] < nums1[i]1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 257
OUT15 602 |
| ✓ |
LcbFruitsIntoBasketsLiveCodeBench / leetcode / medium / id 3791: count fruit types that remain unplaced into baskets1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 231
OUT4 327 |
| ✓ |
LcbLargestAlmostMissingLiveCodeBench / leetcode / easy / id 3705: largest integer appearing in exactly one size-k subarray1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 180
OUT10 545 |
| ✓ |
LcbLexSmallestGeneratedLiveCodeBench / leetcode / hard / id 3770: lexicographically smallest string generated from str1 and str21 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 236
OUT53 560 |
| ✓ |
LcbLongestPalinSubseqKOpsLiveCodeBench / leetcode / medium / id 3786: longest palindromic subsequence after at most k letter shifts1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 202
OUT38 996 |
| ✓ |
LcbLongestVDiagonalLiveCodeBench / leetcode / hard / id 3733: length of longest V-shaped diagonal segment1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 279
OUT28 985 |
| ! |
LcbMaxDistanceSquareLiveCodeBench / leetcode / hard / id 3781: maximize the minimum Manhattan distance among k boundary points1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 274
OUT62 144 |
| ✓ |
LcbMaxSubarraysConflictLiveCodeBench / leetcode / hard / id 3789: max non-empty subarrays after removing one conflicting pair1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 218
OUT45 787 |
| ✓ |
LcbMaxSumKSubarraysLiveCodeBench / leetcode / medium / id 3722: max sum of k non-overlapping subarrays each length >= m1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 155
OUT16 801 |
| ✓ |
LcbMaxSumWithLimitsLiveCodeBench / leetcode / medium / id 3764: maximum sum of at most k elements with per-row limits1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 190
OUT4 503 |
| ✓ |
LcbSameDigitsAfterOpsLiveCodeBench / leetcode / easy / id 3768: check if final two digits are equal after repeated pairwise sums1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 161
OUT18 578 |
Code Generation - LiveCodeBench v6 LeetCode (set 4)
8 passed1 failed1 broken |
80.0% |
IN92 002
OUT238 786 |
| ✓ |
LcbClosestEqualQueriesLiveCodeBench / leetcode / medium / id 3750: circular min distance to an equal-valued element per query1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 203
OUT4 914 |
| ✓ |
LcbCountBeautifulNumbersLiveCodeBench / leetcode / hard / id 3801: count numbers in [l,r] whose digit-product is divisible by digit-sum1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 155
OUT32 174 |
| ! |
LcbLongestPalinConcatLiveCodeBench / leetcode / medium / id 3793: longest palindrome from a substring of s concatenated with one of t1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 165
OUT62 144 |
| ✓ |
LcbMaxContainersShipLiveCodeBench / leetcode / easy / id 3817: max containers of weight w on an n x n deck within maxWeight1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 171
OUT1 604 |
| ✓ |
LcbMaxUniqueSubarraySumLiveCodeBench / leetcode / easy / id 3788: max sum of a subarray with all-unique elements after deletions1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 174
OUT6 382 |
| ✓ |
LcbMinCostReachPositionsLiveCodeBench / leetcode / easy / id 3832: min total cost to reach each position via prefix-min swaps1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 225
OUT4 380 |
| ✓ |
LcbMinOpsElementsZeroLiveCodeBench / leetcode / hard / id 3744: sum over queries of min pair-divide operations to zero a range1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 178
OUT15 451 |
| × |
LcbMinTimeBrewPotionsLiveCodeBench / leetcode / medium / id 3794: min synchronized time for n wizards to brew m potions in order1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBenchAssertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i])
Context: mintime case0: expected 110 got 88 |
Failed |
IN9 247
OUT24 272 |
| ✓ |
LcbPropertiesGraphLiveCodeBench / leetcode / medium / id 3809: connected components where edges need >= k shared distinct values1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 234
OUT29 258 |
| ✓ |
LcbZeroArrayTransformIVLiveCodeBench / leetcode / medium / id 3795: min k queries to reduce nums to a zero array (subset decrements)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 250
OUT58 207 |
Code Generation - LiveCodeBench v6 LeetCode (set 5)
10 passed1 failed |
90.9% |
IN101 094
OUT240 917 |
| ✓ |
LcbFindValidDigitPairLiveCodeBench / leetcode / easy: find-valid-pair-of-adjacent-digits-in-string (id 3736)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 161
OUT1 057 |
| ✓ |
LcbLongestSpecialPathLiveCodeBench / leetcode / hard: longest-special-path (id 3687)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 281
OUT25 274 |
| ✓ |
LcbManhattanArrangementsLiveCodeBench / leetcode / hard: manhattan-distances-of-all-arrangements-of-pieces (id 3739)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 177
OUT26 488 |
| ✓ |
LcbMaxAdjacentCircularLiveCodeBench / leetcode / easy: maximum-difference-between-adjacent-elements-in-a-circular-array (id 3747)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 104
OUT656 |
| ✓ |
LcbMaxFreeTimeLiveCodeBench / leetcode / medium: reschedule-meetings-for-maximum-free-time-i (id 3743)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 283
OUT7 250 |
| ✓ |
LcbMaxProductAlternatingSumLiveCodeBench / leetcode / hard: maximum-product-of-subsequences-with-an-alternating-sum-equal-to-k (id 3777)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 209
OUT57 095 |
| ✓ |
LcbMinCostGoodCaptionLiveCodeBench / leetcode / hard: minimum-cost-good-caption (id 3701)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 212
OUT32 445 |
| ✓ |
LcbMinOpsKSubarraysEqualLiveCodeBench / leetcode / hard: minimum-operations-to-make-elements-within-k-subarrays-equal (id 3717)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 185
OUT60 370 |
| × |
LcbMinPairRemovalSortLiveCodeBench / leetcode / easy: minimum-pair-removal-to-sort-array-i (id 3773)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBenchAssertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i])
Context: minPairRemoval case0: expected 2 got 0 |
Failed |
IN9 132
OUT18 660 |
| ✓ |
LcbSeparateSquaresLiveCodeBench / leetcode / medium: separate-squares-i (id 3763)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 196
OUT10 381 |
| ✓ |
LcbSumOfGoodNumbersLiveCodeBench / leetcode / easy: sum-of-good-numbers (id 3723)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 154
OUT1 241 |
Code Generation - LiveCodeBench v6 LeetCode (set 6)
9 passed1 broken |
90.0% |
IN91 892
OUT185 281 |
| ✓ |
LcbCountCopyArraysLiveCodeBench / leetcode / medium: find-the-number-of-copy-arrays (id 3785)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 255
OUT2 035 |
| ! |
LcbLongestCommonPrefixRemovalLiveCodeBench / leetcode / hard: longest-common-prefix-of-k-strings-after-removal (id 3784)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBenchSkipped: AI output broken/partial |
Broken |
IN9 197
OUT62 144 |
| ✓ |
LcbMaxActiveSectionsTradeLiveCodeBench / leetcode / medium: maximize-active-section-with-trade-i (id 3805)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 241
OUT11 452 |
| ✓ |
LcbMinCostDivideArrayLiveCodeBench / leetcode / hard: minimum-cost-to-divide-array-into-subarrays (id 3765)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 245
OUT29 830 |
| ✓ |
LcbMinCostRemoveElementsLiveCodeBench / leetcode / medium: find-minimum-cost-to-remove-array-elements (id 3776)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench |
Passed |
IN9 173
OUT15 843 |
| ✓ |
LcbPermutationsIVLiveCodeBench / leetcode / hard: permutations-iv (id 3783)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 162
OUT27 218 |
| ✓ |
LcbReverseDegreeLiveCodeBench / leetcode / easy: reverse-degree-of-a-string (id 3811)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 129
OUT1 326 |
| ✓ |
LcbShortestMatchingSubstringLiveCodeBench / leetcode / hard: shortest-matching-substring (id 3692)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench |
Passed |
IN9 190
OUT31 522 |
| ✓ |
LcbTransformArrayParityLiveCodeBench / leetcode / easy: transform-array-by-parity (id 3778)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 147
OUT443 |
| ✓ |
LcbUnique3DigitEvenLiveCodeBench / leetcode / easy: unique-3-digit-even-numbers (id 3799)1 AI query
0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench |
Passed |
IN9 153
OUT3 468 |