Ai4Users.comLocal AI & LLM community
Sign in to contributeSign in

Qwen 3.8 27B NVFP4 Think: medium | Benchmark #68

Described in:Qwen 3.8 27B vs Qwen 3.6 27B: benchmark results analysis

Benchmark summary

LiveCodeBench for SC#

ModelQwen 3.8 27B QuantizationNVFP4 ModeThink: medium

LiveCodeBench adapted to SC#, adding an extra challenge: models must solve newer coding problems while generating correct code in a custom sandboxed language from its provided specification.

Score 856/1022 83.8% passed
856 passed136 failed30 broken32 skipped1054 total 1022 AI queries 0 tool calls TOKENS IN9 425 269 TOKENS OUT10 762 192

Results by difficulty

3 groups
Level Easy
307 / 320 95.9%
passed
320 AI queries 0 tool calls IN2 941 939 OUT936 922
Level Medium
328 / 375 87.5%
passed
375 AI queries 0 tool calls IN3 456 566 OUT3 194 885
Level Hard
221 / 327 67.6%
passed
327 AI queries 0 tool calls IN3 026 764 OUT6 630 385

Results by category

14 groups
Category CodeGeneration
83.8% 856/1022 passed
1022 AI queries 0 tool calls TOKENS IN9 425 269 TOKENS OUT10 762 192
Category V1@AtCoder
82.2% 162/197 passed
197 AI queries 0 tool calls TOKENS IN1 819 839 TOKENS OUT1 631 986
Category V1@Codeforces
77.8% 7/9 passed
9 AI queries 0 tool calls TOKENS IN83 318 TOKENS OUT39 443
Category V1@LeetCode
90.6% 164/181 passed
181 AI queries 0 tool calls TOKENS IN1 659 983 TOKENS OUT1 286 527
Category V2@AtCoder
90.7% 49/54 passed
54 AI queries 0 tool calls TOKENS IN500 779 TOKENS OUT250 745
Category V2@LeetCode
90.7% 49/54 passed
54 AI queries 0 tool calls TOKENS IN495 818 TOKENS OUT427 282
Category V3@AtCoder
72.5% 37/51 passed
51 AI queries 0 tool calls TOKENS IN471 769 TOKENS OUT542 583
Category V3@LeetCode
91.5% 43/47 passed
47 AI queries 0 tool calls TOKENS IN433 141 TOKENS OUT280 944
Category V4@AtCoder
78.7% 48/61 passed
61 AI queries 0 tool calls TOKENS IN564 863 TOKENS OUT902 246
Category V4@LeetCode
94.4% 34/36 passed
36 AI queries 0 tool calls TOKENS IN332 193 TOKENS OUT406 841
Category V5@AtCoder
74.7% 74/99 passed
99 AI queries 0 tool calls TOKENS IN916 143 TOKENS OUT1 478 633
Category V5@LeetCode
87.1% 54/62 passed
62 AI queries 0 tool calls TOKENS IN570 073 TOKENS OUT856 548
Category V6@AtCoder
76.9% 83/108 passed
108 AI queries 0 tool calls TOKENS IN997 785 TOKENS OUT1 858 878
Category V6@LeetCode
82.5% 52/63 passed
63 AI queries 0 tool calls TOKENS IN579 565 TOKENS OUT799 536

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Code Generation - LiveCodeBench v1 AtCoder (set 1) 6 passed2 failed
75.0%
 IN74 040 OUT70 911
×
LcbAntiDdosCountLiveCodeBench / atcoder abc301_f / hard: Anti (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AntiDdosCount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:67: Unexpected character '`'. 1:69: Unexpected character '`'. 3:2: Char literals must contain exactly one character and close with '''. 3:184: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
 Failed IN9 280 OUT24 491
✓
LcbAtCoderCardsLiveCodeBench / atcoder abc301_c / medium: AtCoder Cards (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 212 OUT6 509
✓
LcbAttackCountLiveCodeBench / atcoder abc302_a / easy: Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 166 OUT916
✓
LcbBitmaskLeqNLiveCodeBench / atcoder abc301_d / medium: Bitmask (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 240 OUT26 440
✓
LcbFillTheGapsLiveCodeBench / atcoder abc301_b / easy: Fill the Gaps (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 275 OUT1 732
✓
LcbFindSnukeLiveCodeBench / atcoder abc302_b / medium: Find snuke (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 316 OUT2 607
✓
LcbOverallWinnerLiveCodeBench / atcoder abc301_a / easy: Overall Winner (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 226 OUT909
×
LcbPacCandyPathLiveCodeBench / atcoder abc301_e / hard: Pac (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: PacCandyPath case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 325 OUT7 307
Code Generation - LiveCodeBench v1 AtCoder (set 10) 5 passed1 failed2 skipped
83.3%
 IN55 271 OUT79 213
✓
LcbBlueSpringPassesLiveCodeBench / atcoder / medium: abc318_c Blue Spring (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 215 OUT1 654
–
LcbBookPrerequisitesLiveCodeBench / atcoder / hard: abc315_e Prerequisites (Pattern B, stdin) FLAG: non-unique output (any valid reading order accepted); exact-string driver can reject a correct answer -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: non-unique output: multiple valid reading orders accepted; exact-string driver would reject correct answers
 Skipped IN0 OUT0
–
LcbCheckpointShortcutsLiveCodeBench / atcoder / hard: abc315_f Shortcuts (Pattern B, stdin) FLAG: float output (Euclidean distance sum); exact-string driver cannot do tolerance -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# stdin driver: floating-point distance output needs tolerance comparison; exact string compare unsafe
 Skipped IN0 OUT0
✓
LcbFullMoonDaysLiveCodeBench / atcoder / easy: abc318_a Full Moon (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 185 OUT1 106
✓
LcbIceCreamFlavorsLiveCodeBench / atcoder / medium: abc315_c Flavors (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 209 OUT12 837
✓
LcbMagicalCookiesLiveCodeBench / atcoder / medium: abc315_d Magical Cookies (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 249 OUT32 983
✓
LcbMiddleDayLiveCodeBench / atcoder / easy: abc315_b The Middle Day (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 227 OUT1 215
×
LcbOverlappingSheetsLiveCodeBench / atcoder / easy: abc318_b Overlapping sheets (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OverlappingSheets case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 264:15: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported. Values: run.Compiled = false
 Failed IN9 186 OUT29 418
Code Generation - LiveCodeBench v1 AtCoder (set 11) 7 passed1 skipped
100.0%
 IN64 449 OUT39 361
✓
LcbBusStopsQueriesLiveCodeBench / atcoder / hard: abc319_e Bus Stops (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 304 OUT1 712
–
LcbFalseHopeProbabilityLiveCodeBench / atcoder / medium: abc319_c False Hope (Pattern B, stdin) FLAG: float output (probability); exact-string driver cannot do tolerance -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: SC# stdin driver: probability (float) output needs tolerance comparison; exact string compare unsafe
 Skipped IN0 OUT0
✓
LcbLeylandNumberLiveCodeBench / atcoder / easy: abc320_a Leyland Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 150 OUT1 016
✓
LcbLongestPalindromeSubLiveCodeBench / atcoder / easy: abc320_b Longest Palindrome (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 159 OUT4 764
✓
LcbMeasureDivisorsLiveCodeBench / atcoder / easy: abc319_b Measure (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 212 OUT978
✓
LcbMinimumWindowWidthLiveCodeBench / atcoder / medium: abc319_d Minimum Width (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 231 OUT10 567
✓
LcbSandwichTriplesLiveCodeBench / atcoder / hard: abc318_e Sandwiches (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 178 OUT6 004
✓
LcbWeightedMaxMatchingLiveCodeBench / atcoder / medium: abc318_d General Weighted Max Matching (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 215 OUT14 320
Code Generation - LiveCodeBench v1 AtCoder (set 12) 5 passed4 failed
55.6%
 IN83 111 OUT70 483
✓
Lcb321LikeLiveCodeBench / atcoder / easy: abc321_a 321-like Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 243 OUT968
×
LcbCompleteBinaryTreeLiveCodeBench / atcoder / hard: abc321_e Complete Binary Tree (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CompleteBinaryTree case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 37:20: The shift count of '>>' must be 'int', but got 'long'. 38:23: The shift count of '>>' must be 'int', but got 'long'. Values: run.Compiled = false
 Failed IN9 233 OUT11 529
×
LcbCutoffLiveCodeBench / atcoder / easy: abc321_b Cutoff (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Cutoff case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 82:22: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported. Values: run.Compiled = false
 Failed IN9 261 OUT17 238
✓
LcbFirstAbc2LiveCodeBench / atcoder / easy: abc322_a First ABC 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 184 OUT962
×
LcbKth321LikeLiveCodeBench / atcoder / medium: abc321_c K-th 321-like Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Kth321Like case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:13: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '1'. Values: run.Compiled = false
 Failed IN9 220 OUT4 173
✓
LcbRelativePositionLiveCodeBench / atcoder / medium: abc320_d Relative Position (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 241 OUT5 867
✓
LcbSetMenuLiveCodeBench / atcoder / medium: abc321_d Set Menu (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 219 OUT1 857
✓
LcbSlotStrategy2LiveCodeBench / atcoder / medium: abc320_c Slot Strategy 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 258 OUT16 064
×
LcbSomenNagashiLiveCodeBench / atcoder / hard: abc320_e Somen Nagashi (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SomenNagashi case0: expected [101 10 1000] got [1001 10 100]
 Failed IN9 252 OUT11 825
Code Generation - LiveCodeBench v1 AtCoder (set 13) 7 passed2 failed
77.8%
 IN83 141 OUT32 529
✓
LcbFestivalLiveCodeBench / atcoder / medium: abc322_c Festival (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 218 OUT4 349
✓
LcbMergeSlimesLiveCodeBench / atcoder / hard: abc323_d Merge Slimes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 200 OUT3 471
×
LcbPlaylistProbLiveCodeBench / atcoder / hard: abc323_e Playlist (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PlaylistProb case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:16: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
 Failed IN9 295 OUT8 025
×
LcbPolyominoLiveCodeBench / atcoder / medium: abc322_d Polyomino (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Polyomino case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 96:23: The if condition must be 'bool', but it has type 'void'. 155:34: The if condition must be 'bool', but it has type 'void'. Values: run.Compiled = false
 Failed IN9 272 OUT9 738
✓
LcbPrefixSuffixLiveCodeBench / atcoder / easy: abc322_b Prefix and Suffix (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 230 OUT347
✓
LcbProductDevelopmentLiveCodeBench / atcoder / hard: abc322_e Product Development (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 233 OUT2 552
✓
LcbRoundRobinRankLiveCodeBench / atcoder / easy: abc323_b Round (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 241 OUT1 515
✓
LcbWeakBeatsLiveCodeBench / atcoder / easy: abc323_a Weak Beats (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 186 OUT516
✓
LcbWorldTourFinalsLiveCodeBench / atcoder / medium: abc323_c World Tour Finals (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 266 OUT2 016
Code Generation - LiveCodeBench v1 AtCoder (set 14) 5 passed1 failed1 skipped
83.3%
 IN55 068 OUT86 856
✓
Lcb2x3yLiveCodeBench / atcoder / easy: abc324_b 2^x 3^y (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 150 OUT451
✓
LcbAllValuesEqualLiveCodeBench / atcoder / easy: abc324_a Same (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 147 OUT1 743
–
LcbBeautifulPathLiveCodeBench / atcoder / hard: abc324_f Beautiful Path (Pattern B, stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: float stdout: stdin driver compares stdout by exact trimmed string, cannot tolerance-match a floating-point ratio like 0.7500000000000000
 Skipped IN0 OUT0
✓
LcbErrorCorrectionLiveCodeBench / atcoder / medium: abc324_c Error Correction (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 266 OUT8 073
✓
LcbJointTwoStringsLiveCodeBench / atcoder / hard: abc324_e Joint Two Strings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 200 OUT14 738
×
LcbSquarePermutationLiveCodeBench / atcoder / hard: abc324_d Square Permutation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SquarePermutation case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 163 OUT61 791
✓
LcbSurnameSanLiveCodeBench / atcoder / easy: abc325_a Takahashi san (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 142 OUT60
Code Generation - LiveCodeBench v1 AtCoder (set 15) 6 passed2 failed1 skipped
75.0%
 IN74 277 OUT27 809
✓
Lcb326LikeNumberLiveCodeBench / atcoder / abc326_b: 3261 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 223 OUT2 058
–
LcbAbcPuzzleLiveCodeBench / atcoder / abc326_d: ABC Puzzle NOTE: output is NON-UNIQUE (any valid grid is accepted); exact string compare is unsafe -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: non-unique output: any valid grid is accepted, exact string compare unsafe
 Skipped IN0 OUT0
✓
LcbCarTrainTravelLiveCodeBench / atcoder / abc325_e: Our clients, please wait a moment1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 355 OUT2 540
✓
LcbGiftIntervalLiveCodeBench / atcoder / abc326_c: Peak1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 247 OUT1 023
×
LcbPrintingMachineLiveCodeBench / atcoder / abc325_d: Printing Machine1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PrintingMachine case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:16: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
 Failed IN9 284 OUT3 514
✓
LcbSensorClustersLiveCodeBench / atcoder / abc325_c: Sensors1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 308 OUT5 357
×
LcbSensorCostDilemmaLiveCodeBench / atcoder / abc325_f: Sensor Optimization Dilemma1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SensorCostDilemma case0: expected [17] got [15]
 Failed IN9 378 OUT10 929
✓
LcbStairsOrElevatorLiveCodeBench / atcoder / abc326_a: 2UP3DOWN1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 199 OUT432
✓
LcbWorldMeetingLiveCodeBench / atcoder / abc325_b: World Meeting1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 283 OUT1 956
Code Generation - LiveCodeBench v1 AtCoder (set 16) 6 passed1 failed1 skipped
85.7%
 IN64 697 OUT31 408
✓
LcbAdjacentABLiveCodeBench / atcoder / abc327_a: ab1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 196 OUT732
✓
LcbGoodTupleLiveCodeBench / atcoder / abc327_d: Good Tuple Problem1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 277 OUT11 506
–
LcbMaximizeRatingLiveCodeBench / atcoder / abc327_e: Maximize Rating NOTE: output is a FLOAT with tolerance 1e-6; exact trimmed string compare is unsafe -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: floating-point output with 1e-6 tolerance; exact string compare unsafe
 Skipped IN0 OUT0
✓
LcbNotTooHardLiveCodeBench / atcoder / abc328_a: Not Too Hard1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 197 OUT152
✓
LcbNumberPlaceLiveCodeBench / atcoder / abc327_c: Number Place1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 295 OUT1 955
✓
LcbPerfectPowerAALiveCodeBench / atcoder / abc327_b: A^A1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 177 OUT1 725
✓
LcbRepdigitDatesLiveCodeBench / atcoder / abc328_b: 11/111 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 214 OUT2 326
×
LcbSalaryExpectationLiveCodeBench / atcoder / abc326_e: Revenge of "The Salary of AtCoder Inc."1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SalaryExpectation case0 runtime error: List index 33 is out of range. The list has 3 element(s). Values: run.Success = false
 Failed IN9 341 OUT13 012
Code Generation - LiveCodeBench v1 AtCoder (set 17) 6 passed2 failed
75.0%
 IN73 838 OUT29 530
✓
LcbConsecutivePairsLiveCodeBench / atcoder / abc328_c: Consecutive1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 281 OUT1 354
✓
LcbCountRepeatsLiveCodeBench / atcoder / abc329_c: Count xxx1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 196 OUT1 503
×
LcbElectionReportLiveCodeBench / atcoder / abc329_d: Election Quick Report1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: ElectionReport case0: expected [1 1 2 2 1 1 3] got [2 2 2 2 2 3]
 Failed IN9 260 OUT6 233
×
LcbModuloMstLiveCodeBench / atcoder / abc328_e: Modulo MST1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: ModuloMst case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 292 OUT3 046
✓
LcbSecondLargestLiveCodeBench / atcoder / abc329_b: Next1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 185 OUT1 792
✓
LcbSpreadCharsLiveCodeBench / atcoder / abc329_a: Spread1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 173 OUT432
✓
LcbStampMatchLiveCodeBench / atcoder / abc329_e: Stamp1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 252 OUT13 061
✓
LcbTakeAbcLiveCodeBench / atcoder / abc328_d: Take ABC1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 199 OUT2 109
Code Generation - LiveCodeBench v1 AtCoder (set 18) 8 passed1 failed
88.9%
 IN82 878 OUT55 815
✓
LcbColoredBallLiveCodeBench / atcoder / hard: Colored Ball [LCB id: abc329_f]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 245 OUT27 721
✓
LcbCountingLsLiveCodeBench / atcoder / medium: Counting Ls [LCB id: abc330_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 294 OUT2 427
✓
LcbCountingPassesLiveCodeBench / atcoder / easy: Counting Passes [LCB id: abc330_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 164 OUT1 160
✓
LcbEggPacksLiveCodeBench / atcoder / easy: Buy One Carton of Milk (egg packs) [LCB id: abc331_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 176 OUT5 723
✓
LcbMexAndUpdateLiveCodeBench / atcoder / hard: Mex and Update [LCB id: abc330_e]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 250 OUT2 313
✓
LcbMinimizeAbs1LiveCodeBench / atcoder / easy: Minimize Abs 1 [LCB id: abc330_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 238 OUT1 664
✓
LcbMinimizeAbs2LiveCodeBench / atcoder / medium: Minimize Abs 2 [LCB id: abc330_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 144 OUT11 356
✓
LcbSumGreaterThanMeLiveCodeBench / atcoder / medium: Sum of Numbers Greater Than Me [LCB id: abc331_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 186 OUT2 878
×
LcbTomorrowCalendarLiveCodeBench / atcoder / easy: Tomorrow [LCB id: abc331_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TomorrowCalendar case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 26:14: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
 Failed IN9 181 OUT573
Code Generation - LiveCodeBench v1 AtCoder (set 19) 6 passed2 failed
75.0%
 IN74 295 OUT116 214
✓
LcbGlassAndMugLiveCodeBench / atcoder / easy: Glass and Mug [LCB id: abc332_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 267 OUT48 408
✓
LcbOnlineShoppingLiveCodeBench / atcoder / easy: Online Shopping [LCB id: abc332_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 236 OUT1 251
✓
LcbPentagonDiagonalLiveCodeBench / atcoder / easy: Pentagon [LCB id: abc333_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 248 OUT1 004
×
LcbSetMealLiveCodeBench / atcoder / hard: Set Meal [LCB id: abc331_e]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SetMeal case0: expected [31] got [32]
 Failed IN9 304 OUT2 082
×
LcbSwappingPuzzleLiveCodeBench / atcoder / hard: Swapping Puzzle [LCB id: abc332_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SwappingPuzzle case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:21: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('. Values: run.Compiled = false
 Failed IN9 362 OUT44 528
✓
LcbThreeThreesLiveCodeBench / atcoder / easy: Three Threes [LCB id: abc333_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 140 OUT239
✓
LcbTilePatternLiveCodeBench / atcoder / hard: Tile Pattern [LCB id: abc331_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 344 OUT17 176
✓
LcbTShirtsLiveCodeBench / atcoder / medium: T-Shirts [LCB id: abc332_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 394 OUT1 526
Code Generation - LiveCodeBench v1 AtCoder (set 2) 4 passed4 failed
50.0%
 IN74 091 OUT70 812
×
LcbAlmostEqualRearrangeLiveCodeBench / atcoder abc302_c / medium: Almost Equal (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AlmostEqualRearrange case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 57:23: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
 Failed IN9 218 OUT2 224
×
LcbDashHealthLiveCodeBench / atcoder abc303_c / medium: Dash (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DashHealth case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:25: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. 47:25: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
 Failed IN9 310 OUT2 227
×
LcbDiscordBadMoodLiveCodeBench / atcoder abc303_b / easy: Discord (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: DiscordBadMood case0: expected [2] got [1]
 Failed IN9 235 OUT4 823
✓
LcbImpartialGiftLiveCodeBench / atcoder abc302_d / medium: Impartial Gift (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 260 OUT4 571
×
LcbIsolationQueriesLiveCodeBench / atcoder abc302_e / hard: Isolation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IsolationQueries case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:28: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('. Values: run.Compiled = false
 Failed IN9 247 OUT14 579
✓
LcbMergeSetLiveCodeBench / atcoder abc302_f / hard: Merge Set (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 302 OUT26 191
✓
LcbShiftVsCapsLockLiveCodeBench / atcoder abc303_d / medium: Shift vs. CapsLock (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 270 OUT15 738
✓
LcbSimilarStringLiveCodeBench / atcoder abc303_a / easy: Similar String (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 249 OUT459
Code Generation - LiveCodeBench v1 AtCoder (set 20) 6 passed1 failed1 skipped
85.7%
 IN64 683 OUT88 545
×
LcbChristmasColorGridLiveCodeBench / atcoder / hard: Christmas Color Grid 1 [LCB id: abc334_e]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: ChristmasColorGrid case0: expected [499122178] got [2]
 Failed IN9 373 OUT17 482
✓
LcbChristmasPresentLiveCodeBench / atcoder / easy: Christmas Present [LCB id: abc334_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 157 OUT335
✓
LcbChristmasTreesLiveCodeBench / atcoder / medium: Christmas Trees [LCB id: abc334_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 234 OUT3 963
✓
LcbEraseLeavesLiveCodeBench / atcoder / medium: Erase Leaves [LCB id: abc333_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 236 OUT14 551
✓
LcbReindeerSleighLiveCodeBench / atcoder / medium: Reindeer and Sleigh [LCB id: abc334_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 252 OUT1 239
✓
LcbRepunitTrioLiveCodeBench / atcoder / medium: Repunit Trio [LCB id: abc333_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 178 OUT22 646
✓
LcbSocks2LiveCodeBench / atcoder / medium: Socks 2 [LCB id: abc334_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 253 OUT28 329
–
LcbTakahashiQuestLiveCodeBench / atcoder / hard: Takahashi Quest [LCB id: abc333_e]0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: non-unique output: any valid pick-up sequence achieving K_min is accepted, cannot value-compare against a single oracle line
 Skipped IN0 OUT0
Code Generation - LiveCodeBench v1 AtCoder (set 21) 7 passed1 failed1 skipped
87.5%
 IN73 592 OUT47 185
✓
Lcb2023To2024LiveCodeBench / atcoder / abc335_a: 2023 -> 2024 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 147 OUT115
✓
LcbCtzLiveCodeBench / atcoder / abc336_b: CTZ (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 174 OUT343
✓
LcbEvenDigitsLiveCodeBench / atcoder / abc336_c: Even Digits (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 231 OUT1 639
✓
LcbLongLoongLiveCodeBench / atcoder / abc336_a: Long Loong (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 174 OUT361
–
LcbLoongAndTakahashiLiveCodeBench / atcoder / abc335_d: Loong and Takahashi (Pattern B, stdin) [NON-UNIQUE output]0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
×
LcbLoongTrackingLiveCodeBench / atcoder / abc335_c: Loong Tracking (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: LoongTracking case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 44:25: Type 'string' has no supported method named 'TrimEnd'. Values: run.Compiled = false
 Failed IN9 240 OUT2 052
✓
LcbPyramidSequenceLiveCodeBench / atcoder / abc336_d: Pyramid (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 228 OUT40 639
✓
LcbScoreboardLiveCodeBench / atcoder / abc337_a: Scoreboard (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 193 OUT931
✓
LcbTetrahedralNumberLiveCodeBench / atcoder / abc335_b: Tetrahedral Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 205 OUT1 105
Code Generation - LiveCodeBench v1 AtCoder (set 22) 7 passed1 skipped
100.0%
 IN64 412 OUT34 435
–
LcbBadJuiceLiveCodeBench / atcoder / abc337_e: Bad Juice (INTERACTIVE — not expressible as batch stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# subset: interactive problem (two-way judge interaction + non-unique valid output)
 Skipped IN0 OUT0
✓
LcbCapitalizedLiveCodeBench / atcoder / abc338_a: Capitalized? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 141 OUT989
✓
LcbCheatingGomokuLiveCodeBench / atcoder / abc337_d: Cheating Gomoku Narabe (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 230 OUT1 491
✓
LcbExtendedAbcLiveCodeBench / atcoder / abc337_b: Extended ABC (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 196 OUT912
✓
LcbFrequencyLiveCodeBench / atcoder / abc338_b: Frequency (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 144 OUT858
✓
LcbIslandTourLiveCodeBench / atcoder / abc338_d: Island Tour (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 282 OUT7 921
✓
LcbLeftoverRecipesLiveCodeBench / atcoder / abc338_c: Leftover Recipes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 224 OUT19 684
✓
LcbLiningUp2LiveCodeBench / atcoder / abc337_c: Lining Up 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 195 OUT2 580
Code Generation - LiveCodeBench v1 AtCoder (set 23) 7 passed1 failed
87.5%
 IN73 604 OUT21 469
✓
LcbAppendQueryLiveCodeBench / atcoder / abc340_b: Append (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 183 OUT1 385
✓
LcbArithmeticProgressionLiveCodeBench / atcoder / abc340_a: Arithmetic Progression (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 148 OUT978
✓
LcbChordsLiveCodeBench / atcoder / abc338_e: Chords (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 191 OUT7 007
✓
LcbLangtonsTakahashiLiveCodeBench / atcoder / abc339_b: Langton's Takahashi (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 253 OUT1 620
✓
LcbNegativeTspLiveCodeBench / atcoder / abc338_f: Negative Traveling Salesman (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 242 OUT4 459
×
LcbPerfectBusLiveCodeBench / atcoder / abc339_c: Perfect Bus (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: PerfectBus case2 runtime error: Cannot parse '4-1' as long. Values: run.Success = false
 Failed IN9 190 OUT1 968
✓
LcbSynchronizedPlayersLiveCodeBench / atcoder / abc339_d: Synchronized Players (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 240 OUT3 253
✓
LcbTldLiveCodeBench / atcoder / abc339_a: TLD (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 157 OUT799
Code Generation - LiveCodeBench v1 AtCoder (set 24) 9 passed1 broken
90.0%
 IN92 488 OUT82 983
✓
LcbAlternatingStringLiveCodeBench / atcoder abc341_e / hard: Alternating String (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 261 OUT13 155
✓
LcbBreakdownLiveCodeBench / atcoder abc341_f / hard: Breakdown (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 324 OUT6 224
✓
LcbDivideAndDivideLiveCodeBench / atcoder abc340_c / medium: Divide and Divide (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 246 OUT4 875
✓
LcbForeignExchangeLiveCodeBench / atcoder abc341_b / easy: Foreign Exchange (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 299 OUT3 083
✓
LcbMancala2LiveCodeBench / atcoder abc340_e / hard: Mancala 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 301 OUT24 581
✓
LcbOnlyOneOfTwoLiveCodeBench / atcoder abc341_d / medium: Only one of two (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 185 OUT7 125
✓
LcbPrint341LiveCodeBench / atcoder abc341_a / easy: Print 341 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 146 OUT462
✓
LcbSuperTakahashiBrosLiveCodeBench / atcoder abc340_d / hard: Super Takahashi Bros. (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 290 OUT5 660
!
LcbTakahashiGetsLostLiveCodeBench / atcoder abc341_c / medium: Takahashi Gets Lost (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 275 OUT16 698
✓
LcbYayLiveCodeBench / atcoder abc342_a / easy: Yay! (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 161 OUT1 120
Code Generation - LiveCodeBench v1 AtCoder (set 25) 7 passed2 skipped
100.0%
 IN64 813 OUT69 125
✓
LcbAdjacencyMatrixLiveCodeBench / atcoder abc343_b / easy: Adjacency Matrix (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 252 OUT1 509
✓
LcbDiversityOfScoresLiveCodeBench / atcoder abc343_d / medium: Diversity of Scores (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 272 OUT5 616
✓
LcbLastTrainLiveCodeBench / atcoder abc342_e / hard: Last Train (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 409 OUT25 765
✓
LcbManyReplacementLiveCodeBench / atcoder abc342_c / medium: Many Replacement (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 238 OUT3 729
✓
LcbPalindromicCubeLiveCodeBench / atcoder abc343_c / medium: 343 (palindromic cube) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 183 OUT19 296
–
LcbSevenCubedLiveCodeBench / atcoder abc343_e / hard: 7x7x7 (Pattern B, stdin) Non-unique output: any valid 9-integer placement is accepted; exact-match oracle cannot judge the Yes case.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: Non-unique output: any valid tuple is accepted for the Yes case; exact-match oracle cannot judge
 Skipped IN0 OUT0
✓
LcbSquarePairLiveCodeBench / atcoder abc342_d / medium: Square Pair (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 222 OUT11 552
✓
LcbWhichIsAheadLiveCodeBench / atcoder abc342_b / easy: Which is ahead? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 237 OUT1 658
–
LcbWrongAnswerLiveCodeBench / atcoder abc343_a / easy: Wrong Answer (Pattern B, stdin) Non-unique output: ANY integer 0..9 not equal to A+B is accepted; exact-match oracle cannot judge it.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Skipped: Non-unique output: any integer 0..9 != A+B is a valid answer; exact-match oracle cannot judge
 Skipped IN0 OUT0
Code Generation - LiveCodeBench v1 AtCoder (set 3) 8 passed1 failed
88.9%
 IN83 141 OUT77 465
✓
LcbAbcdefgDistLiveCodeBench / atcoder abc305_b / easy: ABCDEFG (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 210 OUT757
✓
LcbCookiePickerLiveCodeBench / atcoder abc305_c / medium: Snuke the Cookie Picker (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 234 OUT1 802
✓
LcbFirstPlayerLiveCodeBench / atcoder abc304_a / easy: First Player (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 206 OUT2 560
✓
LcbGiftFromStarsLiveCodeBench / atcoder abc303_e / hard: A Gift From the Stars (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 262 OUT17 041
✓
LcbGoodGraphLiveCodeBench / atcoder abc304_e / hard: Good Graph (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 258 OUT12 552
×
LcbPieceOfCakeLiveCodeBench / atcoder abc304_d / medium: A Piece of Cake (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PieceOfCake case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:28: Type 'StringBuilder' has no fields. Only struct values support '.Length'. 25:16: Type 'StringBuilder' has no fields. Only struct values support '.Length'. Values: run.Compiled = false
 Failed IN9 256 OUT7 556
✓
LcbSubscribersLiveCodeBench / atcoder abc304_b / easy: Subscribers (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 314 OUT1 117
✓
LcbVirusSpreadLiveCodeBench / atcoder abc304_c / medium: Virus (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 205 OUT33 271
✓
LcbWaterStationLiveCodeBench / atcoder abc305_a / easy: Water Station (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 196 OUT809
Code Generation - LiveCodeBench v1 AtCoder (set 4) 5 passed3 failed
62.5%
 IN73 777 OUT70 680
✓
LcbArtGalleryLiveCodeBench / atcoder abc305_e / hard: Art Gallery on Graph (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 252 OUT22 602
×
LcbBase2LiveCodeBench / atcoder abc306_b / easy: Base 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: Base2 case0: expected [13] got [12682136550675316736]
 Failed IN9 195 OUT3 028
✓
LcbBestPerformancesLiveCodeBench / atcoder abc306_e / hard: Best Performances (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 230 OUT20 383
✓
LcbCentersLiveCodeBench / atcoder abc306_c / medium: Centers (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 206 OUT11 962
✓
LcbEchoStringLiveCodeBench / atcoder abc306_a / easy: Echo (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 170 OUT169
×
LcbPoisonousFullLiveCodeBench / atcoder abc306_d / medium: Poisonous Full (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PoisonousFull case0: expected [600] got [800]
 Failed IN9 257 OUT5 096
×
LcbSleepLogLiveCodeBench / atcoder abc305_d / hard: Sleep Log (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SleepLog case0: expected [480 0 960] got [960 480 1200]
 Failed IN9 259 OUT7 119
✓
LcbWeeklyRecordsLiveCodeBench / atcoder abc307_a / easy: Weekly Records (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 208 OUT321
Code Generation - LiveCodeBench v1 AtCoder (set 5) 8 passed
100.0%
 IN73 771 OUT107 619
✓
LcbDefaultPriceLiveCodeBench / atcoder abc308_b / easy: Default Price (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 211 OUT3 279
✓
LcbDistinctAdjacentLiveCodeBench / atcoder abc307_e / hard: Distinct Adjacent (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 212 OUT3 662
✓
LcbIdealSheetLiveCodeBench / atcoder abc307_c / medium: Ideal Sheet (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 301 OUT15 344
✓
LcbMismatchedParensLiveCodeBench / atcoder abc307_d / medium: Mismatched Parentheses (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 184 OUT9 575
✓
LcbNewSchemeLiveCodeBench / atcoder abc308_a / easy: New Scheme (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 203 OUT1 154
✓
LcbRacecarPalindromeLiveCodeBench / atcoder abc307_b / easy: racecar (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 210 OUT31 332
✓
LcbSnukeMazeLiveCodeBench / atcoder abc308_d / medium: Snuke Maze (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 252 OUT20 557
✓
LcbStandingsLiveCodeBench / atcoder abc308_c / medium: Standings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 198 OUT22 716
Code Generation - LiveCodeBench v1 AtCoder (set 6) 8 passed1 failed
88.9%
 IN83 422 OUT95 511
✓
LcbAddEdgeMaxDistanceLiveCodeBench / atcoder / medium: abc309_d Add One Edge1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 355 OUT2 533
✓
LcbDrinkCouponLiveCodeBench / atcoder / easy: abc310_a Order Something Else1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 225 OUT631
✓
LcbFamilyInsuranceLiveCodeBench / atcoder / hard: abc309_e Family and Insurance1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 215 OUT7 232
✓
LcbMedicineDayLiveCodeBench / atcoder / medium: abc309_c Medicine1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 236 OUT5 796
✓
LcbMexTriplesLiveCodeBench / atcoder / hard: abc308_e MEX1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 255 OUT13 445
✓
LcbNineAdjacentLiveCodeBench / atcoder / easy: abc309_a Nine1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 224 OUT1 267
✓
LcbRotateOuterLiveCodeBench / atcoder / easy: abc309_b Rotate1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 314 OUT6 605
✓
LcbStrictlySuperiorLiveCodeBench / atcoder / easy: abc310_b Strictly Superior1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 354 OUT38 850
×
LcbVouchersDiscountLiveCodeBench / atcoder / hard: abc308_f Vouchers1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: VouchersDiscount case1: expected [37] got [31]
 Failed IN9 244 OUT19 152
Code Generation - LiveCodeBench v1 AtCoder (set 7) 7 passed1 skipped
100.0%
 IN64 943 OUT41 814
–
LcbFindCycleLiveCodeBench / atcoder / medium: abc311_c Find it! (NON-UNIQUE output: any valid directed cycle is accepted; exact-match unreliable)0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: non-unique output: any valid directed cycle is accepted, exact string match unreliable
 Skipped IN0 OUT0
✓
LcbFirstAbcLiveCodeBench / atcoder / easy: abc311_a First ABC1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 189 OUT522
✓
LcbGridIceFloorLiveCodeBench / atcoder / medium: abc311_d Grid Ice Floor1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 347 OUT26 698
✓
LcbMake10AgainLiveCodeBench / atcoder / hard: abc310_f Make 10 Again1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 328 OUT6 082
✓
LcbNandRepeatedlyLiveCodeBench / atcoder / hard: abc310_e NAND repeatedly1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 294 OUT2 593
✓
LcbPeacefulTeamsLiveCodeBench / atcoder / medium: abc310_d Peaceful Teams1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 271 OUT3 783
✓
LcbReversibleSticksLiveCodeBench / atcoder / medium: abc310_c Reversible1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 265 OUT1 027
✓
LcbVacationTogetherLiveCodeBench / atcoder / easy: abc311_b Vacation Together1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 249 OUT1 109
Code Generation - LiveCodeBench v1 AtCoder (set 8) 5 passed2 failed1 broken
62.5%
 IN74 131 OUT146 895
✓
LcbBecomeStrongestLiveCodeBench / atcoder / easy: abc313_a To Be Saikyo1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 202 OUT1 683
✓
LcbCansOpenersLiveCodeBench / atcoder / hard: abc312_f Cans and Openers1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 293 OUT9 249
✓
LcbChordCheckLiveCodeBench / atcoder / easy: abc312_a Chord1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 154 OUT299
!
LcbCountBracketsLiveCodeBench / atcoder / medium: abc312_d Count Bracket Sequences1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 251 OUT62 144
×
LcbCuboidTangencyLiveCodeBench / atcoder / hard: abc312_e Tangency of Cuboids1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: CuboidTangency case0: expected [1 1 0 0] got [0 0 0 0]
 Failed IN9 341 OUT60 017
×
LcbHolelessSquaresLiveCodeBench / atcoder / hard: abc311_e Defect1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: HolelessSquares case3 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 322 OUT8 844
✓
LcbInvisibleHandLiveCodeBench / atcoder / medium: abc312_c Invisible Hand1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 210 OUT1 978
✓
LcbTakCodeLiveCodeBench / atcoder / easy: abc312_b TaK Code1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 358 OUT2 681
Code Generation - LiveCodeBench v1 AtCoder (set 9) 7 passed1 failed1 skipped
87.5%
 IN73 906 OUT37 319
✓
LcbApproxEqualizationLiveCodeBench / atcoder / medium: abc313_c Approximate Equalization 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 189 OUT2 612
✓
LcbCertainGameExpectedLiveCodeBench / atcoder / hard: abc314_f A Certain Game (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 304 OUT7 234
✓
LcbLowerUpperOpsLiveCodeBench / atcoder / medium: abc314_d LOWER (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 223 OUT6 781
✓
LcbPiTruncateLiveCodeBench / atcoder / easy: abc314_a 3.14 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 268 OUT1 376
✓
LcbRemoveVowelsLiveCodeBench / atcoder / easy: abc315_a tcdr (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 153 OUT331
✓
LcbRotateColoredSubsequenceLiveCodeBench / atcoder / medium: abc314_c Rotate Colored Subsequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 252 OUT7 084
✓
LcbRouletteFewestBetsLiveCodeBench / atcoder / easy: abc314_b Roulette (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 269 OUT2 093
–
LcbRoulettesExpectedLiveCodeBench / atcoder / hard: abc314_e Roulettes (Pattern B, stdin) FLAG: float output (expected value); exact-string driver cannot do tolerance -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# stdin driver: float/expected-value output needs tolerance comparison; exact string compare unsafe
 Skipped IN0 OUT0
×
LcbStrongestProgrammerLiveCodeBench / atcoder / medium: abc313_b Who is Saikyo? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StrongestProgrammer case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 40:15: Variable 'numbers' is already declared in this scope or an enclosing one. Values: run.Compiled = false
 Failed IN9 248 OUT9 808
Code Generation - LiveCodeBench v1 Codeforces (set 1) 7 passed2 failed
77.8%
 IN83 318 OUT39 443
✓
LcbChemistryPalindromeLiveCodeBench / codeforces 1883_B / medium: Chemistry (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Mediumsource:LiveCodeBench
 Passed IN9 250 OUT12 596
✓
LcbGameWithIntegersLiveCodeBench / codeforces 1899_A / easy: Game with Integers (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
 Passed IN9 255 OUT3 166
×
LcbGoodKidLiveCodeBench / codeforces 1873_B / easy: Good Kid (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: GoodKid case0 runtime error: List index 18 is out of range. The list has 18 element(s). Values: run.Success = false
 Failed IN9 244 OUT2 841
✓
LcbOneDEraserLiveCodeBench / codeforces 1873_D / easy: 1D Eraser (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
 Passed IN9 240 OUT2 752
✓
LcbRaspberriesLiveCodeBench / codeforces 1883_C / medium: Raspberries (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Mediumsource:LiveCodeBench
 Passed IN9 248 OUT4 199
✓
LcbShortSortLiveCodeBench / codeforces 1873_A / easy: Short Sort (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
 Passed IN9 227 OUT3 799
✓
LcbTruckWeightDifferenceLiveCodeBench / codeforces 1899_B / hard: 250 Thousand Tons of TNT (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench
 Passed IN9 306 OUT2 446
✓
LcbYarikArrayAltParityLiveCodeBench / codeforces 1899_C / hard: Yarik and Array (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench
 Passed IN9 268 OUT4 001
×
LcbYarikMusicalNotesLiveCodeBench / codeforces 1899_D / hard: Yarik and Musical Notes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: YarikMusicalNotes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 49:25: Type 'string' has no supported method named 'TrimEnd'. Values: run.Compiled = false
 Failed IN9 280 OUT3 643
Code Generation - LiveCodeBench v1 LeetCode (set 1) 8 passed1 failed
88.9%
 IN82 618 OUT78 634
✓
LcbBuyChocoLiveCodeBench / leetcode / easy: buy-two-chocolates (LCB 2756)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 156 OUT328
✓
LcbColorTheArrayLiveCodeBench / leetcode / medium: number-of-adjacent-elements-with-the-same-color (LCB 2779)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 233 OUT858
✓
LcbCountOfIntegersLiveCodeBench / leetcode / hard: count-of-integers (LCB 2757)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 200 OUT47 249
✓
LcbCountSeniorsLiveCodeBench / leetcode / easy: number-of-senior-citizens (LCB 2727)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 236 OUT410
✓
LcbDistinctDifferenceArrayLiveCodeBench / leetcode / easy: find-the-distinct-difference-array (LCB 2777)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 177 OUT1 387
✓
LcbMatrixSumLiveCodeBench / leetcode / medium: sum-in-a-matrix (LCB 2728)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 151 OUT1 211
✓
LcbMaximumOrLiveCodeBench / leetcode / medium: maximum-or (LCB 2730)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 163 OUT7 079
✓
LcbMaxStrengthLiveCodeBench / leetcode / medium: maximum-strength-of-a-group (LCB 2754)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 142 OUT2 573
×
LcbMinExtraCharLiveCodeBench / leetcode / medium: extra-characters-in-a-string (LCB 2755)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: minExtraChar case0 runtime error: Integer overflow. Values: run.Success = false
 Failed IN9 160 OUT17 539
Code Generation - LiveCodeBench v1 LeetCode (set 10) 8 passed1 failed
88.9%
 IN83 002 OUT73 273
✓
LcbCanBeEqualSwapLiveCodeBench / leetcode / easy: check-if-strings-can-be-made-equal-with-operations-i (id 2999)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 182 OUT1 001
✓
LcbCanMakeSubsequenceCyclicLiveCodeBench / leetcode / medium: make-string-a-subsequence-using-cyclic-increments (id 3018)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 247 OUT982
✓
LcbConstructProductMatrixLiveCodeBench / leetcode / medium: construct-product-matrix (id 3031)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 196 OUT1 336
✓
LcbFurthestDistanceFromOriginLiveCodeBench / leetcode / easy: furthest-point-from-origin (id 3019)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 194 OUT713
✓
LcbMaxBallPassingValueLiveCodeBench / leetcode / hard: maximize-value-of-function-in-a-ball-passing-game (id 3032)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 308 OUT33 780
✓
LcbMinAbsoluteDifferenceApartLiveCodeBench / leetcode / medium: minimum-absolute-difference-between-elements-with-constraint (id 3000)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 204 OUT8 173
✓
LcbMinOperationsSubsequenceSumLiveCodeBench / leetcode / hard: minimum-operations-to-form-subsequence-with-target-sum (id 3025)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 261 OUT15 013
×
LcbNumberOfBeautifulIntegersLiveCodeBench / leetcode / hard: number-of-beautiful-integers-in-the-range (id 3017)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: numBeautiful case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:26: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. 58:26: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
 Failed IN9 182 OUT3 439
✓
LcbStringTransformationWaysLiveCodeBench / leetcode / hard: string-transformation (id 3024)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 228 OUT8 836
Code Generation - LiveCodeBench v1 LeetCode (set 11) 8 passed1 failed
88.9%
 IN82 729 OUT74 665
✓
LcbMaximumCompleteSubsetSumLiveCodeBench / leetcode / hard: maximum-element-sum-of-a-complete-subset-of-indices (id 3047)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 234 OUT33 571
✓
LcbMaximumOddBinaryNumberLiveCodeBench / leetcode / easy: maximum-odd-binary-number (id 3055)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 150 OUT773
✓
LcbMinArrayLengthAfterRemovalsLiveCodeBench / leetcode / medium: minimum-array-length-after-pair-removals (id 3081)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 208 OUT2 292
✓
LcbMinCostMakeStringsEqualLiveCodeBench / leetcode / medium: apply-operations-to-make-two-strings-equal (id 3033)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 281 OUT23 576
✓
LcbMinimumRightShiftsLiveCodeBench / leetcode / easy: minimum-right-shifts-to-sort-the-array (id 3045)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 159 OUT1 210
×
LcbMinOperationsCollectElementsLiveCodeBench / leetcode / easy: minimum-operations-to-collect-elements (id 3044)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minOpsCollect case0: expected 4 got 2
 Failed IN9 170 OUT1 408
✓
LcbMinOperationsSpecialNumberLiveCodeBench / leetcode / medium: minimum-operations-to-make-a-special-number (id 3046)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 158 OUT6 834
✓
LcbNumberOfPointsCarsLiveCodeBench / leetcode / easy: points-that-intersect-with-cars (id 3034)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 169 OUT2 663
✓
LcbSplitArrayMaxSubarraysLiveCodeBench / leetcode / medium: split-array-into-maximum-number-of-subarrays (id 3080)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 200 OUT2 338
Code Generation - LiveCodeBench v1 LeetCode (set 12) 8 passed
100.0%
 IN73 724 OUT134 891
✓
LcbBeautifulTowersMaxSumLiveCodeBench / leetcode / medium: beautiful-towers-i (id 3114)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 264 OUT7 706
✓
LcbCountSubMultisetsBoundedSumLiveCodeBench / leetcode / hard: count-of-sub-multisets-with-bounded-sum (id 3091)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 291 OUT49 884
✓
LcbCountWaysHappyStudentsLiveCodeBench / leetcode / medium: happy-students (id 3104)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 200 OUT4 458
✓
LcbLongestSubsequenceSumTargetLiveCodeBench / leetcode / medium: length-of-the-longest-subsequence-that-sums-to-target (id 3106)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 200 OUT37 289
✓
LcbMinOperationsMakeArrayEmptyLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-array-empty (id 3094)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 175 OUT1 210
✓
LcbMinSizeSubarrayInfiniteLiveCodeBench / leetcode / medium: minimum-size-subarray-in-infinite-array (id 3141)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 181 OUT6 593
✓
LcbShortestBeautifulSubstringLiveCodeBench / leetcode / medium: shortest-and-lexicographically-smallest-beautiful-string (id 3150)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 225 OUT27 010
✓
LcbSumIndicesKSetBitsLiveCodeBench / leetcode / easy: sum-of-values-at-indices-with-k-set-bits (id 3093)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 188 OUT741
Code Generation - LiveCodeBench v1 LeetCode (set 13) 8 passed1 failed
88.9%
 IN82 334 OUT61 327
✓
LcbDivisibleSumsDifferenceLiveCodeBench / leetcode / easy: 3172 divisible-and-non-divisible-sums-difference (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 116 OUT370
✓
LcbLastVisitedIntegersLiveCodeBench / leetcode / easy: 3164 last-visited-integers (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 200 OUT1 188
×
LcbMaxOrderedTripletValueLiveCodeBench / leetcode / easy: 3154 maximum-value-of-an-ordered-triplet-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxOrderedTripletValue case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'maximumTripletValue' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, MaximumTripletValue. Values: run.Compiled = false
 Failed IN9 129 OUT2 804
✓
LcbMaxSumOfSquaresLiveCodeBench / leetcode / hard: 3153 apply-operations-on-array-to-maximize-sum-of-squares (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 186 OUT2 798
✓
LcbMinChangesBinaryBeautifulLiveCodeBench / leetcode / medium: 3174 minimum-number-of-changes-to-make-binary-string-beautiful (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 122 OUT955
✓
LcbMinEqualSumReplaceZerosLiveCodeBench / leetcode / medium: 3171 minimum-equal-sum-of-two-arrays-after-replacing-zeros (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 119 OUT2 158
✓
LcbMinGroupsValidAssignmentLiveCodeBench / leetcode / medium: 3166 minimum-number-of-groups-to-create-a-valid-assignment (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 151 OUT3 827
✓
LcbMinProcessingTimeLiveCodeBench / leetcode / medium: 3151 minimum-processing-time (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 191 OUT1 082
✓
LcbSumDistinctSquaresLiveCodeBench / leetcode / easy: 3163 subarrays-distinct-element-sum-of-squares-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 120 OUT46 145
Code Generation - LiveCodeBench v1 LeetCode (set 14) 8 passed1 failed
88.9%
 IN82 207 OUT73 536
✓
LcbFindChampionILiveCodeBench / leetcode / easy: 3188 find-champion-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 148 OUT659
✓
LcbFindKOrLiveCodeBench / leetcode / easy: 3183 find-the-k-or-of-an-array (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 139 OUT1 369
✓
LcbFindWordsContainingLiveCodeBench / leetcode / easy: 3194 find-words-containing-character (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 096 OUT241
×
LcbMaxBalancedSubseqSumLiveCodeBench / leetcode / hard: 3184 maximum-balanced-subsequence-sum (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: MaxBalancedSubseqSum case2: expected -1 got -2
 Failed IN9 157 OUT2 889
✓
LcbMaximumXorProductLiveCodeBench / leetcode / medium: 3192 maximum-xor-product (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 119 OUT25 540
✓
LcbMaxStrongPairXorLiveCodeBench / leetcode / easy: 3193 maximum-strong-pair-xor-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 147 OUT37 147
✓
LcbMinMountainTripletSumLiveCodeBench / leetcode / easy: 3176 minimum-sum-of-mountain-triplets-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 116 OUT1 534
✓
LcbMinOpsMaximizeLastLiveCodeBench / leetcode / medium: 3190 minimum-operations-to-maximize-last-elements-in-arrays (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 162 OUT3 652
✓
LcbSeparateBlackWhiteBallsLiveCodeBench / leetcode / medium: 3195 separate-black-and-white-balls (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 123 OUT505
Code Generation - LiveCodeBench v1 LeetCode (set 15) 7 passed1 failed
87.5%
 IN73 154 OUT78 806
✓
LcbCountBeautifulSubstringsLiveCodeBench / leetcode / medium: 3210 count-beautiful-substrings-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 143 OUT12 878
✓
LcbDistributeCandiesILiveCodeBench / leetcode / easy: 3199 distribute-candies-among-children-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 084 OUT11 104
✓
LcbFindCommonElementsLiveCodeBench / leetcode / easy: 3206 find-common-elements-between-two-arrays (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 159 OUT462
✓
LcbGoodStringsLeetLiveCodeBench / leetcode / medium: 3200 number-of-strings-which-can-be-rearranged-to-contain-substring (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 115 OUT9 146
✓
LcbMakeThreeStringsEqualLiveCodeBench / leetcode / easy: 3207 make-three-strings-equal (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 146 OUT1 367
✓
LcbMaxFrequencyScoreLiveCodeBench / leetcode / hard: 3196 apply-operations-to-maximize-frequency-score (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 127 OUT8 483
✓
LcbMinCoinsForFruitsLiveCodeBench / leetcode / medium: 3209 minimum-number-of-coins-for-fruits (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 148 OUT12 741
×
LcbPalindromeRearrangeQueriesLiveCodeBench / leetcode / hard: 3203 palindrome-rearrangement-queries (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PalindromeRearrangeQueries case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:21: Type 'Dictionary<char, int>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
 Failed IN9 232 OUT22 625
Code Generation - LiveCodeBench v1 LeetCode (set 16) 8 passed1 failed
88.9%
 IN82 336 OUT46 385
✓
LcbCompleteSubstringsLiveCodeBench / leetcode / hard: count-complete-substrings (id 3223)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 143 OUT5 594
✓
LcbCountTestedDevicesLiveCodeBench / leetcode / easy: count-tested-devices-after-test-operations (id 3220)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 190 OUT558
✓
LcbFindPeaksLiveCodeBench / leetcode / easy: find-the-peaks (id 3221)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 115 OUT189
✓
LcbGoodPartitionsCountLiveCodeBench / leetcode / hard: count-the-number-of-good-partitions (id 3212)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 116 OUT8 571
✓
LcbInfectionSequencesLiveCodeBench / leetcode / hard: count-the-number-of-infection-sequences (id 3224)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 215 OUT17 489
×
LcbLexSmallestSwapLiveCodeBench / leetcode / medium: make-lexicographically-smallest-array-by-swapping-elements (id 3219)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: lexSwap case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 172 OUT5 331
✓
LcbLongestSubarrayKFreqLiveCodeBench / leetcode / medium: length-of-longest-subarray-with-at-most-k-frequency (id 3225)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 131 OUT605
✓
LcbMaxNonDecreasingLengthLiveCodeBench / leetcode / hard: find-maximum-non-decreasing-array-length (id 3211)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 155 OUT3 176
✓
LcbSubarraysMaxKTimesLiveCodeBench / leetcode / medium: count-subarrays-where-max-element-appears-at-least-k-times (id 3213)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 099 OUT4 872
Code Generation - LiveCodeBench v1 LeetCode (set 17) 7 passed2 failed
77.8%
 IN82 438 OUT54 201
✓
LcbDoubleModExpLiveCodeBench / leetcode / medium: double-modular-exponentiation (id 3234)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 148 OUT1 900
✓
LcbEqualindromicCostLiveCodeBench / leetcode / medium: minimum-cost-to-make-array-equalindromic (id 3229)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 200 OUT14 769
×
LcbMaxPartitionsOpsLiveCodeBench / leetcode / hard: maximize-the-number-of-partitions-after-operations (id 3233)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxPartOps case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 63:38: Cannot assign a value of type 'int' to variable 'c' of type 'char'. Values: run.Compiled = false
 Failed IN9 164 OUT20 531
✓
LcbMaxSetSizeRemovalsLiveCodeBench / leetcode / medium: maximum-size-of-a-set-after-removals (id 3228)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 129 OUT3 566
✓
LcbMinCoinsToAddLiveCodeBench / leetcode / medium: minimum-number-of-coins-to-be-added (id 3231)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 161 OUT1 813
✓
LcbMinCostConvertStringLiveCodeBench / leetcode / medium: minimum-cost-to-convert-string-i (id 3235)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 232 OUT2 046
✓
LcbMinimumNumberGameLiveCodeBench / leetcode / easy: minimum-number-game (id 3226)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 137 OUT797
✓
LcbMissingAndRepeatedLiveCodeBench / leetcode / easy: find-missing-and-repeated-values (id 3227)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 151 OUT977
×
LcbRemoveAlmostEqualLiveCodeBench / leetcode / medium: remove-adjacent-almost-equal-characters (id 3230)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: removeAlmost case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'removeAlmostEqualCharacters' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, RemoveAlmostEqualCharacters. Values: run.Compiled = false
 Failed IN9 116 OUT7 802
Code Generation - LiveCodeBench v1 LeetCode (set 18) 8 passed
100.0%
 IN73 230 OUT61 737
✓
LcbBeautifulIndicesLiveCodeBench / leetcode / medium: find-beautiful-indices-in-the-given-array-i (id 3245)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 172 OUT3 361
✓
LcbBitwiseOrTrailingZerosLiveCodeBench / leetcode / easy: check-if-bitwise-or-has-trailing-zeros (id 3246)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 157 OUT671
✓
LcbMaxFrequencyElementsLiveCodeBench / leetcode / easy: count-elements-with-maximum-frequency (id 3242)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 091 OUT630
✓
LcbMaxNumberPricesSumLiveCodeBench / leetcode / medium: maximum-number-that-sum-of-the-prices-is-less-than-or-equal-to-k (id 3240)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 191 OUT9 636
✓
LcbMinArrayLengthModLiveCodeBench / leetcode / medium: minimize-length-of-array-using-operations (id 3244)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 154 OUT14 519
✓
LcbMinOpsXYEqualLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-x-and-y-equal (id 3239)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 131 OUT9 583
✓
LcbMissingSeqPrefixSumLiveCodeBench / leetcode / easy: smallest-missing-integer-greater-than-sequential-prefix-sum (id 3236)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 130 OUT918
✓
LcbPowerfulIntegersLiveCodeBench / leetcode / hard: count-the-number-of-powerful-integers (id 3243)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 204 OUT22 419
Code Generation - LiveCodeBench v1 LeetCode (set 19) 8 passed1 failed
88.9%
 IN82 269 OUT49 183
✓
LcbAreaOfMaxDiagonalLiveCodeBench / leetcode / easy: maximum-area-of-longest-diagonal-rectangle (id 3251)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 128 OUT678
✓
LcbCountMatchingSubarraysLiveCodeBench / leetcode / medium: number-of-subarrays-that-match-a-pattern-i (id 3269)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 201 OUT2 216
✓
LcbIncremovableSubarrayCountLiveCodeBench / leetcode / easy: count-the-number-of-incremovable-subarrays-i (id 3252)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 121 OUT14 999
✓
LcbLargestPerimeterLiveCodeBench / leetcode / medium: find-polygon-with-the-largest-perimeter (id 3262)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 187 OUT2 397
✓
LcbLongestSpecialThriceLiveCodeBench / leetcode / medium: find-longest-special-substring-that-occurs-thrice-i (id 3267)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 115 OUT5 508
✓
LcbMaximumGoodSubarraySumLiveCodeBench / leetcode / medium: maximum-good-subarray-sum (id 3265)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 132 OUT1 441
✓
LcbMinimumCostThreeSubarraysLiveCodeBench / leetcode / easy: divide-an-array-into-subarrays-with-minimum-cost-i (id 3263)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 096 OUT1 701
✓
LcbMinOpsXorEqualKLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-array-xor-equal-to-k (id 3249)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 139 OUT1 779
×
LcbMinOrAfterOperationsLiveCodeBench / leetcode / hard: minimize-or-of-remaining-elements-using-operations (id 3261)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minOr case1: expected 2 got 7
 Failed IN9 150 OUT18 464
Code Generation - LiveCodeBench v1 LeetCode (set 2) 9 passed
100.0%
 IN82 494 OUT16 353
✓
LcbCircularGameLosersLiveCodeBench / leetcode / easy: find-the-losers-of-the-circular-game (LCB 2791)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 184 OUT1 436
✓
LcbCollectingChocolatesLiveCodeBench / leetcode / medium: collecting-chocolates (LCB 2810)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 182 OUT3 918
✓
LcbLongestSemiRepetitiveLiveCodeBench / leetcode / medium: find-the-longest-semi-repetitive-substring (LCB 2786)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 159 OUT1 163
✓
LcbMinLengthRemoveSubstrLiveCodeBench / leetcode / easy: minimum-string-length-after-removing-substrings (LCB 2800)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 127 OUT1 374
✓
LcbNeighboringXorLiveCodeBench / leetcode / medium: neighboring-bitwise-xor (LCB 2792)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 187 OUT1 170
✓
LcbPaintWallsLiveCodeBench / leetcode / hard: painting-the-walls (LCB 2808)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 193 OUT2 444
✓
LcbPowerOfHeroesLiveCodeBench / leetcode / hard: power-of-heroes (LCB 2784)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 154 OUT2 137
✓
LcbPunishmentNumberLiveCodeBench / leetcode / medium: find-the-punishment-number-of-an-integer (LCB 2802)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 147 OUT1 398
✓
LcbSemiOrderedPermutationLiveCodeBench / leetcode / easy: semi-ordered-permutation (LCB 2785)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 161 OUT1 313
Code Generation - LiveCodeBench v1 LeetCode (set 20) 6 passed2 failed
75.0%
 IN73 149 OUT37 235
✓
LcbCanSortArrayBySetBitsLiveCodeBench / leetcode / medium: find-if-array-can-be-sorted (id 3291)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 115 OUT1 996
✓
LcbCountPrefixSuffixPairsLiveCodeBench / leetcode / easy: count-prefix-and-suffix-pairs-i (id 3309)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 131 OUT2 605
×
LcbEarliestSecondToMarkLiveCodeBench / leetcode / medium: earliest-second-to-mark-indices-i (id 3292)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: earliestSecond case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:27: Function 'CanMarkBySecond' must return 'int', but this return statement has type 'bool'. 24:28: Function 'CanMarkBySecond' must return 'int', but this return statement has type 'bool'. 36:31: Function 'CanMarkBySecond' must return 'int', but this return statement has type 'bool'. 38:5: Function 'CanMarkBySecond' must return 'int', but this return statement has type 'bool'. 64:13: The if condition must be 'bool', but it has type 'int'. Values: run.Compiled = false
 Failed IN9 192 OUT7 244
✓
LcbFlowerGameLiveCodeBench / leetcode / medium: alice-and-bob-playing-flower-game (id 3279)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 147 OUT947
×
LcbLastNonEmptyStringLiveCodeBench / leetcode / medium: apply-operations-to-make-string-empty (id 3308)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson) == FromJson<string>(expected[i]) Context: lastNonEmpty case0: expected "ba" got "aabbba"
 Failed IN9 099 OUT3 820
✓
LcbMaxSelectedConsecutiveLiveCodeBench / leetcode / hard: maximize-consecutive-elements-in-an-array-after-modification (id 3298)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 146 OUT13 996
✓
LcbMaxSubsetPowerPatternLiveCodeBench / leetcode / medium: find-the-maximum-number-of-elements-in-subset (id 3299)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 193 OUT3 920
✓
LcbMinTimeRevertWordLiveCodeBench / leetcode / medium: minimum-time-to-revert-word-to-initial-state-i (id 3297)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 126 OUT2 707
Code Generation - LiveCodeBench v1 LeetCode (set 21) 8 passed
100.0%
 IN73 166 OUT44 455
✓
LcbAntOnBoundaryLiveCodeBench / leetcode / easy: ant-on-the-boundary (id 3311)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 154 OUT191
✓
LcbCountKeyChangesLiveCodeBench / leetcode / easy: number-of-changing-keys (id 3312)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 124 OUT755
✓
LcbDistributeTwoArraysLiveCodeBench / leetcode / easy: distribute-elements-into-two-arrays-i (id 3347)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 178 OUT1 303
✓
LcbLongestCommonPrefixDigitsLiveCodeBench / leetcode / medium: find-the-length-of-the-longest-common-prefix (id 3329)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 190 OUT1 402
✓
LcbMaxOperationsSameScoreLiveCodeBench / leetcode / easy: maximum-number-of-operations-with-the-same-score-i (id 3320)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 124 OUT1 085
✓
LcbMaxPalindromesAfterOpsLiveCodeBench / leetcode / medium: maximum-palindromes-after-operations (id 3317)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 167 OUT38 408
✓
LcbMinOpsExceedThresholdLiveCodeBench / leetcode / easy: minimum-operations-to-exceed-threshold-value-i (id 3331)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 107 OUT285
✓
LcbSplitArrayDistinctLiveCodeBench / leetcode / easy: split-the-array (id 3324)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 122 OUT1 026
Code Generation - LiveCodeBench v1 LeetCode (set 3) 7 passed1 broken
87.5%
 IN73 135 OUT40 310
!
LcbGcdTraversalLiveCodeBench / leetcode / hard: greatest-common-divisor-traversal (LCB 2827)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 169 OUT29 713
✓
LcbIsFascinatingLiveCodeBench / leetcode / easy: check-if-the-number-is-fascinating (LCB 2824)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 136 OUT966
✓
LcbKAvoidingArrayLiveCodeBench / leetcode / medium: determine-the-minimum-sum-of-a-k-avoiding-array (LCB 2811)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 123 OUT2 823
✓
LcbMaxAchievableNumberLiveCodeBench / leetcode / easy: find-the-maximum-achievable-number (LCB 2812)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 137 OUT1 488
✓
LcbMinCostEqualCharsLiveCodeBench / leetcode / medium: minimum-cost-to-make-all-characters-equal (LCB 2817)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 165 OUT2 624
✓
LcbMinimizeStringLengthLiveCodeBench / leetcode / easy: minimize-string-length (LCB 2825)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 154 OUT1 243
✓
LcbRemoveTrailingZerosLiveCodeBench / leetcode / easy: remove-trailing-zeros-from-a-string (LCB 2819)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 107 OUT237
✓
LcbSmallestPalindromeLiveCodeBench / leetcode / easy: lexicographically-smallest-palindrome (LCB 2816)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 144 OUT1 216
Code Generation - LiveCodeBench v1 LeetCode (set 4) 8 passed1 failed
88.9%
 IN82 989 OUT30 703
✓
LcbBeautifulPairsLiveCodeBench / leetcode / easy: number-of-beautiful-pairs (id 2831)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 189 OUT3 929
✓
LcbCountZeroRequestServersLiveCodeBench / leetcode / medium: count-zero-request-servers (id 2833)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 288 OUT1 294
✓
LcbLongestEqualSubarrayLiveCodeBench / leetcode / medium: find-the-longest-equal-subarray (id 2832)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 193 OUT2 859
✓
LcbMakeIntegerZeroLiveCodeBench / leetcode / medium: minimum-operations-to-make-the-integer-zero (id 2837)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 180 OUT4 043
✓
LcbMaximumSumQueriesLiveCodeBench / leetcode / hard: maximum-sum-queries (id 2839)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 340 OUT12 119
×
LcbRelocateMarblesLiveCodeBench / leetcode / medium: relocate-marbles (id 2834)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: relocateMarbles case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 266 OUT1 631
✓
LcbSmallestStringOpLiveCodeBench / leetcode / medium: lexicographically-smallest-string-after-substring-operation (id 2828)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 205 OUT2 459
✓
LcbSumOfSquaresSpecialLiveCodeBench / leetcode / easy: sum-of-squares-of-special-elements (id 2844)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 154 OUT733
✓
LcbValueOfPartitionLiveCodeBench / leetcode / medium: find-the-value-of-the-partition (id 2845)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 174 OUT1 636
Code Generation - LiveCodeBench v1 LeetCode (set 5) 8 passed1 failed
88.9%
 IN82 898 OUT50 465
×
LcbCountCompleteSubarraysLiveCodeBench / leetcode / medium: count-complete-subarrays-in-an-array (id 2856)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: countCompleteSubarrays case0: expected 4 got 2
 Failed IN9 159 OUT1 812
✓
LcbDecrementalConcatLiveCodeBench / leetcode / medium: decremental-string-concatenation (id 2854)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 271 OUT3 638
✓
LcbLongestEvenOddThresholdLiveCodeBench / leetcode / easy: longest-even-odd-subarray-with-threshold (id 2866)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 243 OUT2 090
✓
LcbLongestNewStringLiveCodeBench / leetcode / medium: construct-the-longest-new-string (id 2850)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 195 OUT10 137
✓
LcbMaximumJumpsLiveCodeBench / leetcode / medium: maximum-number-of-jumps-to-reach-the-last-index (id 2855)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 242 OUT11 224
✓
LcbMaxStringPairsLiveCodeBench / leetcode / easy: find-maximum-number-of-string-pairs (id 2847)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 193 OUT795
✓
LcbSpecialPermutationsLiveCodeBench / leetcode / medium: special-permutations (id 2848)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 176 OUT2 238
✓
LcbSumImbalanceNumbersLiveCodeBench / leetcode / hard: sum-of-imbalance-numbers-of-all-subarrays (id 2849)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 198 OUT17 733
✓
LcbTotalDistanceTraveledLiveCodeBench / leetcode / easy: total-distance-traveled (id 2857)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 221 OUT798
Code Generation - LiveCodeBench v1 LeetCode (set 6) 8 passed
100.0%
 IN73 668 OUT33 542
✓
LcbContinuousSubarraysLiveCodeBench / leetcode / medium: continuous-subarrays (id 2868)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 184 OUT4 503
✓
LcbEmployeesMetTargetLiveCodeBench / leetcode / easy: number-of-employees-who-met-the-target (id 2876)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 198 OUT239
✓
LcbGoodSubarraySplitsLiveCodeBench / leetcode / medium: ways-to-split-array-into-good-subarrays (id 2867)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 179 OUT1 036
✓
LcbLongestAlternatingLiveCodeBench / leetcode / easy: longest-alternating-subarray (id 2870)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 263 OUT6 177
✓
LcbLongestNonDecreasingLiveCodeBench / leetcode / medium: longest-non-decreasing-subarray-from-two-arrays (id 2869)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 262 OUT2 687
✓
LcbMaxArrayValueMergeLiveCodeBench / leetcode / medium: largest-element-in-an-array-after-merge-operations (id 2872)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 191 OUT1 240
✓
LcbPrimePairsSumLiveCodeBench / leetcode / medium: prime-pairs-with-target-sum (id 2873)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 193 OUT1 270
✓
LcbShortestThreeStringsLiveCodeBench / leetcode / medium: shortest-string-that-contains-three-strings (id 2877)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 198 OUT16 390
Code Generation - LiveCodeBench v1 LeetCode (set 7) 9 passed
100.0%
 IN82 426 OUT64 878
✓
LcbCheckArrayZeroableLiveCodeBench / leetcode / medium: apply-operations-to-make-all-array-elements-equal-to-zero (id 2878)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 153 OUT2 209
✓
LcbFaultyKeyboardLiveCodeBench / leetcode / easy: faulty-keyboard (id 2886)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 113 OUT5 968
✓
LcbLongestValidSubstringForbiddenLiveCodeBench / leetcode / hard: length-of-the-longest-valid-substring (id 2884)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 137 OUT39 377
✓
LcbMinBeautifulSubstringsLiveCodeBench / leetcode / medium: partition-string-into-minimum-beautiful-substrings (id 2883)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 147 OUT6 132
✓
LcbMinChangesKSemiPalindromesLiveCodeBench / leetcode / hard: minimum-changes-to-make-k-semi-palindromes (id 2879)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 176 OUT4 758
✓
LcbMinIndexValidSplitLiveCodeBench / leetcode / medium: minimum-index-of-a-valid-split (id 2888)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 211 OUT2 657
✓
LcbSortVowelsInStringLiveCodeBench / leetcode / medium: sort-vowels-in-a-string (id 2887)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 139 OUT1 402
✓
LcbSplitWordsBySeparatorLiveCodeBench / leetcode / easy: split-strings-by-separator (id 2881)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 177 OUT715
✓
LcbWaysSumOfPowersLiveCodeBench / leetcode / medium: ways-to-express-an-integer-as-sum-of-powers (id 2882)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 173 OUT1 660
Code Generation - LiveCodeBench v1 LeetCode (set 8) 9 passed
100.0%
 IN82 550 OUT47 531
✓
LcbCanSplitArrayMLiveCodeBench / leetcode / medium: check-if-it-is-possible-to-split-array (id 2916)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 197 OUT4 596
✓
LcbCountInterestingSubarraysLiveCodeBench / leetcode / medium: count-of-interesting-subarrays (id 2915)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 184 OUT5 091
✓
LcbCountPairsSumLessTargetLiveCodeBench / leetcode / easy: count-pairs-whose-sum-is-less-than-target (id 2917)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 144 OUT1 010
✓
LcbIsArrayGoodLiveCodeBench / leetcode / easy: check-if-array-is-good (id 2892)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 192 OUT2 391
✓
LcbMaxBeautyAfterOpLiveCodeBench / leetcode / medium: maximum-beauty-of-an-array-after-applying-operation (id 2891)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 177 OUT1 321
✓
LcbMaxIncreasingGroupsLiveCodeBench / leetcode / hard: maximum-number-of-groups-with-increasing-length (id 2919)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 171 OUT23 580
✓
LcbMaxPairSumEqualDigitLiveCodeBench / leetcode / easy: max-pair-sum-in-an-array (id 2902)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 137 OUT2 451
✓
LcbMaxScoreVisitPositionsLiveCodeBench / leetcode / medium: visit-array-positions-to-maximize-score (id 2893)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 184 OUT5 142
✓
LcbMinSecondsCircularEqualLiveCodeBench / leetcode / medium: minimum-seconds-to-equalize-a-circular-array (id 2920)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 164 OUT1 949
Code Generation - LiveCodeBench v1 LeetCode (set 9) 6 passed1 failed1 broken
75.0%
 IN73 467 OUT134 417
✓
LcbAccountBalanceRoundedLiveCodeBench / leetcode / easy: account-balance-after-rounded-purchase (id 2955)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 150 OUT780
!
LcbCountPairsDistanceKLiveCodeBench / leetcode / medium: count-pairs-of-points-with-distance-k (id 2953)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 204 OUT62 144
✓
LcbCountSteppingNumbersLiveCodeBench / leetcode / hard: count-stepping-numbers-in-range (id 2921)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 156 OUT26 197
✓
LcbCountSymmetricIntegersLiveCodeBench / leetcode / easy: count-symmetric-integers (id 2998)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 149 OUT13 528
✓
LcbIsAcronymOfWordsLiveCodeBench / leetcode / easy: check-if-a-string-is-an-acronym-of-words (id 2977)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 163 OUT501
✓
LcbMaximizeSalesmanProfitLiveCodeBench / leetcode / medium: maximize-the-profit-as-the-salesman (id 2979)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 213 OUT4 856
×
LcbMaxSumAlmostUniqueLiveCodeBench / leetcode / medium: maximum-sum-of-almost-unique-subarray (id 2954)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: MaxSumAlmostUnique case0: expected 18 got 26
 Failed IN9 208 OUT2 147
✓
LcbMinTimeSumAtMostXLiveCodeBench / leetcode / hard: minimum-time-to-make-array-sum-at-most-x (id 2952)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 224 OUT24 264
Code Generation - LiveCodeBench v2 AtCoder (set 1) 7 passed1 failed
87.5%
 IN73 800 OUT47 945
✓
LcbABCSumQueryLiveCodeBench / atcoder abc344_c / medium: A+B+C (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 261 OUT2 055
✓
LcbCeilDivTenLiveCodeBench / atcoder abc345_b / easy: Integer Division Returns (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 147 OUT1 169
✓
LcbDelimiterReverseLiveCodeBench / atcoder abc344_b / easy: Delimiter (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 194 OUT734
✓
LcbGomamayoSequenceLiveCodeBench / atcoder abc346_d / medium: Gomamayo Sequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 257 OUT26 406
×
LcbInsertOrEraseLiveCodeBench / atcoder abc344_e / hard: Insert or Erase (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: InsertOrErase case0: expected [4 5 1 3] got [4 5 1]
 Failed IN9 249 OUT6 888
✓
LcbSpoilerRemoveLiveCodeBench / atcoder abc344_a / easy: Spoiler (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 149 OUT448
✓
LcbStringBagsLiveCodeBench / atcoder abc344_d / hard: String Bags (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 297 OUT4 474
✓
LcbTilingGridLiveCodeBench / atcoder abc345_d / hard: Tiling (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 246 OUT5 771
Code Generation - LiveCodeBench v2 AtCoder (set 2) 6 passed1 failed
85.7%
 IN64 475 OUT46 064
✓
LcbAdjacentProductLiveCodeBench / atcoder abc346_a / easy: Adjacent Product (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 172 OUT870
✓
LcbDivisibleQuotientsLiveCodeBench / atcoder abc347_a / easy: Divisible (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 182 OUT944
✓
LcbIdealHolidaysLiveCodeBench / atcoder abc347_c / medium: Ideal Holidays (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 218 OUT6 051
✓
LcbPaintGridLiveCodeBench / atcoder abc346_e / hard: Paint (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 303 OUT11 611
✓
LcbPianoSubstringLiveCodeBench / atcoder abc346_b / easy: Piano (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 188 OUT12 439
✓
LcbSetAddQueryLiveCodeBench / atcoder abc347_e / hard: Set Add Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 247 OUT13 303
×
LcbSigmaMissingSumLiveCodeBench / atcoder abc346_c / medium: Sigma (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SigmaMissingSum case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 165 OUT846
Code Generation - LiveCodeBench v2 AtCoder (set 3) 7 passed1 failed
87.5%
 IN74 415 OUT18 243
✓
LcbAirportCodeLiveCodeBench / atcoder / abc349_c: Airport Code (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 290 OUT3 741
✓
LcbColorfulBeansLiveCodeBench / atcoder / abc348_c: Colorful Beans (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 279 OUT773
✓
LcbDistinctSubstringsLiveCodeBench / atcoder / abc347_b: Substring (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 190 OUT580
✓
LcbFarthestPointLiveCodeBench / atcoder / abc348_b: Farthest Point (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 331 OUT2 252
×
LcbMedicinesOnGridLiveCodeBench / atcoder / abc348_d: Medicines on Grid (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MedicinesOnGrid case0 runtime error: String index 4 is out of range. The string has 4 character(s). Values: run.Success = false
 Failed IN9 510 OUT5 474
✓
LcbMinimizeSumOfDistancesLiveCodeBench / atcoder / abc348_e: Minimize Sum of Distances (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 321 OUT3 797
✓
LcbPenaltyKickLiveCodeBench / atcoder / abc348_a: Penalty Kick (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 224 OUT380
✓
LcbZeroSumGameLiveCodeBench / atcoder / abc349_a: Zero Sum Game (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 270 OUT1 246
Code Generation - LiveCodeBench v2 AtCoder (set 4) 5 passed2 skipped
100.0%
 IN46 649 OUT22 951
✓
LcbCommencementLiveCodeBench / atcoder / abc349_b: Commencement (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 213 OUT1 311
✓
LcbDentistAokiLiveCodeBench / atcoder / abc350_b: Dentist Aoki (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 277 OUT630
✓
LcbDivideIntervalLiveCodeBench / atcoder / abc349_d: Divide Interval (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 411 OUT13 614
✓
LcbPastABCsLiveCodeBench / atcoder / abc350_a: Past ABCs (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 295 OUT615
–
LcbSortPermutationLiveCodeBench / atcoder / abc350_c: Sort (Pattern B, stdin) TRIAGE: 0 public tests in dump + non-unique output (any valid swap sequence accepted) — cannot oracle-compare.0 AI queries 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: no public tests in dump; output non-unique (any valid swap sequence is accepted) — exact-compare oracle inapplicable, coordinator triage
 Skipped IN0 OUT0
–
LcbTowardZeroLiveCodeBench / atcoder / abc350_e: Toward 0 (Pattern B, stdin) TRIAGE: float output (absolute/relative error <= 1e-6) — RunLcbStdin does exact string compare; needs tolerance.0 AI queries 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: float output requires error tolerance (<=1e-6); RunLcbStdin does exact string compare — coordinator triage
 Skipped IN0 OUT0
✓
LcbWeightedTicLiveCodeBench / atcoder / abc349_e: Weighted Tic (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 453 OUT6 781
Code Generation - LiveCodeBench v2 AtCoder (set 5) 7 passed1 failed
87.5%
 IN74 244 OUT32 894
✓
LcbBottomNinthLiveCodeBench / atcoder / abc351_a: The bottom of the ninth (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 328 OUT1 034
✓
LcbCliqueConnectLiveCodeBench / atcoder / abc352_e: Clique Connect (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 339 OUT16 646
✓
LcbDoubleSumMaxDiffLiveCodeBench / atcoder / abc351_f: Double Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 191 OUT1 342
✓
LcbGridAndMagnetLiveCodeBench / atcoder / abc351_d: Grid and Magnet (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 294 OUT8 059
✓
LcbJumpDistanceSumLiveCodeBench / atcoder / abc351_e: Jump Distance Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 295 OUT2 146
✓
LcbMergeTheBallsLiveCodeBench / atcoder / abc351_c: Merge the balls (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 273 OUT1 233
✓
LcbNewFriendsLiveCodeBench / atcoder / abc350_d: New Friends (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 222 OUT1 692
×
LcbSpotTheDifferenceLiveCodeBench / atcoder / abc351_b: Spot the Difference (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SpotTheDifference case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:15: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
 Failed IN9 302 OUT742
Code Generation - LiveCodeBench v2 AtCoder (set 6) 7 passed
100.0%
 IN64 827 OUT15 993
✓
LcbAmusementParkLiveCodeBench / atcoder / abc353_b: AtCoder Amusement Park (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 284 OUT1 856
✓
LcbAtcoderLineLiveCodeBench / atcoder / abc352_a: AtCoder Line (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 237 OUT1 174
✓
LcbBuildingsTallerLiveCodeBench / atcoder / abc353_a: Buildings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 211 OUT171
✓
LcbPermutationSubsequenceLiveCodeBench / atcoder / abc352_d: Permutation Subsequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 299 OUT5 094
✓
LcbSigmaRemainderSumLiveCodeBench / atcoder / abc353_c: Sigma Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 217 OUT3 467
✓
LcbStandingOnShouldersLiveCodeBench / atcoder / abc352_c: Standing On The Shoulders (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 310 OUT1 496
✓
LcbTypingBackspaceLiveCodeBench / atcoder / abc352_b: Typing (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 269 OUT2 735
Code Generation - LiveCodeBench v2 AtCoder (set 7) 6 passed
100.0%
 IN55 846 OUT45 250
✓
LcbAnotherSigmaProblemLiveCodeBench / atcoder / abc353_d: Another Sigma Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 318 OUT6 253
✓
LcbAtcoderJanken2LiveCodeBench / atcoder / abc354_b: AtCoder Janken 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 302 OUT878
✓
LcbAtcoderMagicsLiveCodeBench / atcoder / abc354_c: AtCoder Magics (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 371 OUT11 669
✓
LcbExponentialPlantLiveCodeBench / atcoder / abc354_a: Exponential Plant (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 255 OUT1 131
✓
LcbRemovePairsLiveCodeBench / atcoder / abc354_e: Remove Pairs (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 348 OUT19 572
✓
LcbYetAnotherSigmaProblemLiveCodeBench / atcoder / abc353_e: Yet Another Sigma Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 252 OUT5 747
Code Generation - LiveCodeBench v2 AtCoder (set 8) 4 passed1 failed1 skipped
80.0%
 IN46 523 OUT21 405
×
LcbAtcoderWallpaperLiveCodeBench / atcoder / abc354_d: AtCoder Wallpaper (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: AtcoderWallpaper case0: expected [10] got [14]
 Failed IN9 363 OUT11 791
✓
LcbBingo2LiveCodeBench / atcoder / abc355_c: Bingo 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 376 OUT1 513
–
LcbGuessTheSumLiveCodeBench / atcoder / abc355_e: Guess the Sum (Pattern B, stdin) — INTERACTIVE, cannot run in the batch harness0 AI queries 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# subset: interactive problem (adaptive query/response dialogue; not expressible as a single stdin->stdout Solve)
 Skipped IN0 OUT0
✓
LcbIntersectingIntervalsLiveCodeBench / atcoder / abc355_d: Intersecting Intervals (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 233 OUT4 475
✓
LcbPiano2LiveCodeBench / atcoder / abc355_b: Piano 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 301 OUT3 456
✓
LcbWhoAteTheCakeLiveCodeBench / atcoder / abc355_a: Who Ate the Cake? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 250 OUT170
Code Generation - LiveCodeBench v2 LeetCode (set 1) 8 passed1 failed
88.9%
 IN82 567 OUT32 387
✓
LcbCountSubstringsStartEndCharLiveCodeBench / leetcode / medium: count-substrings-starting-and-ending-with-given-character (LCB 3337)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 103 OUT627
✓
LcbMaximumHappinessSumLiveCodeBench / leetcode / medium: maximize-happiness-of-selected-children (LCB 3351)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 198 OUT1 120
✓
LcbMaximumStrengthSubarraysLiveCodeBench / leetcode / hard: maximum-strength-of-k-disjoint-subarrays (LCB 3313)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 253 OUT14 104
✓
LcbMaxLengthTwoOccurrencesLiveCodeBench / leetcode / easy: maximum-length-substring-with-two-occurrences (LCB 3349)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 085 OUT1 560
✓
LcbMinDeletionsKSpecialLiveCodeBench / leetcode / medium: minimum-deletions-to-make-string-k-special (LCB 3360)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 158 OUT2 916
✓
LcbMinimumBoxesApplesLiveCodeBench / leetcode / easy: apple-redistribution-into-boxes (LCB 3334)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 188 OUT970
✓
LcbMinMovesPickKOnesLiveCodeBench / leetcode / hard: minimum-moves-to-pick-k-ones (LCB 3327)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 312 OUT6 993
×
LcbShortestUncommonSubstringsLiveCodeBench / leetcode / medium: shortest-uncommon-substring-in-an-array (LCB 3356)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: shortestSubstrings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 166 OUT3 147
✓
LcbSubstringInReverseLiveCodeBench / leetcode / easy: existence-of-a-substring-in-a-string-and-its-reverse (LCB 3353)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 104 OUT950
Code Generation - LiveCodeBench v2 LeetCode (set 2) 9 passed
100.0%
 IN82 464 OUT36 458
✓
LcbCountAlternatingSubarraysLiveCodeBench / leetcode / medium: count-alternating-subarrays (LCB 3374)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 116 OUT692
✓
LcbHarshadDigitSumLiveCodeBench / leetcode / easy: harshad-number (LCB 3371)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 115 OUT965
✓
LcbLexSmallestWithinDistanceLiveCodeBench / leetcode / medium: lexicographically-smallest-string-after-operations-with-constraint (LCB 3346)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 211 OUT10 109
✓
LcbLongestCommonSuffixQueriesLiveCodeBench / leetcode / hard: longest-common-suffix-queries (LCB 3376)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 210 OUT7 674
✓
LcbLongestMonotonicSubarrayLiveCodeBench / leetcode / easy: longest-strictly-increasing-or-decreasing-subarray (LCB 3372)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 124 OUT1 220
✓
LcbMinimizeManhattanDistanceLiveCodeBench / leetcode / hard: minimize-manhattan-distances (LCB 3344)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 147 OUT7 906
✓
LcbMinOpsMedianKLiveCodeBench / leetcode / medium: minimum-operations-to-make-median-of-array-equal-to-k (LCB 3387)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 187 OUT5 117
✓
LcbMinOpsSumAtLeastKLiveCodeBench / leetcode / medium: apply-operations-to-make-sum-of-array-ge-k (LCB 3328)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 142 OUT1 722
✓
LcbMostFrequentIdsLiveCodeBench / leetcode / medium: most-frequent-ids (LCB 3363)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 212 OUT1 053
Code Generation - LiveCodeBench v2 LeetCode (set 3) 8 passed1 failed
88.9%
 IN82 814 OUT103 635
✓
LcbKthSmallestAmountLiveCodeBench 3375 / leetcode / hard: kth-smallest-amount-with-single-denomination-combination (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 187 OUT3 366
✓
LcbLatestTimeReplaceLiveCodeBench 3361 / leetcode / easy: latest-time-you-can-obtain-after-replacing-characters (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 211 OUT4 157
✓
LcbMaximumPrimeDifferenceLiveCodeBench 3373 / leetcode / medium: maximum-prime-difference (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 156 OUT3 065
✓
LcbMinimizeStringValueLiveCodeBench 3354 / leetcode / medium: replace-question-marks-in-string-to-minimize-its-value (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 223 OUT39 978
×
LcbMinSumValuesDividingLiveCodeBench 3364 / leetcode / hard: minimum-sum-of-values-by-dividing-array (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minSumValuesDividing case1: expected 17 got -1
 Failed IN9 275 OUT41 363
✓
LcbShortestSubarrayOrKLiveCodeBench 3381 / leetcode / easy: shortest-subarray-with-or-at-least-k-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 179 OUT5 486
✓
LcbSumOfEncryptedIntsLiveCodeBench 3367 / leetcode / easy: find-the-sum-of-encrypted-integers (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 157 OUT929
✓
LcbSumOfPowerSubsequencesLiveCodeBench 3345 / leetcode / hard: find-the-sum-of-the-power-of-all-subsequences (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 172 OUT2 815
✓
LcbUnmarkedSumArrayLiveCodeBench 3306 / leetcode / medium: mark-elements-on-array-by-performing-queries (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 254 OUT2 476
Code Generation - LiveCodeBench v2 LeetCode (set 4) 9 passed
100.0%
 IN82 569 OUT34 628
✓
LcbAddedIntegerLiveCodeBench 3397 / leetcode / easy: find-the-integer-added-to-array-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 200 OUT589
✓
LcbMedianUniquenessArrayLiveCodeBench 3362 / leetcode / hard: find-the-median-of-the-uniqueness-array (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 220 OUT3 512
✓
LcbMinimumArrayEndLiveCodeBench 3394 / leetcode / medium: minimum-array-end (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 164 OUT2 649
✓
LcbMinimumLevelsGainPointsLiveCodeBench 3355 / leetcode / medium: minimum-levels-to-gain-more-points (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 223 OUT1 324
✓
LcbNumberOfSpecialCharsLiveCodeBench 3408 / leetcode / easy: count-the-number-of-special-characters-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 119 OUT920
✓
LcbScoreOfStringLiveCodeBench 3379 / leetcode / easy: score-of-a-string (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 170 OUT379
✓
LcbSubarraysBoundaryMaxLiveCodeBench 3382 / leetcode / hard: find-the-number-of-subarrays-where-boundary-elements-are-maximum (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 125 OUT6 363
✓
LcbSumOfSubsequencePowersLiveCodeBench 3316 / leetcode / hard: find-the-sum-of-subsequence-powers (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 180 OUT17 575
✓
LcbValidWordLiveCodeBench 3396 / leetcode / easy: valid-word (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 168 OUT1 317
Code Generation - LiveCodeBench v2 LeetCode (set 5) 8 passed1 broken
88.9%
 IN82 705 OUT94 615
✓
LcbCanMakeSquareColorLiveCodeBench / leetcode / easy: make-a-square-with-the-same-color1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 215 OUT1 060
✓
LcbIsArraySpecialILiveCodeBench / leetcode / easy: special-array-i1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 125 OUT611
✓
LcbMakeWordKPeriodicLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-word-k-periodic1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 195 OUT1 394
✓
LcbMinAnagramLengthLiveCodeBench / leetcode / medium: minimum-length-of-anagram-concatenation1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 129 OUT18 637
✓
LcbMinCostEqualizeArrayLiveCodeBench / leetcode / hard: minimum-cost-to-equalize-array1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 259 OUT5 613
✓
LcbMysticDungeonEnergyLiveCodeBench / leetcode / medium: taking-maximum-energy-from-the-mystic-dungeon1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 186 OUT844
✓
LcbNumberOfRightTrianglesLiveCodeBench / leetcode / medium: right-triangles1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 221 OUT3 614
!
LcbNumberOfStableArraysLiveCodeBench / leetcode / medium: find-all-possible-stable-binary-arrays-i1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 215 OUT62 144
✓
LcbPermutationDifferenceLiveCodeBench / leetcode / easy: permutation-difference-between-two-strings1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 160 OUT698
Code Generation - LiveCodeBench v2 LeetCode (set 6) 7 passed1 failed1 broken
77.8%
 IN82 699 OUT125 559
✓
LcbMaxSumNonAdjacentQueriesLiveCodeBench / leetcode / hard: maximum-sum-of-subsequence-with-non-adjacent-elements1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 226 OUT18 390
!
LcbMinBalancedPartitionLiveCodeBench / leetcode / medium: minimum-substring-partition-of-equal-character-frequency1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 123 OUT62 144
✓
LcbNumberOfGoodPairsILiveCodeBench / leetcode / easy: find-the-number-of-good-pairs-i1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 205 OUT14 574
✓
LcbOccurrencesOfElementLiveCodeBench / leetcode / medium: find-occurrences-of-an-element-in-an-array1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 203 OUT791
×
LcbProductsBigArrayLiveCodeBench / leetcode / hard: find-products-of-elements-of-big-array1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ProductsBigArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:20: The shift count of '<<' must be 'int', but got 'long'. 9:42: The shift count of '<<' must be 'int', but got 'long'. 10:34: The shift count of '<<' must be 'int', but got 'long'. 12:21: The shift count of '<<' must be 'int', but got 'long'. 24:20: The shift count of '<<' must be 'int', but got 'long'. 25:37: The shift count of '<<' must be 'int', but got 'long'. 26:34: The shift count of '<<' must be 'int', but got 'long'. 28:21: The shift count of '<<' must be 'int', but got 'long'. 56:17: The shift count of '>>' must be 'int', but got 'long'. Values: run.Compiled = false
 Failed IN9 308 OUT13 024
✓
LcbStringCompressionIIILiveCodeBench / leetcode / medium: string-compression-iii1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 147 OUT580
✓
LcbSumDigitDifferencesLiveCodeBench / leetcode / medium: sum-of-digit-differences-of-all-pairs1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 145 OUT1 497
✓
LcbWaysToReachStairLiveCodeBench / leetcode / hard: find-number-of-ways-to-reach-the-k-th-stair1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 202 OUT13 813
✓
LcbXorAppearingTwiceLiveCodeBench / leetcode / easy: find-the-xor-of-numbers-which-appear-twice1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 140 OUT746
Code Generation - LiveCodeBench v3 AtCoder (set 1) 5 passed2 failed
71.4%
 IN64 940 OUT17 346
✓
LcbKeysCombinationsLiveCodeBench / atcoder / medium: abc356_c Keys (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 390 OUT4 482
✓
LcbMaskedPopcountLiveCodeBench / atcoder / medium: abc356_d Masked Popcount (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 227 OUT3 096
×
LcbMaxMinFloorSumLiveCodeBench / atcoder / hard: abc356_e Max/Min (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MaxMinFloorSum case0 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 214 OUT3 916
✓
LcbNutrientsLiveCodeBench / atcoder / easy: abc356_b Nutrients (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 291 OUT1 538
×
LcbSanitizeHandsLiveCodeBench / atcoder / easy: abc357_a Sanitize Hands (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SanitizeHands case0 runtime error: List index 6 is out of range. The list has 6 element(s). Values: run.Success = false
 Failed IN9 266 OUT2 111
✓
LcbSierpinskiCarpetLiveCodeBench / atcoder / medium: abc357_c Sierpinski carpet (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 319 OUT1 232
✓
LcbSubsegmentReverseLiveCodeBench / atcoder / easy: abc356_a Subsegment Reverse (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 233 OUT971
Code Generation - LiveCodeBench v3 AtCoder (set 2) 6 passed1 failed
85.7%
 IN65 004 OUT40 154
×
LcbAlphabetTilesLiveCodeBench / atcoder / hard: abc358_e Alphabet Tiles (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: AlphabetTiles case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 287 OUT15 278
✓
LcbConcatModuloLiveCodeBench / atcoder / medium: abc357_d 88888888 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 278 OUT5 225
✓
LcbFunctionalGraphReachLiveCodeBench / atcoder / hard: abc357_e Reachability in Functional Graph (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 266 OUT10 311
✓
LcbPopcornStandsLiveCodeBench / atcoder / medium: abc358_c Popcorn (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 290 OUT2 592
✓
LcbSouvenirsLiveCodeBench / atcoder / medium: abc358_d Souvenirs (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 333 OUT4 303
✓
LcbTicketCounterLiveCodeBench / atcoder / easy: abc358_b Ticket Counter (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 331 OUT2 041
✓
LcbUppercaseLowercaseLiveCodeBench / atcoder / easy: abc357_b Uppercase and Lowercase (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 219 OUT404
Code Generation - LiveCodeBench v3 AtCoder (set 3) 4 passed1 failed2 broken
57.1%
 IN64 621 OUT141 043
!
LcbAvoidKPalindromeLiveCodeBench / atcoder abc359_d / hard: Avoid K Palindrome (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 221 OUT62 144
✓
LcbCountTakahashiLiveCodeBench / atcoder abc359_a / easy: Count Takahashi (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 177 OUT155
✓
LcbCouplesBetweenLiveCodeBench / atcoder abc359_b / easy: Couples (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 190 OUT1 540
✓
LcbMoveItBoxesLiveCodeBench / atcoder abc360_c / medium: Move It (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 230 OUT5 192
×
LcbTileDistance2TollLiveCodeBench / atcoder abc359_c / medium: Tile Distance 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: TileDistance2Toll case0: expected [5] got [6]
 Failed IN9 320 OUT9 482
!
LcbWaterTankFillLiveCodeBench / atcoder abc359_e / hard: Water Tank (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 317 OUT62 144
✓
LcbWelcomeAtCoderLandLiveCodeBench / atcoder abc358_a / easy: Welcome to AtCoder Land (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 166 OUT386
Code Generation - LiveCodeBench v3 AtCoder (set 4) 5 passed2 broken
71.4%
 IN64 699 OUT108 259
!
LcbGhostAntsPassLiveCodeBench / atcoder abc360_d / medium: Ghost Ants (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 300 OUT18 360
!
LcbGoStonePuzzleLiveCodeBench / atcoder abc361_d / hard: Go Stone Puzzle (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 286 OUT62 144
✓
LcbHealthyBreakfastLiveCodeBench / atcoder abc360_a / easy: A Healthy Breakfast (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 226 OUT515
✓
LcbInsertAfterKLiveCodeBench / atcoder abc361_a / easy: Insert (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 175 OUT1 754
✓
LcbIntersectCuboidsLiveCodeBench / atcoder abc361_b / medium: Intersection of Cuboids (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 207 OUT2 162
✓
LcbRandomSwapsBallsLiveCodeBench / atcoder abc360_e / hard: Random Swaps of Balls (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 280 OUT18 740
✓
LcbVerticalReadingPairLiveCodeBench / atcoder abc360_b / easy: Vertical Reading (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 225 OUT4 584
Code Generation - LiveCodeBench v3 AtCoder (set 5) 6 passed1 skipped
100.0%
 IN55 358 OUT55 258
✓
LcbBuyAPenLiveCodeBench / atcoder / easy: abc362_a Buy a Pen (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 203 OUT594
✓
LcbCountArithmeticSubsequencesLiveCodeBench / atcoder / hard: abc362_e Count Arithmetic Subsequences (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 261 OUT23 319
✓
LcbMakeThemNarrowLiveCodeBench / atcoder / medium: abc361_c Make Them Narrow (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 213 OUT3 168
✓
LcbPerfectPowerCountLiveCodeBench / atcoder / hard: abc361_f x = a^b (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 156 OUT8 009
✓
LcbShortestPath3LiveCodeBench / atcoder / hard: abc362_d Shortest Path 3 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 280 OUT13 881
–
LcbSumZeroSequenceLiveCodeBench / atcoder / medium: abc362_c Sum = 0 (Pattern B, stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbTreeHamiltonPathLiveCodeBench / atcoder / hard: abc361_e Tree and Hamilton Path 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 245 OUT6 287
Code Generation - LiveCodeBench v3 AtCoder (set 6) 5 passed1 failed1 skipped
83.3%
 IN55 512 OUT92 446
×
LcbAvoidKPalindrome2LiveCodeBench / atcoder / medium: abc363_c Avoid K Palindrome 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: AvoidKPalindrome2 case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 269 OUT43 187
✓
LcbCursedDollLiveCodeBench / atcoder / easy: abc363_b Japanese Cursed Doll (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 239 OUT2 433
✓
LcbNthPalindromeLiveCodeBench / atcoder / medium: abc363_d Palindromic Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 179 OUT6 805
–
LcbPalindromicExpressionLiveCodeBench / atcoder / hard: abc363_f Palindromic Expression (Pattern B, stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbPilingUpLiveCodeBench / atcoder / easy: abc363_a Piling Up (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 259 OUT635
✓
LcbRightTriangleCheckLiveCodeBench / atcoder / easy: abc362_b Right Triangle (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 209 OUT959
✓
LcbSinkingLandLiveCodeBench / atcoder / hard: abc363_e Sinking Land (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 357 OUT38 427
Code Generation - LiveCodeBench v3 AtCoder (set 7) 2 passed4 failed
33.3%
 IN55 525 OUT58 427
×
LcbGluttonTakahashiLiveCodeBench / atcoder / easy: Glutton Takahashi (abc364_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: GluttonTakahashi case2: expected [No] got [Yes]
 Failed IN9 191 OUT2 939
✓
LcbGridWalkLiveCodeBench / atcoder / easy: Grid Walk (abc364_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 371 OUT1 070
×
LcbKthClosestPointLiveCodeBench / atcoder / hard: K — k-th closest point (abc364_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: KthClosestPoint case0 runtime error: List index 5 is out of range. The list has 5 element(s). Values: run.Success = false
 Failed IN9 272 OUT17 907
×
LcbMaximumGluttonLiveCodeBench / atcoder / hard: Maximum Glutton (abc364_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: MaximumGlutton case0: expected [3] got [2]
 Failed IN9 234 OUT5 300
✓
LcbMinimumGluttonLiveCodeBench / atcoder / medium: Minimum Glutton (abc364_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 198 OUT12 529
×
LcbRangeConnectMstLiveCodeBench / atcoder / hard: Range Connect MST (abc364_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: RangeConnectMst case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 259 OUT18 682
Code Generation - LiveCodeBench v3 AtCoder (set 8) 4 passed1 failed
80.0%
 IN46 110 OUT29 650
✓
LcbAtcoderJanken3LiveCodeBench / atcoder / medium: AtCoder Janken 3 (abc365_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 267 OUT3 409
✓
LcbLeapYearLiveCodeBench / atcoder / easy: Leap Year (abc365_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 241 OUT132
✓
LcbSecondBestLiveCodeBench / atcoder / easy: Second Best (abc365_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 173 OUT918
✓
LcbTransportationExpensesLiveCodeBench / atcoder / medium: Transportation Expenses (abc365_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 233 OUT2 075
×
LcbXorSigmaProblemLiveCodeBench / atcoder / hard: Xor Sigma Problem (abc365_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: XorSigmaProblem case0 runtime error: List index 3 is out of range. The list has 3 element(s). Values: run.Success = false
 Failed IN9 196 OUT23 116
Code Generation - LiveCodeBench v3 LeetCode (set 1) 7 passed1 failed
87.5%
 IN73 377 OUT31 285
✓
LcbChildWithBallLiveCodeBench / leetcode / easy: find-the-child-who-has-the-ball-after-k-seconds (id 3450)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 179 OUT439
✓
LcbCompleteDayPairsLiveCodeBench / leetcode / easy: count-pairs-that-form-a-complete-day-i (id 3421)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 138 OUT1 199
✓
LcbCountDaysWithoutMeetingsLiveCodeBench / leetcode / medium: count-days-without-meetings (id 3430)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 196 OUT3 003
✓
LcbMaxTotalDamageLiveCodeBench / leetcode / medium: maximum-total-damage-with-spell-casting (id 3437)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 158 OUT3 656
×
LcbMaxTotalRewardLiveCodeBench / leetcode / medium: maximum-total-reward-using-operations-i (id 3442)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxTotalReward case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:149: Char literals must contain exactly one character and close with '''. 11:218: Char literals must contain exactly one character and close with '''. 16:47: Char literals must contain exactly one character and close with '''. 16:134: Unexpected character '✓'. 17:180: Char literals must contain exactly one character and close with '''. 86:8: Char literals must contain exactly one character and close with '''. 88:18: Unexpected character '→'. 88:44: Char literals must contain exactly one character and close with '''. 90:69: Char literals must contain exactly one character and close with '''. 94:24: Char literals must contain exactly one character and close with '''. 98:66: Char literals must contain exactly one character and close with '''. 100:116: Char literals must contain exactly one character and close with '''. 116:203: Unexpected character '≤'. 116:334: Char literals must contain exactly one character and close with '''. 130:134: Unexpected character '→'. 130:147: Char literals must contain exactly one character and close with '''. 132:23: Char literals must contain exactly one character and close with '''. 134:172: Unexpected character '≈'. 140:91: Char literals must contain exactly one character and close with '''. 144:29: Char literals must contain exactly one character and close with '''. 170:15: Char literals must contain exactly one character and close with '''. 172:6: Char literals must contain exactly one character and close with '''. 178:17: Char literals must contain exactly one character and close with '''. 180:14: Char literals must contain exactly one character and close with '''. 182:71: Char literals must contain exactly one character and close with '''. 188:11: Char literals must contain exactly one character and close with '''. 207:12: Unexpected character '→'. 208:12: Unexpected character '→'. 209:12: Unexpected character '→'. 215:32: Char literals must contain exactly one character and close with '''. 235:15: Char literals must contain exactly one character and close with '''. 254:205: Char literals must contain exactly one character and close with '''. 256:35: Unexpected character '→'. 256:37: Unexpected character '→'. 256:39: Unexpected character '→'. 256:59: Unexpected character '✓'. 256:65: Unexpected character '✓'. 256:71: Unexpected character '✓'. 258:13: Char literals must contain exactly one character and close with '''. 264:33: Unexpected character '≤'. 264:51: Unexpected character '≤'. 266:5: Char literals must contain exactly one character and close with '''. 268:94: Char literals must contain exactly one character and close with '''. 276:56: Char literals must contain exactly one character and close with '''. 278:25: Char literals must contain exactly one character and close with '''. 280:152: Unexpected character '≤'. 280:155: Unexpected character '≤'. 280:159: Unexpected character '≤'. 280:201: Unexpected character '≥'. 282:10: Char literals must contain exactly one character and close with '''. 284:40: Unexpected character '≤'. 284:66: Unexpected character '≤'. 284:88: Unexpected character '≥'. 284:111: Unexpected character '≥'. 286:8: Char literals must contain exactly one character and close with '''. 290:28: Unexpected character '→'. 337:162: Char literals must contain exactly one character and close with '''. 339:199: Char literals must contain exactly one character and close with '''. 364:15: Char literals must contain exactly one character and close with '''. 372:34: Unexpected character '≤'. 385:71: Char literals must contain exactly one character and close with '''. 388:32: Unexpected character '→'. 392:2: Char literals must contain exactly one character and close with '''. 394:123: Unexpected character '≥'. 398:94: Char literals must contain exactly one character and close with '''. 404:176: Char literals must contain exactly one character and close with '''. 406:61: Unexpected character '≤'. 415:134: ... (message truncated)
 Failed IN9 172 OUT18 486
✓
LcbMinimumChairsLiveCodeBench / leetcode / easy: minimum-number-of-chairs-in-a-waiting-room (id 3426)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 161 OUT350
✓
LcbSubarrayOrClosestKLiveCodeBench / leetcode / hard: find-subarray-with-bitwise-or-closest-to-k (id 3436)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 180 OUT1 330
✓
LcbValueAfterKSecondsLiveCodeBench / leetcode / medium: find-the-n-th-value-after-k-seconds (id 3422)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 193 OUT2 822
Code Generation - LiveCodeBench v3 LeetCode (set 2) 8 passed
100.0%
 IN73 547 OUT26 002
✓
LcbEncryptedStringLiveCodeBench / leetcode / easy: find-the-encrypted-string (id 3468)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 125 OUT630
✓
LcbMaxTotalCostAlternatingLiveCodeBench / leetcode / medium: maximize-total-cost-of-alternating-subarrays (id 3464)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 216 OUT5 743
✓
LcbMaxTriangleHeightLiveCodeBench / leetcode / easy: maximum-height-of-a-triangle (id 3469)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 182 OUT5 874
✓
LcbMaxValidSubsequenceLiveCodeBench / leetcode / medium: find-the-maximum-length-of-valid-subsequence-i (id 3490)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 183 OUT2 268
✓
LcbMinDiameterMergeTreesLiveCodeBench / leetcode / hard: find-minimum-diameter-after-merging-two-trees (id 3439)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 282 OUT2 827
✓
LcbMinimumAreaCoverOnesLiveCodeBench / leetcode / medium: find-the-minimum-area-to-cover-all-ones-i (id 3461)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 128 OUT1 288
✓
LcbMinimumAverageLiveCodeBench / leetcode / easy: minimum-average-of-smallest-and-largest-elements (id 3471)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 183 OUT1 018
✓
LcbPeaksInArrayLiveCodeBench / leetcode / hard: peaks-in-array (id 3438)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 248 OUT6 354
Code Generation - LiveCodeBench v3 LeetCode (set 3) 7 passed1 skipped
100.0%
 IN64 783 OUT46 533
✓
LcbBitChangesEqualLiveCodeBench / leetcode / easy: 3508 number-of-bit-changes-to-make-two-integers-equal1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 221 OUT879
✓
LcbCountEqualXYSubmatricesLiveCodeBench / leetcode / medium: 3492 count-submatrices-with-equal-frequency-of-x-and-y1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 236 OUT3 445
✓
LcbMaxOpsMoveOnesLiveCodeBench / leetcode / medium: 3493 maximum-number-of-operations-to-move-ones-to-the-end1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 218 OUT8 284
✓
LcbMinCostConstructStringLiveCodeBench / leetcode / hard: 3482 construct-string-with-minimum-cost1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 332 OUT16 873
✓
LcbMinCostCutCakeLiveCodeBench / leetcode / medium: 3494 minimum-cost-for-cutting-cake-i1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 348 OUT1 724
✓
LcbSmallestStringAfterSwapLiveCodeBench / leetcode / easy: 3484 lexicographically-smallest-string-after-a-swap1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 214 OUT2 486
–
LcbValidBinaryStringsLiveCodeBench / leetcode / medium: 3453 generate-binary-strings-without-adjacent-zeros0 AI queries 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbVowelsGameLiveCodeBench / leetcode / medium: 3462 vowels-game-in-a-string1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 214 OUT12 842
Code Generation - LiveCodeBench v3 LeetCode (set 4) 6 passed2 failed
75.0%
 IN74 281 OUT81 646
×
LcbAlternatingGroupsIIILiveCodeBench / leetcode / hard: 3527 alternating-groups-iii1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: numberOfAlternatingGroups case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 401 OUT6 488
✓
LcbDigitGameWinLiveCodeBench / leetcode / easy: 3515 find-if-digit-game-can-be-won1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 255 OUT556
✓
LcbDominantOnesSubstringsLiveCodeBench / leetcode / medium: 3479 count-the-number-of-substrings-with-dominant-ones1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 185 OUT19 715
✓
LcbMinOpsArrayToTargetLiveCodeBench / leetcode / hard: 3454 minimum-operations-to-make-array-equal-to-target1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 214 OUT2 235
✓
LcbNonSpecialCountLiveCodeBench / leetcode / medium: 3507 find-the-count-of-numbers-which-are-not-special1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 239 OUT2 536
✓
LcbRectangleCornerReachableLiveCodeBench / leetcode / hard: 3478 check-if-the-rectangle-corner-is-reachable1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 390 OUT47 928
×
LcbShortestDistanceQueriesLiveCodeBench / leetcode / medium: 3517 shortest-distance-after-road-addition-queries-i1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: shortestDistanceAfterQueries case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 331 OUT1 732
✓
LcbSnakeFinalPositionLiveCodeBench / leetcode / easy: 3533 snake-in-matrix1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 266 OUT456
Code Generation - LiveCodeBench v3 LeetCode (set 5) 8 passed
100.0%
 IN73 494 OUT48 294
✓
LcbAlternatingGroupsCircleLiveCodeBench / leetcode / easy: alternating-groups-i (LCB id 3463)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 178 OUT563
✓
LcbClearDigitsLiveCodeBench / leetcode / easy: clear-digits (LCB id 3447)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 125 OUT1 972
✓
LcbCountInversionPermutationsLiveCodeBench / leetcode / hard: count-the-number-of-inversions (LCB id 3460)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 280 OUT27 041
✓
LcbCountMonotonicPairsLiveCodeBench / leetcode / hard: find-the-count-of-monotonic-pairs-i (LCB id 3535)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 242 OUT3 352
✓
LcbFirstPlayerWinKGamesLiveCodeBench / leetcode / medium: find-the-first-player-to-win-k-games-in-a-row (LCB id 3413)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 226 OUT2 446
✓
LcbMaxGoodSubsequenceLengthLiveCodeBench / leetcode / medium: find-the-maximum-length-of-a-good-subsequence-i (LCB id 3456)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 165 OUT4 714
✓
LcbMinOpsBinaryToOneLiveCodeBench / leetcode / medium: minimum-operations-to-make-binary-array-elements-equal-to-one-i (LCB id 3475)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 159 OUT7 686
✓
LcbMinOpsDivisibleThreeLiveCodeBench / leetcode / easy: find-minimum-operations-to-make-all-elements-divisible-by-three (LCB id 3476)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 119 OUT520
Code Generation - LiveCodeBench v3 LeetCode (set 6) 7 passed1 failed
87.5%
 IN73 659 OUT47 184
✓
LcbCoinGameWinnerLiveCodeBench / leetcode / easy: find-the-winning-player-in-coin-game (LCB id 3511)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 174 OUT1 219
✓
LcbCountSubarraysAndKLiveCodeBench / leetcode / hard: number-of-subarrays-with-and-value-of-k (LCB id 3466)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 144 OUT4 760
✓
LcbCountWinningPlayersLiveCodeBench / leetcode / easy: find-the-number-of-winning-players (LCB id 3519)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 276 OUT1 137
×
LcbMaxPointsEnemyBattlesLiveCodeBench / leetcode / medium: maximum-points-after-enemy-battles (LCB id 3264)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxPointsEnemyBattles case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'maximumPoints' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, MaximumPoints. Values: run.Compiled = false
 Failed IN9 241 OUT7 320
✓
LcbMinChangesEqualDiffsLiveCodeBench / leetcode / medium: minimum-array-changes-to-make-differences-equal (LCB id 3498)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 195 OUT19 395
✓
LcbMinFlipsPalindromicGridLiveCodeBench / leetcode / medium: minimum-number-of-flips-to-make-binary-grid-palindromic-i (LCB id 3526)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 190 OUT1 636
✓
LcbMinLengthAfterOpsLiveCodeBench / leetcode / medium: minimum-length-of-string-after-operations (LCB id 3455)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 162 OUT1 392
✓
LcbTimeTakenMarkNodesLiveCodeBench / leetcode / hard: time-taken-to-mark-all-nodes (LCB id 3532)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 277 OUT10 325
Code Generation - LiveCodeBench v4 AtCoder (set 1) 7 passed1 failed1 skipped
87.5%
 IN73 893 OUT61 270
×
LcbBallsAndBagQueryLiveCodeBench / atcoder / medium: abc366_c Balls and Bag Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BallsAndBagQuery case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 37:25: Type 'string' has no supported method named 'TrimEnd'. Values: run.Compiled = false
 Failed IN9 211 OUT1 013
✓
LcbCuboidSumQueryLiveCodeBench / atcoder / medium: abc366_d Cuboid Sum Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 321 OUT17 687
✓
LcbCutTrailingZerosLiveCodeBench / atcoder / easy: abc367_b Cut .0 (Pattern B, stdin) NOTE (triage): float-formatting output — model must print X with no trailing zeros and no trailing decimal point. Compared as a trimmed string. Flagged for coordinator.1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 203 OUT694
✓
LcbElection2LiveCodeBench / atcoder / easy: abc366_a Election 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 217 OUT1 849
✓
LcbManhattanEllipseLiveCodeBench / atcoder / hard: abc366_e Manhattan Multifocal Ellipse (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 234 OUT8 074
✓
LcbMaximumCompositionLiveCodeBench / atcoder / hard: abc366_f Maximum Composition (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 238 OUT24 916
✓
LcbShoutEverydayLiveCodeBench / atcoder / easy: abc367_a Shout Everyday (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 198 OUT2 926
✓
LcbVerticalWritingLiveCodeBench / atcoder / easy: abc366_b Vertical Writing (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 271 OUT4 111
–
LcbXorNeighborsLiveCodeBench / atcoder / hard: abc366_g XOR Neighbors (Pattern B, stdin) NOTE (triage): non-unique answer — any valid assignment is accepted, so exact-string comparison against the sample output will reject other correct solutions. Flagged for coordinator.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
Code Generation - LiveCodeBench v4 AtCoder (set 2) 6 passed2 failed
75.0%
 IN74 028 OUT128 901
✓
LcbAddMultiplyQueriesLiveCodeBench / atcoder / hard: abc368_g Add and Multiply Queries (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 295 OUT47 711
✓
LcbCardCutLiveCodeBench / atcoder / easy: abc368_a Cut (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 217 OUT348
✓
LcbDecreaseTwoMaxLiveCodeBench / atcoder / easy: abc368_b Decrease 2 max elements (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 202 OUT2 295
×
LcbEnumerateSequencesLiveCodeBench / atcoder / medium: abc367_c Enumerate Sequences (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: EnumerateSequences case0: expected [1 1 2 2 1 1 2 1 3] got []
 Failed IN9 214 OUT9 301
✓
LcbPedometerLiveCodeBench / atcoder / medium: abc367_d Pedometer (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 267 OUT5 079
✓
LcbPermuteKTimesLiveCodeBench / atcoder / hard: abc367_e Permute K times (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 242 OUT2 215
✓
LcbRearrangeQueryLiveCodeBench / atcoder / hard: abc367_f Rearrange Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 295 OUT19 181
×
LcbSumXorKLiveCodeBench / atcoder / hard: abc367_g Sum of (XOR^K or 0) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SumXorK case0 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 296 OUT42 771
Code Generation - LiveCodeBench v4 AtCoder (set 3) 8 passed1 failed
88.9%
 IN83 475 OUT47 774
✓
LcbArrangeArithmeticLiveCodeBench / atcoder / abc369_a: 369 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 209 OUT1 848
✓
LcbAsFarAsPossibleLiveCodeBench / atcoder / abc369_g: As far as possible (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 368 OUT8 651
✓
LcbBonusExpLiveCodeBench / atcoder / abc369_d: Bonus EXP (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 273 OUT1 563
×
LcbCountArithmeticSubarraysLiveCodeBench / atcoder / abc369_c: Count Arithmetic Subarrays (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: CountArithmeticSubarrays case0: expected [8] got [7]
 Failed IN9 254 OUT3 714
✓
LcbDividingGameLiveCodeBench / atcoder / abc368_f: Dividing Game (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 258 OUT2 706
✓
LcbMinimumSteinerTreeLiveCodeBench / atcoder / abc368_d: Minimum Steiner Tree (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 216 OUT10 033
✓
LcbPiano3LiveCodeBench / atcoder / abc369_b: Piano 3 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 306 OUT9 267
✓
LcbTrainDelayLiveCodeBench / atcoder / abc368_e: Train Delay (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 340 OUT7 804
✓
LcbTripleAttackLiveCodeBench / atcoder / abc368_c: Triple Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 251 OUT2 188
Code Generation - LiveCodeBench v4 AtCoder (set 4) 7 passed1 failed
87.5%
 IN74 367 OUT104 726
✓
LcbAvoidKPartitionLiveCodeBench / atcoder / abc370_e: Avoid K Partition (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 316 OUT11 714
✓
LcbBinaryAlchemyLiveCodeBench / atcoder / abc370_b: Binary Alchemy (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 248 OUT1 232
✓
LcbCakeDivisionLiveCodeBench / atcoder / abc370_f: Cake Division (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 367 OUT59 043
✓
LcbCrossExplosionLiveCodeBench / atcoder / abc370_d: Cross Explosion (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 344 OUT2 426
×
LcbDivisibleByThreeLiveCodeBench / atcoder / abc370_g: Divisible by 3 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: DivisibleByThree case3 runtime error: Cannot cast value to 'int' because it is outside the target type range. Values: run.Success = false
 Failed IN9 192 OUT8 256
✓
LcbRaiseBothHandsLiveCodeBench / atcoder / abc370_a: Raise Both Hands (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 263 OUT390
✓
LcbSightseeingTourLiveCodeBench / atcoder / abc369_e: Sightseeing Tour (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 364 OUT13 126
✓
LcbWordLadderLiveCodeBench / atcoder / abc370_c: Word Ladder (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 273 OUT8 539
Code Generation - LiveCodeBench v4 AtCoder (set 5) 8 passed1 failed
88.9%
 IN83 437 OUT119 164
✓
LcbCountABCAgainLiveCodeBench / atcoder / medium: abc372_c Count ABC Again (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 239 OUT8 126
✓
LcbDistinctSubarraySumLiveCodeBench / atcoder / hard: abc371_e I Hate Sigma Problems (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 207 OUT3 654
✓
LcbKthLargestConnectedLiveCodeBench / atcoder / hard: abc372_e K (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 277 OUT12 380
✓
LcbLexSmallestPermLiveCodeBench / atcoder / hard: abc371_g Lexicographically Smallest Permutation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 246 OUT37 007
✓
LcbMakeIsomorphicLiveCodeBench / atcoder / medium: abc371_c Make Isomorphic (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 400 OUT10 799
✓
LcbMiddleBrotherLiveCodeBench / atcoder / easy: abc371_a Jiro (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 226 OUT1 119
×
LcbNarrowRoadLiveCodeBench / atcoder / hard: abc371_f Takahashi in Narrow Road (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NarrowRoad case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:17: Expected '(' to declare a function or '=' to declare a global variable after 'List<long> stSum', found ';'. Global variables must have an initializer. Values: run.Compiled = false
 Failed IN9 287 OUT32 149
✓
LcbOneDCountryLiveCodeBench / atcoder / medium: abc371_d 1D Country (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 279 OUT12 782
✓
LcbTaroNameLiveCodeBench / atcoder / easy: abc371_b Taro (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 276 OUT1 148
Code Generation - LiveCodeBench v4 AtCoder (set 6) 7 passed1 skipped
100.0%
 IN64 717 OUT96 573
✓
LcbAxByLessCLiveCodeBench / atcoder / hard: abc372_g Ax + By < C (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 302 OUT60 611
✓
LcbDeleteDotsLiveCodeBench / atcoder / easy: abc372_a delete . (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 151 OUT117
✓
LcbDiminishingKnapsackLiveCodeBench / atcoder / hard: abc373_f Knapsack with Diminishing Values (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 243 OUT13 091
–
LcbNoCrossMatchingLiveCodeBench / atcoder / hard: abc373_g No Cross Matching (Pattern B, stdin) NOTE: non-unique answer — any non-crossing perfect matching R is valid; the exact-match oracle may reject a different valid R.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbOneDKeyboardLiveCodeBench / atcoder / easy: abc373_b 1D Keyboard (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 244 OUT1 882
✓
LcbSeptemberLengthsLiveCodeBench / atcoder / easy: abc373_a September (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 181 OUT324
✓
LcbTeleportingWalksLiveCodeBench / atcoder / hard: abc372_f Teleporting Takahashi 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 362 OUT17 296
✓
LcbVisibleBuildingsLiveCodeBench / atcoder / medium: abc372_d Buildings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 234 OUT3 252
Code Generation - LiveCodeBench v4 AtCoder (set 7) 4 passed1 failed1 broken1 skipped
66.7%
 IN55 566 OUT169 146
✓
LcbAnnoyingStringLiveCodeBench / atcoder / hard: arc181_b Annoying String Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 261 OUT20 487
✓
LcbIncDecAgainLiveCodeBench / atcoder / hard: arc182_d Increment Decrement Again (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 306 OUT51 966
✓
LcbMaxAiBjLiveCodeBench / atcoder / medium: abc373_c Max Ai+Bj (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 172 OUT312
×
LcbPrefixBubbleSortLiveCodeBench / atcoder / hard: arc181_d Prefix Bubble Sort (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PrefixBubbleSort case0: expected [3 1] got [5 5]
 Failed IN9 292 OUT7 064
–
LcbRowColumnOrderLiveCodeBench / atcoder / hard: arc181_c Row and Column Order (Pattern B, stdin) TRIAGE: non-unique answer (any valid grid accepted) — exact string compare may fail correct solutions.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbSortLeftRightLiveCodeBench / atcoder / medium: arc181_a Sort Left and Right (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 264 OUT27 173
!
LcbWinElectionLiveCodeBench / atcoder / hard: abc373_e How to Win the Election (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 271 OUT62 144
Code Generation - LiveCodeBench v4 AtCoder (set 8) 1 passed4 failed1 broken1 skipped
16.7%
 IN55 380 OUT174 692
×
LcbChmaxRushLiveCodeBench / atcoder / hard: arc182_a Chmax Rush! (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: ChmaxRush case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 358 OUT53 748
!
LcbDivisorsOfProductLiveCodeBench / atcoder / hard: arc182_c Sum of Number of Divisors of Product (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 203 OUT62 144
–
LcbKeepMatchedLiveCodeBench / atcoder / hard: arc183_d Keep Perfectly Matched (Pattern B, stdin) TRIAGE: non-unique answer (any maximizing procedure accepted) — exact string compare may fail correct solutions.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
×
LcbMedianGoodSeqLiveCodeBench / atcoder / medium: arc183_a Median of Good Sequences (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MedianGoodSeq case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:79: Unexpected character '`'. 3:81: Unexpected character '`'. 3:102: Unexpected character '`'. 3:107: Unexpected character '`'. 3:175: Unexpected character '`'. 3:183: Unexpected character '`'. 5:45: Unexpected character '→'. 5:47: Unexpected character '`'. 5:57: Unexpected character '`'. 5:59: Unexpected character '✓'. 6:28: Unexpected character '→'. 6:30: Unexpected character '`'. 6:44: Unexpected character '`'. 6:46: Unexpected character '✓'. Values: run.Compiled = false
 Failed IN9 175 OUT11 530
×
LcbNearAssignmentLiveCodeBench / atcoder / hard: arc183_b Near Assignment (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NearAssignment case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 173:25: Type 'string' has no supported method named 'TrimEnd'. Values: run.Compiled = false
 Failed IN9 240 OUT26 432
×
LcbNotArgmaxLiveCodeBench / atcoder / hard: arc183_c Not Argmax (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: NotArgmax case2: expected [1598400] got [9151]
 Failed IN9 225 OUT13 427
✓
LcbSumMinModLinearLiveCodeBench / atcoder / hard: arc182_e Sum of Min of Mod of Linear (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 179 OUT7 411
Code Generation - LiveCodeBench v4 LeetCode (set 1) 5 passed1 broken
83.3%
 IN55 181 OUT94 150
✓
LcbAlmostEqualPairsLiveCodeBench / leetcode / medium: count-almost-equal-pairs-i (id 3534)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 198 OUT6 339
✓
LcbBeautifulArraySumLiveCodeBench / leetcode / medium: find-the-minimum-possible-sum-of-a-beautiful-array (id 3026)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 187 OUT4 248
✓
LcbFinalArrayStateLiveCodeBench / leetcode / easy: final-array-state-after-k-multiplication-operations-i (id 3555)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 210 OUT16 597
✓
LcbKConstraintSubstringsLiveCodeBench / leetcode / easy: count-substrings-that-satisfy-k-constraint-i (id 3543)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 191 OUT2 593
!
LcbLargestKPalindromeLiveCodeBench / leetcode / hard: find-the-largest-palindrome-divisible-by-k (id 3552)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 162 OUT62 144
✓
LcbMaxEnergyBoostLiveCodeBench / leetcode / medium: maximum-energy-boost-from-two-drinks (id 3525)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 233 OUT2 229
Code Generation - LiveCodeBench v4 LeetCode (set 2) 5 passed1 failed
83.3%
 IN55 268 OUT37 006
✓
LcbConvertDateBinaryLiveCodeBench / leetcode / easy: convert-date-to-binary (id 3567)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 181 OUT2 638
×
LcbKthNearestObstacleLiveCodeBench / leetcode / medium: k-th-nearest-obstacle-queries (id 3495)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: obstacle case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 57:24: Type 'Dictionary<long, int>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
 Failed IN9 250 OUT9 460
✓
LcbMaxCellScoreLiveCodeBench / leetcode / hard: select-cells-in-grid-with-maximum-score (id 3563)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 178 OUT3 628
✓
LcbMaxRangeScoreLiveCodeBench / leetcode / medium: maximize-score-of-numbers-in-ranges (id 3485)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 173 OUT14 471
✓
LcbMaxXorSubarrayLiveCodeBench / leetcode / hard: maximum-xor-score-subarray-queries (id 3551)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 313 OUT6 148
✓
LcbSameChessboardColorLiveCodeBench / leetcode / easy: check-if-two-chessboard-squares-have-the-same-color (id 3553)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 173 OUT661
Code Generation - LiveCodeBench v4 LeetCode (set 3) 6 passed
100.0%
 IN55 509 OUT62 683
✓
LcbKnightKillPawnsLiveCodeBench / leetcode / hard: maximum-number-of-moves-to-kill-all-pawns (LCB 3560)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 343 OUT12 089
✓
LcbMaxMultiplicationScoreLiveCodeBench / leetcode / medium: maximum-multiplication-score (LCB 3518)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 288 OUT1 793
✓
LcbMinValidStringsLiveCodeBench / leetcode / medium: minimum-number-of-valid-strings-to-form-target-i (LCB 3559)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 185 OUT4 572
✓
LcbPowerKSizeSubarraysLiveCodeBench / leetcode / medium: find-the-power-of-k-size-subarrays-i (LCB 3522)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 253 OUT2 430
✓
LcbReachEndMaxScoreLiveCodeBench / leetcode / medium: reach-end-of-array-with-max-score (LCB 3528)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 209 OUT13 341
✓
LcbThreeRooksMaxSumLiveCodeBench / leetcode / hard: maximum-value-sum-by-placing-three-rooks-i (LCB 3550)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 231 OUT28 458
Code Generation - LiveCodeBench v4 LeetCode (set 4) 6 passed
100.0%
 IN55 660 OUT64 477
✓
LcbCountGoodIntegersLiveCodeBench / leetcode / hard: find-the-count-of-good-integers (LCB 3548)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 270 OUT7 379
✓
LcbGenerateKeyNumbersLiveCodeBench / leetcode / easy: find-the-key-of-the-numbers (LCB 3568)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 294 OUT2 019
✓
LcbHashDividedStringLiveCodeBench / leetcode / medium: hash-divided-string (LCB 3540)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 271 OUT541
✓
LcbMaxSequenceValueLiveCodeBench / leetcode / hard: find-the-maximum-sequence-value-of-array (LCB 3575)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 234 OUT25 288
✓
LcbMinDamageToBobLiveCodeBench / leetcode / hard: minimum-amount-of-damage-dealt-to-bob (LCB 3531)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 269 OUT17 673
✓
LcbSafeWalkGridLiveCodeBench / leetcode / medium: find-a-safe-walk-through-a-grid (LCB 3558)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 322 OUT11 577
Code Generation - LiveCodeBench v4 LeetCode (set 5) 6 passed
100.0%
 IN55 275 OUT54 582
✓
LcbKthCharacterGameLiveCodeBench 3600 / leetcode / easy: find the k-th character in string game I (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 206 OUT1 786
✓
LcbLongestIncreasingPathLiveCodeBench 3571 / leetcode / hard: length of the longest increasing path (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 279 OUT11 851
✓
LcbMountainHeightZeroLiveCodeBench 3496 / leetcode / medium: minimum number of seconds to make mountain height zero (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 279 OUT24 069
✓
LcbReportSpamLiveCodeBench 3541 / leetcode / medium: report spam message (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 162 OUT843
✓
LcbSubstringsVowelsKConsonantsLiveCodeBench 3570 / leetcode / medium: count of substrings containing every vowel and k consonants I (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 166 OUT12 672
✓
LcbValidSubstringCountLiveCodeBench 3573 / leetcode / medium: count substrings that can be rearranged to contain a string I (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 183 OUT3 361
Code Generation - LiveCodeBench v4 LeetCode (set 6) 6 passed
100.0%
 IN55 300 OUT93 943
✓
LcbFirstAlmostEqualSubstringLiveCodeBench 3580 / leetcode / hard: find the occurrence of first almost equal substring (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 198 OUT18 837
✓
LcbLexSmallestValidSequenceLiveCodeBench 3584 / leetcode / medium: find the lexicographically smallest valid sequence (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 279 OUT38 532
✓
LcbMaxBinaryConcatenationLiveCodeBench 3579 / leetcode / medium: maximum possible number by binary concatenation (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 166 OUT4 598
✓
LcbMaxUniqueTowerHeightsLiveCodeBench 3510 / leetcode / medium: maximize the total height of unique towers (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 203 OUT953
✓
LcbMinAfterDigitSumLiveCodeBench 3606 / leetcode / easy: minimum element after replacement with digit sum (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 159 OUT719
✓
LcbSortedGcdPairQueriesLiveCodeBench 3583 / leetcode / hard: sorted GCD pair queries (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 295 OUT30 304
Code Generation - LiveCodeBench v5 AtCoder (set 1) 8 passed2 failed2 skipped
80.0%
 IN92 203 OUT91 543
×
LcbAbaPalindromeLiveCodeBench / atcoder / medium: abc375_d ABA (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: AbaPalindrome case0: expected [5] got [1]
 Failed IN9 189 OUT1 070
–
LcbLaserMarkingLiveCodeBench / atcoder / medium: abc374_d Laser Marking (Pattern B, stdin) [float output, tolerance 1e-6]0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected
 Skipped IN0 OUT0
×
LcbOnlyOneProductNameLiveCodeBench / atcoder / hard: abc374_g Only One Product Name (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OnlyOneProductName case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 126:31: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('. Values: run.Compiled = false
 Failed IN9 227 OUT56 084
✓
LcbSeatsLiveCodeBench / atcoder / easy: abc375_a Seats (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 182 OUT470
✓
LcbSensorOptimizationLiveCodeBench / atcoder / hard: abc374_e Sensor Optimization Dilemma 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 278 OUT5 131
✓
LcbSeparatedLunchLiveCodeBench / atcoder / medium: abc374_c Separated Lunch (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 199 OUT3 683
✓
LcbShippingLiveCodeBench / atcoder / hard: abc374_f Shipping (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 281 OUT12 342
✓
LcbSpiralRotationLiveCodeBench / atcoder / medium: abc375_c Spiral Rotation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 249 OUT8 314
✓
LcbTakahashiSanLiveCodeBench / atcoder / easy: abc374_a Takahashi san 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 151 OUT241
✓
LcbThreeTeamDivisionLiveCodeBench / atcoder / hard: abc375_e 3 Team Division (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 268 OUT3 768
–
LcbTravelingTakahashiLiveCodeBench / atcoder / easy: abc375_b Traveling Takahashi Problem (Pattern B, stdin) [float output, tolerance 1e-6]0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Skipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected
 Skipped IN0 OUT0
✓
LcbUnvarnishedReportLiveCodeBench / atcoder / easy: abc374_b Unvarnished Report (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 179 OUT440
Code Generation - LiveCodeBench v5 AtCoder (set 2) 9 passed2 failed
81.8%
 IN102 080 OUT157 808
✓
LcbAvoidKnightAttackLiveCodeBench / atcoder / medium: abc377_c Avoid Knight Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 305 OUT2 722
✓
LcbAvoidRookAttackLiveCodeBench / atcoder / easy: abc377_b Avoid Rook Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 253 OUT1 385
✓
LcbCandyButtonLiveCodeBench / atcoder / easy: abc376_a Candy Button (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 221 OUT901
✓
LcbCycleMinEdgesLiveCodeBench / atcoder / medium: abc376_d Cycle (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 243 OUT7 317
✓
LcbHandsOnRingEasyLiveCodeBench / atcoder / medium: abc376_b Hands on Ring (Easy) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 287 OUT3 143
✓
LcbHandsOnRingHardLiveCodeBench / atcoder / hard: abc376_f Hands on Ring (Hard) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 292 OUT61 610
×
LcbMaxTimesSumLiveCodeBench / atcoder / hard: abc376_e Max x Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxTimesSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 67:27: Type 'StringBuilder' has no fields. Only struct values support '.Length'. 80:15: Type 'StringBuilder' has no fields. Only struct values support '.Length'. Values: run.Compiled = false
 Failed IN9 279 OUT11 683
✓
LcbPrepareAnotherBoxLiveCodeBench / atcoder / medium: abc376_c Prepare Another Box (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 276 OUT13 055
✓
LcbRoadBlockedLiveCodeBench / atcoder / hard: abc375_f Road Blocked (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 302 OUT31 554
✓
LcbRoadBlocked2LiveCodeBench / atcoder / hard: abc375_g Road Blocked 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 291 OUT12 856
×
LcbTreasureHuntingLiveCodeBench / atcoder / hard: abc376_g Treasure Hunting (Pattern B, stdin) [answer modulo 998244353]1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TreasureHunting case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:18: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 331 OUT11 582
Code Generation - LiveCodeBench v5 AtCoder (set 3) 13 passed1 failed
92.9%
 IN128 774 OUT208 313
✓
LcbAddOneEdge2LiveCodeBench / atcoder abc378_f: Add One Edge 2 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 174 OUT11 537
✓
LcbAvoidQueenAttackLiveCodeBench / atcoder abc377_f: Avoid Queen Attack (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 245 OUT50 360
✓
LcbCountSimplePathsLiveCodeBench / atcoder abc378_d: Count Simple Paths (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 193 OUT30 282
✓
LcbEditToMatchLiveCodeBench / atcoder abc377_g: Edit to Match (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 248 OUT11 833
×
LcbEverlastingLidsLiveCodeBench / atcoder abc378_g: Everlasting LIDS (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EverlastingLids case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '2'. Values: run.Compiled = false
 Failed IN9 225 OUT17 558
✓
LcbGarbageCollectionLiveCodeBench / atcoder abc378_b: Garbage Collection (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 215 OUT11 595
✓
LcbManySegments2LiveCodeBench / atcoder abc377_d: Many Segments 2 (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 205 OUT18 169
✓
LcbModSigmaProblemLiveCodeBench / atcoder abc378_e: Mod Sigma Problem (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 181 OUT18 096
✓
LcbPairingLiveCodeBench / atcoder abc378_a: Pairing (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 166 OUT1 178
✓
LcbPermuteKTimesLiveCodeBench / atcoder abc377_e: Permute K times 2 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 201 OUT14 261
✓
LcbRearrangingAbcLiveCodeBench / atcoder abc377_a: Rearranging ABC (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 162 OUT438
✓
LcbRepeatingLiveCodeBench / atcoder abc378_c: Repeating (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 183 OUT2 474
✓
LcbStrawberriesLiveCodeBench / atcoder abc379_b: Strawberries (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 186 OUT516
✓
LcbSumOfAllSubstringsLiveCodeBench / atcoder abc379_e: Sum of All Substrings (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 190 OUT20 016
Code Generation - LiveCodeBench v5 AtCoder (set 4) 11 passed3 failed
78.6%
 IN128 983 OUT83 709
✓
Lcb1122StringLiveCodeBench / atcoder abc381_a: 11/22 String (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 271 OUT1 037
×
Lcb1122SubsequenceLiveCodeBench / atcoder abc381_e: 11/22 Subsequence (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Subsequence1122 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 106:25: Type 'string' has no supported method named 'TrimEnd'. Values: run.Compiled = false
 Failed IN9 266 OUT5 743
✓
LcbAnotherShuffleWindowLiveCodeBench / atcoder abc380_g: Another Shuffle Window (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 273 OUT22 848
✓
LcbBucketToolLiveCodeBench / atcoder abc380_e: 1D Bucket Tool (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 209 OUT6 288
✓
LcbBuildings2LiveCodeBench / atcoder abc379_f: Buildings 2 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 219 OUT12 713
✓
LcbCountGrid3LiveCodeBench / atcoder abc379_g: Count Grid 3 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 201 OUT7 602
✓
LcbCyclicLiveCodeBench / atcoder abc379_a: Cyclic (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 175 OUT306
✓
LcbDigitPattern123233LiveCodeBench / atcoder abc380_a: 123233 (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 162 OUT550
×
LcbExchangeGameLiveCodeBench / atcoder abc380_f: Exchange Game (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: ExchangeGame case1: expected [Takahashi] got [Aoki]
 Failed IN9 253 OUT6 506
×
LcbHomeGardenLiveCodeBench / atcoder abc379_d: Home Garden (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: HomeGarden case0 runtime error: Substring(start: 2, length: -1) is out of range for a string of length 1. Values: run.Success = false
 Failed IN9 189 OUT8 971
✓
LcbHurdleParsingLiveCodeBench / atcoder abc380_b: Hurdle Parsing (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 173 OUT1 060
✓
LcbMoveSegmentLiveCodeBench / atcoder abc380_c: Move Segment (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 184 OUT2 628
✓
LcbSowingStonesLiveCodeBench / atcoder abc379_c: Sowing Stones (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 216 OUT2 380
✓
LcbStrangeMirroringLiveCodeBench / atcoder abc380_d: Strange Mirroring (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 192 OUT5 077
Code Generation - LiveCodeBench v5 AtCoder (set 5) 11 passed2 failed
84.6%
 IN121 097 OUT129 051
✓
Lcb1122StringLiveCodeBench / atcoder / easy: 1122 String (abc381_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 254 OUT1 640
✓
Lcb1122SubarrayLiveCodeBench / atcoder / hard: 1122 Substring (abc381_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 294 OUT4 154
✓
LcbDailyCookieLiveCodeBench / atcoder / easy: Daily Cookie (abc382_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 260 OUT793
✓
LcbDailyCookie2LiveCodeBench / atcoder / easy: Daily Cookie 2 (abc382_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 282 OUT821
×
LcbFallingBarsLiveCodeBench / atcoder / hard: Falling Bars (abc382_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: FallingBars case0: expected [2 4 3 4] got [1 4 3 2]
 Failed IN9 403 OUT10 858
✓
LcbHumidifier1LiveCodeBench / atcoder / easy: Humidifier 1 (abc383_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 253 OUT3 814
✓
LcbHumidifier2LiveCodeBench / atcoder / medium: Humidifier 2 (abc383_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 317 OUT4 054
✓
LcbHumidifier3LiveCodeBench / atcoder / medium: Humidifier 3 (abc383_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 307 OUT9 034
✓
LcbKaitenSushiLiveCodeBench / atcoder / medium: Kaiten Sushi (abc382_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 313 OUT8 633
✓
LcbKeepDistanceLiveCodeBench / atcoder / hard: Keep Distance (abc382_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 276 OUT11 153
✓
LcbMax1122SubstringLiveCodeBench / atcoder / medium: 11/22 Substring (abc381_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 379 OUT4 171
✓
LcbSumOfMaxMatchingLiveCodeBench / atcoder / hard: Sum of Max Matching (abc383_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 365 OUT36 823
×
LcbTileDistance3LiveCodeBench / atcoder / hard: Tile Distance 3 (abc382_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TileDistance3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:80: Unexpected character '≤'. 4:84: Unexpected character '≤'. 4:104: Unexpected character '≤'. 4:108: Unexpected character '≤'. 5:61: Unexpected character '≤'. 5:65: Unexpected character '≤'. 5:85: Unexpected character '≤'. 5:89: Unexpected character '≤'. 10:20: Unexpected character '∈'. 10:41: Unexpected character '∈'. 11:23: Unexpected character '∈'. 11:57: Unexpected character '∈'. 14:20: Unexpected character '∈'. 14:41: Unexpected character '∈'. 15:23: Unexpected character '∈'. 15:63: Unexpected character '∈'. 42:54: Char literals must contain exactly one character and close with '''. 56:43: Unexpected character '≠'. 57:83: Unexpected character '∈'. 57:187: Char literals must contain exactly one character and close with '''. 58:80: Unexpected character '∈'. 62:24: Unexpected character '∈'. 62:61: Unexpected character '∈'. 66:131: Unexpected character '∈'. 70:48: Unexpected character '∈'. 74:50: Unexpected character '∈'. 74:140: Unexpected character '∈'. 103:40: Unexpected character '∈'. 112:44: Unexpected character '∈'. 113:46: Unexpected character '∈'. 114:51: Unexpected character '∈'. 117:59: Unexpected character '↔'. 118:64: Unexpected character '↔'. 118:137: Unexpected character '∈'. 118:183: Unexpected character '∈'. 119:66: Unexpected character '↔'. 119:124: Unexpected character '∈'. 119:148: Unexpected character '∈'. 119:188: Unexpected character '∈'. 119:210: Unexpected character '∈'. 120:71: Unexpected character '↔'. 123:32: Unexpected character '∈'. 125:60: Unexpected character '∈'. 128:61: Unexpected character '∈'. 132:61: Unexpected character '↔'. 133:66: Unexpected character '↔'. 134:64: Unexpected character '↔'. 135:69: Unexpected character '↔'. 137:153: Char literals must contain exactly one character and close with '''. 143:142: Char literals must contain exactly one character and close with '''. 145:105: Char literals must contain exactly one character and close with '''. 147:48: Char literals must contain exactly one character and close with '''. 155:22: Char literals must contain exactly one character and close with '''. 157:50: Char literals must contain exactly one character and close with '''. 164:32: Char literals must contain exactly one character and close with '''. 168:7: Char literals must contain exactly one character and close with '''. 172:67: Char literals must contain exactly one character and close with '''. 179:15: Unexpected character '→'. 180:20: Unexpected character '→'. 181:20: Unexpected character '→'. 182:15: Unexpected character '→'. 183:15: Unexpected character '→'. 186:41: Unexpected character '∈'. 192:119: Unexpected character '↔'. 194:35: Unexpected character '→'. 194:69: Unexpected character '→'. 196:135: Unexpected character '↔'. 196:198: Char literals must contain exactly one character and close with '''. 198:181: Char literals must contain exactly one character and close with '''. 202:29: Unexpected character '↔'. 203:42: Char literals must contain exactly one character and close with '''. 205:25: Unexpected character '→'. 205:33: Unexpected character '→'. 205:41: Unexpected character '→'. 205:49: Unexpected character '→'. 205:63: Char literals must contain exactly one character and close with '''. 207:11: Unexpected character '→'. 207:19: Unexpected character '→'. 209:38: Unexpected character '→'. 209:67: Unexpected character '→'. 211:14: Unexpected character '→'. 211:22: Unexpected character '→'. 211:36: Char literals must contain exactly one character and close with '''. 213:78: Unexpected character '↔'. 215:28: Unexpected character '→'. 215:58: Unexpected character '→'. 218:23: Unexpected character '→'. 218:31: Unexpected character '→'. 218:39: Unexpected character '→'. 218:47: Unexpected character '→'. 218:61: Char literals must contain exactly one character and close with '''. 220:16: Unexpected character '→'. 220:53: Unexpected character '→'. 220:151: Unexpected character '↔'. 220:182: Unexpe ... (message truncated)
 Failed IN9 394 OUT33 103
Code Generation - LiveCodeBench v5 AtCoder (set 6) 12 passed1 failed1 skipped
92.3%
 IN120 901 OUT114 857
×
LcbAbsSumLiveCodeBench / atcoder / hard: Abs Sum (abc384_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: AbsSum case1: expected [13331322 2209746 6366712 207690 20241215] got [10010877 6683134 4468958 1708516 20241215]
 Failed IN9 314 OUT35 906
✓
LcbArcDivisionLiveCodeBench / atcoder / easy: ARC Division (abc384_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 361 OUT803
✓
LcbDoubleSum2LiveCodeBench / atcoder / hard: Double Sum 2 (abc384_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 251 OUT12 767
✓
LcbEquallyLiveCodeBench / atcoder / easy: Equally (abc385_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 184 OUT1 654
✓
LcbIlluminateBuildingsLiveCodeBench / atcoder / medium: Illuminate Buildings (abc385_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 224 OUT5 749
✓
LcbMaximizeXorLiveCodeBench / atcoder / hard: Maximize XOR (abc386_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 240 OUT9 172
✓
LcbPerfectStandingsLiveCodeBench / atcoder / medium: Perfect Standings (abc384_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 302 OUT6 286
✓
LcbRepeatedSequenceLiveCodeBench / atcoder / medium: Repeated Sequence (abc384_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 246 OUT6 999
✓
LcbReplaceExceptCharLiveCodeBench / atcoder / easy: aaaadaa (abc384_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 202 OUT1 097
✓
LcbSantaClaus1LiveCodeBench / atcoder / easy: Santa Claus 1 (abc385_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 467 OUT3 232
✓
LcbSantaClaus2LiveCodeBench / atcoder / hard: Santa Claus 2 (abc385_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 442 OUT13 266
✓
LcbSlime2LiveCodeBench / atcoder / hard: Takahashi is Slime 2 (abc384_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 376 OUT10 526
✓
LcbSnowflakeTreeLiveCodeBench / atcoder / hard: Snowflake Tree (abc385_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 292 OUT7 400
–
LcbVisibleBuildingsLiveCodeBench / atcoder / hard: Visible Buildings (abc385_f)0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected
 Skipped IN0 OUT0
Code Generation - LiveCodeBench v5 AtCoder (set 7) 7 passed4 failed1 broken1 skipped
58.3%
 IN110 985 OUT320 550
!
LcbAccumulatingManyTimesLiveCodeBench / atcoder / hard: arc184_e Accumulating Many Times (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 289 OUT62 144
✓
LcbAdjacentGcdLiveCodeBench / atcoder / hard: arc185_e Adjacent GCD (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 265 OUT49 599
✓
LcbCalculatorMinPressesLiveCodeBench / atcoder / easy: abc386_b Calculator (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 206 OUT1 312
✓
LcbDiagonalSeparationLiveCodeBench / atcoder / hard: abc386_d Diagonal Separation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 285 OUT16 763
×
LcbEraseBalls2DLiveCodeBench / atcoder / hard: arc184_d Erase Balls 2D (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EraseBalls2D case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:81: Char literals must contain exactly one character and close with '''. 19:64: Char literals must contain exactly one character and close with '''. 21:72: Unexpected character 'π'. 21:115: Unexpected character 'π'. 21:122: Unexpected character 'π'. 21:142: Unexpected character 'π'. 21:149: Unexpected character 'π'. 23:79: Unexpected character 'π'. 23:84: Unexpected character 'π'. 23:112: Unexpected character 'π'. 23:117: Unexpected character 'π'. 31:81: Char literals must contain exactly one character and close with '''. 43:23: Unexpected character 'π'. 43:87: Unexpected character 'π'. 43:92: Unexpected character 'π'. 43:175: Unexpected character 'π'. 43:180: Unexpected character 'π'. 43:450: Char literals must contain exactly one character and close with '''. 47:13: Unexpected character 'π'. 49:12: Unexpected character 'π'. 49:46: Unexpected character 'π'. 49:82: Unexpected character 'π'. 49:89: Unexpected character '→'. 49:97: Unexpected character 'π'. 49:135: Unexpected character 'π'. 49:142: Unexpected character '→'. 49:213: Unexpected character 'π'. 49:249: Unexpected character 'π'. 49:256: Unexpected character '→'. 49:291: Unexpected character 'π'. 49:298: Unexpected character '→'. 51:8: Unexpected character 'π'. 55:17: Unexpected character 'π'. 56:46: Unexpected character 'π'. 56:53: Unexpected character '→'. 57:46: Unexpected character 'π'. 57:53: Unexpected character '→'. 57:80: Unexpected character 'π'. 57:87: Unexpected character '→'. 58:46: Unexpected character 'π'. 58:53: Unexpected character '→'. 60:77: Unexpected character 'π'. 60:87: Unexpected character 'π'. 69:68: Unexpected character 'π'. 69:73: Unexpected character 'π'. 69:91: Unexpected character 'π'. 69:96: Unexpected character 'π'. 69:108: Unexpected character 'π'. 69:129: Unexpected character 'π'. 69:136: Unexpected character 'π'. 69:151: Unexpected character '✓'. 69:191: Unexpected character 'π'. 69:198: Unexpected character 'π'. 70:29: Unexpected character 'π'. 70:36: Unexpected character 'π'. 70:64: Unexpected character 'π'. 70:71: Unexpected character 'π'. 74:12: Unexpected character 'π'. 75:13: Unexpected character '→'. 75:22: Unexpected character '→'. 75:31: Unexpected character '→'. 77:46: Unexpected character 'π'. 77:53: Unexpected character '→'. 78:46: Unexpected character 'π'. 78:53: Unexpected character '→'. 78:87: Unexpected character 'π'. 78:94: Unexpected character '→'. 79:46: Unexpected character 'π'. 79:53: Unexpected character '→'. 79:87: Unexpected character 'π'. 79:94: Unexpected character '→'. 82:63: Unexpected character 'π'. 82:88: Unexpected character 'π'. 82:95: Unexpected character '→'. 83:46: Unexpected character 'π'. 83:53: Unexpected character '→'. 85:120: Char literals must contain exactly one character and close with '''. 91:5: Unexpected character 'π'. 92:5: Unexpected character 'π'. 93:5: Unexpected character 'π'. 94:5: Unexpected character 'π'. 96:12: Unexpected character 'π'. 97:46: Unexpected character 'π'. 97:53: Unexpected character '→'. 97:78: Unexpected character 'π'. 97:85: Unexpected character '→'. 100:1: Unexpected character 'π'. 101:6: Unexpected character '→'. 101:15: Unexpected character '→'. 101:24: Unexpected character '→'. 103:46: Unexpected character 'π'. 103:53: Unexpected character '→'. 104:46: Unexpected character 'π'. 104:53: Unexpected character '→'. 104:87: Unexpected character 'π'. 104:94: Unexpected character '→'. 105:46: Unexpected character 'π'. 105:53: Unexpected character '→'. 105:78: Unexpected character 'π'. 105:85: Unexpected character '→'. 108:46: Too many lexical errors; further errors are not reported. Values: run.Compiled = false
 Failed IN9 251 OUT45 436
✓
LcbFullHouse2LiveCodeBench / atcoder / easy: abc386_a Full House 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 200 OUT1 580
×
LcbMountainValleyFoldsLiveCodeBench / atcoder / hard: arc184_c Mountain and Valley Folds (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MountainValleyFolds case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:41: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:43: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:68: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:69: Unexpected character '\'. 3:77: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:180: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:197: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:203: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 3:215: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 5:35: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 5:43: Unexpected character '\'. 5:60: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 6:3: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 6:22: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 6:30: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 6:34: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 6:49: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 6:50: Unexpected character '\'. 6:64: Unexpected character '\'. 6:76: Unexpected character '\'. 6:78: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 7:3: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 7:24: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 7:32: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 7:36: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 7:51: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 7:52: Unexpected character '\'. 7:70: Unexpected character '\'. 7:81: Unexpected character '\'. 7:83: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 10:3: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 10:15: Unexpected character '\'. 10:23: Char literals must contain exactly one character and close with '''. 10:33: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 11:3: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 11:15: Unexpected character '\'. 11:23: Char literals must contain exactly one character and close with '''. 11:33: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 13:23: Unexpected character '→'. 13:24: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 13:30: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 13:42: Unexpected character '→'. 13:43: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? 13:50: Unexpected character '$'. Did you mean a string literal like "...", @"..." or $"..."? Values: run.Compiled = false
 Failed IN9 309 OUT16 616
✓
LcbOperate1LiveCodeBench / atcoder / medium: abc386_c Operate 1 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 209 OUT21 053
✓
LcbOperateKLiveCodeBench / atcoder / hard: abc386_f Operate K (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 213 OUT32 199
✓
LcbPlusOneAndLiveCodeBench / atcoder / hard: arc185_b +1 and (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 230 OUT8 456
×
LcbRandomWalkOnTreeLiveCodeBench / atcoder / hard: arc185_d Random Walk on Tree (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RandomWalkOnTree case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:11: Unexpected character '\'. Values: run.Compiled = false
 Failed IN9 280 OUT43 275
–
LcbSumOfThreeIntegersLiveCodeBench / atcoder / hard: arc185_c Sum of Three Integers (Pattern B, stdin) NOTE: multiple valid triples may exist; exact-match oracle may reject a different valid answer.0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
×
LcbUndercluedLiveCodeBench / atcoder / hard: arc186_a Underclued (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: Underclued case1 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 248 OUT22 117
Code Generation - LiveCodeBench v5 AtCoder (set 8) 3 passed7 failed2 broken1 skipped
25.0%
 IN111 120 OUT372 802
×
LcbAbcSymmetryLiveCodeBench / atcoder / hard: arc188_a ABC Symmetry (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AbcSymmetry case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 118:16: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported. Values: run.Compiled = false
 Failed IN9 249 OUT53 654
×
LcbBallAndBoxLiveCodeBench / atcoder / hard: arc186_c Ball and Box (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BallAndBox case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 56:25: Type 'string' has no supported method named 'TrimEnd'. Values: run.Compiled = false
 Failed IN9 286 OUT8 673
×
LcbBallsAndBoxesLiveCodeBench / atcoder / hard: arc189_c Balls and Boxes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BallsAndBoxes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 31:5: Expected ';' after the statement, found '{'. Values: run.Compiled = false
 Failed IN9 251 OUT16 219
–
LcbHonestLiarConfusedLiveCodeBench / atcoder / hard: arc188_c Honest or Liar or Confused (Pattern B, stdin) NOTE: multiple valid confused sets may exist; exact-match oracle may reject a different valid answer.0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbMinimizeSumLiveCodeBench / atcoder / hard: arc189_b Minimize Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 235 OUT8 584
×
LcbMirrorAndOrderLiveCodeBench / atcoder / hard: arc188_d Mirror and Order (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MirrorAndOrder case1 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 320 OUT27 972
!
LcbMissingSubsequenceLiveCodeBench / atcoder / hard: arc186_e Missing Subsequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 243 OUT62 144
×
LcbPolishManiaLiveCodeBench / atcoder / hard: arc186_d Polish Mania (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PolishMania case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:176: Unexpected character '≤'. 4:95: Unexpected character '≥'. 5:116: Unexpected character '≥'. 7:32: Unexpected character '·'. Values: run.Compiled = false
 Failed IN9 264 OUT22 302
×
LcbReversi2LiveCodeBench / atcoder / medium: arc189_a Reversi 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Reversi2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected a name, found '='. Values: run.Compiled = false
 Failed IN9 277 OUT48 489
✓
LcbSumOfCCLiveCodeBench / atcoder / hard: arc187_b Sum of CC (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 282 OUT30 575
×
LcbSymmetricPaintingLiveCodeBench / atcoder / hard: arc188_b Symmetric Painting (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SymmetricPainting case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:230: Char literals must contain exactly one character and close with '''. 3:74: Unexpected character 'σ'. 3:80: Unexpected character '→'. 3:91: Unexpected character 'σ'. 3:97: Unexpected character '→'. 5:8: Unexpected character 'σ'. 5:14: Unexpected character 'σ'. 5:27: Unexpected character '≡'. 5:42: Unexpected character '≥'. 5:97: Char literals must contain exactly one character and close with '''. 6:9: Unexpected character '≡'. 9:28: Unexpected character '≡'. 9:44: Unexpected character '≡'. Values: run.Compiled = false
 Failed IN9 239 OUT23 760
✓
LcbTakahashiIsSlimeLiveCodeBench / atcoder / hard: arc189_d Takahashi is Slime (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 231 OUT8 286
!
LcbTypicalPermutationDescriptorLiveCodeBench / atcoder / hard: arc186_b Typical Permutation Descriptor (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 243 OUT62 144
Code Generation - LiveCodeBench v5 LeetCode (set 1) 10 passed1 failed
90.9%
 IN101 036 OUT69 649
✓
LcbCountWinningSequencesLiveCodeBench / leetcode / hard: count-the-number-of-winning-sequences1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 253 OUT6 682
×
LcbDfsPalindromesLiveCodeBench / leetcode / hard: check-if-dfs-strings-are-palindromes1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: dfsPalindromes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 257 OUT4 380
✓
LcbFindXSumLiveCodeBench / leetcode / easy: find-x-sum-of-all-k-long-subarrays-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 229 OUT23 840
✓
LcbIsBalancedStringLiveCodeBench / leetcode / easy: check-balanced-string1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 119 OUT322
✓
LcbLengthAfterTransformationsLiveCodeBench / leetcode / medium: total-characters-in-string-after-transformations-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 171 OUT4 984
✓
LcbMaxFactorScoreLiveCodeBench / leetcode / medium: find-the-maximum-factor-score-of-array1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 164 OUT3 152
✓
LcbMinDivisionOperationsLiveCodeBench / leetcode / medium: minimum-division-operations-to-make-array-non-decreasing1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 153 OUT4 192
✓
LcbMinTimeToReachRoomLiveCodeBench / leetcode / medium: find-minimum-time-to-reach-last-room-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 223 OUT6 193
✓
LcbNumberOfSubstringsKFreqLiveCodeBench / leetcode / medium: count-substrings-with-k-frequency-characters-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 109 OUT2 103
✓
LcbStringSequenceLiveCodeBench / leetcode / medium: find-the-sequence-of-strings-appeared-on-the-screen1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 172 OUT2 210
✓
LcbSubsequencePairCountGcdLiveCodeBench / leetcode / hard: find-the-number-of-subsequences-with-equal-gcd1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 186 OUT11 591
Code Generation - LiveCodeBench v5 LeetCode (set 2) 8 passed1 failed1 broken
80.0%
 IN92 092 OUT220 104
✓
LcbCountBalancedPermutationsLiveCodeBench / leetcode / hard: count-number-of-balanced-permutations1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 156 OUT42 551
!
LcbCountKReducibleNumbersLiveCodeBench / leetcode / hard: count-k-reducible-numbers-less-than-n1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 183 OUT62 144
✓
LcbCountValidSelectionsLiveCodeBench / leetcode / easy: make-array-elements-equal-to-zero1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 239 OUT19 337
✓
LcbHasIncreasingSubarraysLiveCodeBench / leetcode / easy: adjacent-increasing-subarrays-detection-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 219 OUT3 553
✓
LcbIsZeroArrayLiveCodeBench / leetcode / medium: zero-array-transformation-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 211 OUT1 240
✓
LcbMaximizeSumOfWeightsLiveCodeBench / leetcode / hard: maximize-sum-of-weights-after-edge-removals1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 266 OUT9 951
×
LcbMinAdjacentDifferenceLiveCodeBench / leetcode / hard: minimize-the-maximum-adjacent-element-difference1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minDifference case2: expected 1 got 4
 Failed IN9 169 OUT52 754
✓
LcbMinArraySumLiveCodeBench / leetcode / medium: minimum-array-sum1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 280 OUT7 665
✓
LcbMinimumPositiveSumSubarrayLiveCodeBench / leetcode / easy: minimum-positive-sum-subarray1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 213 OUT15 171
✓
LcbSumOfGoodSubsequencesLiveCodeBench / leetcode / hard: sum-of-good-subsequences1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 156 OUT5 738
Code Generation - LiveCodeBench v5 LeetCode (set 3) 8 passed2 failed1 broken
72.7%
 IN101 311 OUT164 428
×
LcbMaxCollectedFruitsLiveCodeBench / leetcode / hard: find-the-maximum-number-of-fruits-collected (id 3648)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxCollectedFruits case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:28: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 356 OUT15 480
✓
LcbMaxFrequencyOpsLiveCodeBench / leetcode / medium: maximum-frequency-of-an-element-after-performing-operations-i (id 3622)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 175 OUT15 376
!
LcbMaxRemovalsSourceLiveCodeBench / leetcode / medium: find-maximum-removals-from-source-string (id 3487)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 273 OUT62 144
✓
LcbMaxScoreTouristLiveCodeBench / leetcode / medium: maximum-points-tourist-can-earn (id 3587)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 265 OUT2 467
✓
LcbMinBitwiseArrayLiveCodeBench / leetcode / easy: construct-the-minimum-bitwise-array-i (id 3605)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 187 OUT6 450
✓
LcbNumberOfWaysEventLiveCodeBench / leetcode / hard: find-the-number-of-possible-ways-for-an-event (id 3604)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 214 OUT45 004
✓
LcbPossibleStringCountLiveCodeBench / leetcode / easy: find-the-original-typed-string-i (id 3617)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 133 OUT2 004
✓
LcbShiftDistanceLiveCodeBench / leetcode / medium: shift-distance-between-two-strings (id 3591)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 201 OUT5 304
✓
LcbSmallestDivisibleDigitProductLiveCodeBench / leetcode / easy: smallest-divisible-digit-product-i (id 3626)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 123 OUT1 498
✓
LcbStoneRemovalGameLiveCodeBench / leetcode / easy: stone-removal-game (id 3625)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 132 OUT2 846
×
LcbZeroArrayTransformIIILiveCodeBench / leetcode / medium: zero-array-transformation-iii (id 3647)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxRemoval case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:5: Function 'maxRemoval' is declared more than once. Overloads are not supported. Values: run.Compiled = false
 Failed IN9 252 OUT5 855
Code Generation - LiveCodeBench v5 LeetCode (set 4) 9 passed1 broken
90.0%
 IN91 849 OUT158 314
✓
LcbButtonLongestTimeLiveCodeBench / leetcode / easy: button-with-longest-push-time (id 3632)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 202 OUT797
✓
LcbCountComponentsLcmLiveCodeBench / leetcode / hard: count-connected-components-in-lcm-graph (id 3680)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 171 OUT44 501
!
LcbDigitOpsEqualLiveCodeBench / leetcode / medium: digit-operations-to-make-two-integers-equal (id 3655)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 197 OUT62 144
✓
LcbLargestOutlierLiveCodeBench / leetcode / medium: identify-the-largest-outlier-in-an-array (id 3594)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 196 OUT2 339
✓
LcbMaxRectangleAreaLiveCodeBench / leetcode / medium: maximum-area-rectangle-with-point-constraints-i (id 3681)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 210 OUT34 789
✓
LcbMaxSubarraySumDivKLiveCodeBench / leetcode / medium: maximum-subarray-sum-with-length-divisible-by-k (id 3653)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 146 OUT2 260
✓
LcbMinOpsEqualKLiveCodeBench / leetcode / easy: minimum-operations-to-make-array-values-equal-to-k (id 3621)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 185 OUT2 693
✓
LcbMinTimeBreakLocksLiveCodeBench / leetcode / medium: minimum-time-to-break-locks-i (id 3649)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 180 OUT5 955
✓
LcbSmallestAllSetBitsLiveCodeBench / leetcode / easy: smallest-number-with-all-set-bits (id 3676)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 119 OUT2 104
✓
LcbTransformedArrayLiveCodeBench / leetcode / easy: transformed-array (id 3651)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 243 OUT732
Code Generation - LiveCodeBench v5 LeetCode (set 5) 10 passed
100.0%
 IN91 745 OUT80 566
✓
LcbBeautifulSplitsLiveCodeBench / leetcode / medium: count beautiful splits in an array (LCB id 3686)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 144 OUT5 238
✓
LcbCountGoodArraysLiveCodeBench / leetcode / hard: count arrays with k matching adjacent elements (LCB id 3682)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 181 OUT2 618
✓
LcbCountLen3SubarraysLiveCodeBench / leetcode / easy: count length-3 subarrays with a condition (LCB id 3685)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 113 OUT601
✓
LcbCountSpecialSubsequencesLiveCodeBench / leetcode / medium: count special subsequences (LCB id 3699)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 195 OUT5 782
✓
LcbLargestBoxStringLiveCodeBench / leetcode / medium: lexicographically largest string from the box I (LCB id 3683)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 145 OUT4 202
✓
LcbMakeStringGoodLiveCodeBench / leetcode / hard: minimum operations to make character frequencies equal (LCB id 3638)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 149 OUT9 664
✓
LcbMaxCurrencyAmountLiveCodeBench / leetcode / medium: maximize amount after two days of conversions (LCB id 3613)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 325 OUT4 443
✓
LcbMaxDistinctElementsLiveCodeBench / leetcode / medium: maximum number of distinct elements after operations (LCB id 3620)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 152 OUT11 403
✓
LcbMinIdenticalSubstringLiveCodeBench / leetcode / hard: smallest substring with identical characters I (LCB id 3690)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 174 OUT30 318
✓
LcbMinOpsDistinctLiveCodeBench / leetcode / easy: minimum operations to make elements distinct (LCB id 3656)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 167 OUT6 297
Code Generation - LiveCodeBench v5 LeetCode (set 6) 9 passed1 broken
90.0%
 IN92 040 OUT163 487
✓
LcbCheckValidCutsLiveCodeBench / leetcode / medium: check if grid can be cut into sections (LCB id 3657)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 263 OUT28 241
✓
LcbCountXorPathsLiveCodeBench / leetcode / medium: count paths with the given xor value (LCB id 3659)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 248 OUT3 510
✓
LcbLongestDecreasingDiffLiveCodeBench / leetcode / medium: longest subsequence with decreasing adjacent difference (LCB id 3716)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 204 OUT6 456
✓
LcbMaxCoinsKBagsLiveCodeBench / leetcode / medium: maximum coins from k consecutive bags (LCB id 3715)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 193 OUT4 422
!
LcbMaxIntervalScoreLiveCodeBench / leetcode / hard: maximum score of non-overlapping intervals (LCB id 3562)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 257 OUT62 144
✓
LcbMaxProductEquivalentLiveCodeBench / leetcode / easy: maximum subarray with equal products (LCB id 3702)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 181 OUT6 832
✓
LcbMaxSubarrayAfterRemovalLiveCodeBench / leetcode / hard: maximize subarray sum after removing all occurrences of one element (LCB id 3688)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 152 OUT22 657
✓
LcbMiddleModeSubsequencesLiveCodeBench / leetcode / hard: subsequences with a unique middle mode I (LCB id 3700)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 209 OUT16 730
✓
LcbMirrorScoreLiveCodeBench / leetcode / medium: find mirror score of a string (LCB id 3634)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 182 OUT3 969
✓
LcbSubstringPatternLiveCodeBench / leetcode / easy: substring matching pattern (LCB id 3684)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 151 OUT8 526
Code Generation - LiveCodeBench v6 AtCoder (set 1) 11 passed4 failed1 broken
68.8%
 IN147 209 OUT212 469
✓
LcbComingOfAgeLiveCodeBench / atcoder abc388_d / medium: Coming of Age Celebration1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 206 OUT5 223
!
LcbCountArraysLiveCodeBench / atcoder abc387_f / hard: Count Arrays1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 228 OUT62 144
×
LcbDangerousSugorokuLiveCodeBench / atcoder abc388_f / hard: Dangerous Sugoroku1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DangerousSugoroku case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 39:24: Type 'long' has no supported method named 'ToString'. 39:56: Type 'long' has no supported method named 'ToString'. Values: run.Compiled = false
 Failed IN9 245 OUT19 776
✓
LcbDigitProductLiveCodeBench / atcoder abc389_a / easy: 9x91 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 146 OUT506
✓
LcbFactorialInverseLiveCodeBench / atcoder abc389_b / easy: tcaF1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 152 OUT1 809
✓
LcbHeavySnakeLiveCodeBench / atcoder abc388_b / easy: Heavy Snake1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 191 OUT1 146
✓
LcbKagamimochi2LiveCodeBench / atcoder abc388_g / hard: Simultaneous Kagamimochi 21 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 255 OUT46 550
✓
LcbNotXSumLiveCodeBench / atcoder abc387_b / easy: 9x9 Sum1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 207 OUT850
×
LcbOddEvenGraphLiveCodeBench / atcoder abc389_g / hard: Odd Even Graph1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OddEvenGraph case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:16: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
 Failed IN9 242 OUT23 726
✓
LcbQuestionUpcLiveCodeBench / atcoder abc388_a / easy: ?UPC1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 152 OUT148
✓
LcbRatedRangeLiveCodeBench / atcoder abc389_f / hard: Rated Range1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 201 OUT1 883
×
LcbSimultaneousKagamimochiLiveCodeBench / atcoder abc388_e / hard: Simultaneous Kagamimochi1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SimultaneousKagamimochi case0: expected [3] got [2]
 Failed IN9 194 OUT29 987
✓
LcbSnakeNumbersLiveCodeBench / atcoder abc387_c / medium: Snake Numbers1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 201 OUT11 422
✓
LcbSquareOfSumLiveCodeBench / atcoder abc387_a / easy: Happy New Year 20251 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 133 OUT522
✓
LcbSquaresInCircleLiveCodeBench / atcoder abc389_d / medium: Squares in Circle1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 232 OUT3 131
×
LcbVariousKagamimochiLiveCodeBench / atcoder abc388_c / medium: Various Kagamimochi1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: VariousKagamimochi case0 runtime error: List index 5 is out of range. The list has 5 element(s). Values: run.Success = false
 Failed IN9 224 OUT3 646
Code Generation - LiveCodeBench v6 AtCoder (set 2) 13 passed2 failed
86.7%
 IN138 184 OUT193 623
×
LcbDoubleSum3LiveCodeBench / atcoder abc390_f / hard: Double Sum 31 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DoubleSum3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:49: List constructor expects a List or HashSet to copy, but got 'int'. 21:41: List constructor expects a List or HashSet to copy, but got 'int'. Values: run.Compiled = false
 Failed IN9 231 OUT8 947
✓
LcbGeometricSequenceLiveCodeBench / atcoder abc390_b / easy: Geometric Sequence1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 162 OUT4 811
✓
LcbGravityLiveCodeBench / atcoder abc391_d / medium: Gravity1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 293 OUT19 007
✓
LcbKthLargestLiveCodeBench / atcoder abc391_f / hard: K1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 234 OUT50 547
✓
LcbMajorityVoteLiveCodeBench / atcoder abc391_e / hard: Hierarchical Majority Vote1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 220 OUT7 471
✓
LcbManyLcsLiveCodeBench / atcoder abc391_g / hard: Many LCS1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 211 OUT19 307
✓
LcbOneSwapSortLiveCodeBench / atcoder abc390_a / easy: 124351 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 195 OUT1 712
✓
LcbOppositeDirectionLiveCodeBench / atcoder abc391_a / easy: Lucky Direction1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 172 OUT127
✓
LcbPaintRectangleLiveCodeBench / atcoder abc390_c / medium: Paint to make a rectangle1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 218 OUT4 122
×
LcbPermutationConcatLiveCodeBench / atcoder abc390_g / hard: Permutation Concatenation1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: PermutationConcat case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 243 OUT24 347
✓
LcbSeekGridLiveCodeBench / atcoder abc391_b / easy: Seek Grid1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 210 OUT30 638
✓
LcbShuffledEquationLiveCodeBench / atcoder abc392_a / easy: Shuffled Equation1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 187 OUT1 386
✓
LcbSquarePriceLiveCodeBench / atcoder abc389_e / hard: Square Price1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 194 OUT12 682
✓
LcbStoneXorLiveCodeBench / atcoder abc390_d / medium: Stone XOR1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 206 OUT3 789
✓
LcbVitaminBalanceLiveCodeBench / atcoder abc390_e / hard: Vitamin Balance1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 208 OUT4 730
Code Generation - LiveCodeBench v6 AtCoder (set 3) 9 passed1 failed
90.0%
 IN92 267 OUT149 299
✓
LcbABCIntervalsLiveCodeBench / atcoder / abc393_b A..B..C (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 190 OUT45 488
✓
LcbBibStaringLiveCodeBench / atcoder / abc392_c Bib (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 233 OUT6 715
×
LcbDoublesProbabilityLiveCodeBench / atcoder / abc392_d Doubles (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: DoublesProbability case0: expected [0.333333333333333] got [0.6666666666666666]
 Failed IN9 243 OUT1 655
✓
LcbFineTripletsLiveCodeBench / atcoder / abc392_g Fine Triplets (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 213 OUT35 176
✓
LcbGcdOfSubsetLiveCodeBench / atcoder / abc393_e GCD of Subset (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 212 OUT34 029
✓
LcbInsertSequenceLiveCodeBench / atcoder / abc392_f Insert (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 228 OUT1 208
✓
LcbPoisonousOysterLiveCodeBench / atcoder / abc393_a Poisonous Oyster (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 248 OUT438
✓
LcbPrefixLisQueryLiveCodeBench / atcoder / abc393_f Prefix LIS Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 258 OUT21 426
✓
LcbSwapToGatherLiveCodeBench / atcoder / abc393_d Swap to Gather (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 211 OUT1 525
✓
LcbWhoIsMissingLiveCodeBench / atcoder / abc392_b Who is Missing? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 231 OUT1 639
Code Generation - LiveCodeBench v6 AtCoder (set 4) 7 passed3 failed
70.0%
 IN92 337 OUT105 944
✓
LcbAlkaneSubtreeLiveCodeBench / atcoder / abc394_f Alkane (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 246 OUT18 701
✓
LcbCatConcatLiveCodeBench / atcoder / abc394_b cat (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 173 OUT937
✓
LcbColorfulBracketsLiveCodeBench / atcoder / abc394_d Colorful Bracket Sequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 186 OUT3 039
✓
LcbDebugWaAcLiveCodeBench / atcoder / abc394_c Debug (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 157 OUT7 940
×
LcbDenseBuildingsLiveCodeBench / atcoder / abc394_g Dense Buildings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DenseBuildings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 142:40: List constructor expects a List or HashSet to copy, but got 'int'. 154:31: List constructor expects a List or HashSet to copy, but got 'int'. 155:30: List constructor expects a List or HashSet to copy, but got 'int'. 156:32: List constructor expects a List or HashSet to copy, but got 'int'. 157:32: List constructor expects a List or HashSet to copy, but got 'int'. 158:33: List constructor expects a List or HashSet to copy, but got 'int'. 170:28: List constructor expects a List or HashSet to copy, but got 'int'. 171:29: List constructor expects a List or HashSet to copy, but got 'int'. 172:27: List constructor expects a List or HashSet to copy, but got 'int'. 173:28: List constructor expects a List or HashSet to copy, but got 'int'. 174:29: List constructor expects a List or HashSet to copy, but got 'int'. 175:29: List constructor expects a List or HashSet to copy, but got 'int'. Values: run.Compiled = false
 Failed IN9 378 OUT46 200
✓
LcbFilterTwosLiveCodeBench / atcoder / abc394_a 22222 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 149 OUT168
✓
LcbMakeTargetLiveCodeBench / atcoder / abc395_b Make Target (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 261 OUT2 096
×
LcbPalindromicShortestPathLiveCodeBench / atcoder / abc394_e Palindromic Shortest Path (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PalindromicShortestPath case0: expected [0 1 2 4 -1 0 1 -1 3 -1 0 1 1 -1 -1 0] got [0 1 5 3 3 0 1 -1 2 3 0 1 1 -1 3 0]
 Failed IN9 312 OUT7 502
✓
LcbShortestDuplicateSubarrayLiveCodeBench / atcoder / abc395_c Shortest Duplicate Subarray (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 214 OUT4 232
×
LcbSmoothOcclusionLiveCodeBench / atcoder / abc395_f Smooth Occlusion (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SmoothOcclusion case0 runtime error: List index 6 is out of range. The list has 6 element(s). Values: run.Success = false
 Failed IN9 261 OUT15 129
Code Generation - LiveCodeBench v6 AtCoder (set 5) 13 passed2 failed1 skipped
86.7%
 IN138 145 OUT179 226
✓
LcbBuyBallsLiveCodeBench / atcoder / medium: Buy Balls (abc396_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 229 OUT2 925
✓
LcbCardPileLiveCodeBench / atcoder / easy: Card Pile (abc396_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 208 OUT1 529
–
LcbCubesLiveCodeBench / atcoder / hard: Cubes (abc397_d)0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbFlipEdgeLiveCodeBench / atcoder / hard: Flip Edge (abc395_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 222 OUT38 647
✓
LcbFlipRowOrColLiveCodeBench / atcoder / hard: Flip Row or Col (abc396_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 218 OUT2 516
×
LcbMaximizeDistanceLiveCodeBench / atcoder / hard: Maximize Distance (abc397_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaximizeDistance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'List<int> gU', found ';'. Global variables must have an initializer. Values: run.Compiled = false
 Failed IN9 202 OUT20 678
✓
LcbMinRestrictedSumLiveCodeBench / atcoder / hard: Min of Restricted Sum (abc396_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 243 OUT4 075
✓
LcbMinXorPathLiveCodeBench / atcoder / medium: Minimum XOR Path (abc396_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 225 OUT4 376
✓
LcbPathDecompositionLiveCodeBench / atcoder / hard: Path Decomposition of a Tree (abc397_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 195 OUT43 041
✓
LcbRotatedInversionsLiveCodeBench / atcoder / hard: Rotated Inversions (abc396_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 231 OUT13 069
✓
LcbStrictlyIncreasingLiveCodeBench / atcoder / easy: Strictly Increasing? (abc395_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 190 OUT1 222
✓
LcbThermometerLiveCodeBench / atcoder / easy: Thermometer (abc397_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 185 OUT409
✓
LcbTicketGateLogLiveCodeBench / atcoder / medium: Ticket Gate Log (abc397_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 188 OUT2 777
✓
LcbTripleFourLiveCodeBench / atcoder / easy: Triple Four (abc396_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 193 OUT1 584
✓
LcbVarietySplitEasyLiveCodeBench / atcoder / medium: Variety Split Easy (abc397_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 201 OUT4 141
×
LcbVarietySplitHardLiveCodeBench / atcoder / hard: Variety Split Hard (abc397_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: VarietySplitHard case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 204:17: The if condition must be 'bool', but it has type 'void'. 223:17: The if condition must be 'bool', but it has type 'void'. Values: run.Compiled = false
 Failed IN9 215 OUT38 237
Code Generation - LiveCodeBench v6 AtCoder (set 6) 15 passed
100.0%
 IN138 168 OUT201 669
✓
LcbAbc400PartyLiveCodeBench / atcoder / easy: ABC400 Party (abc400_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 178 OUT265
✓
LcbAbcbaLiveCodeBench / atcoder / hard: ABCBA (abc398_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 143 OUT8 849
✓
LcbBonfireLiveCodeBench / atcoder / hard: Bonfire (abc398_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 327 OUT7 217
✓
LcbDoorsInCenterLiveCodeBench / atcoder / easy: Doors in the Center (abc398_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 158 OUT1 337
✓
LcbFullHouse3LiveCodeBench / atcoder / medium: Full House 3 (abc398_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 200 OUT2 324
✓
LcbGoodIntegersLiveCodeBench / atcoder / medium: 2^a b^2 good integers (abc400_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 198 OUT4 274
✓
LcbHammingDistanceLiveCodeBench / atcoder / easy: Hamming Distance (abc399_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 182 OUT111
✓
LcbMakeItForestLiveCodeBench / atcoder / medium: Make it Forest (abc399_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 180 OUT2 322
✓
LcbNotOnlyTreeGameLiveCodeBench / atcoder / hard: Not Only Tree Game (abc398_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 241 OUT43 276
✓
LcbRangePowerSumLiveCodeBench / atcoder / hard: Range Power Sum (abc399_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 215 OUT60 876
✓
LcbRankingWithTiesLiveCodeBench / atcoder / easy: Ranking with Ties (abc399_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 209 OUT4 926
✓
LcbReplaceLiveCodeBench / atcoder / hard: Replace (abc399_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 211 OUT9 986
✓
LcbSwitchSeatsLiveCodeBench / atcoder / medium: Switch Seats (abc399_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 256 OUT18 732
✓
LcbUniquenessLiveCodeBench / atcoder / medium: Uniqueness (abc398_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 184 OUT1 585
✓
LcbWallBreakerLiveCodeBench / atcoder / medium: Takahashi the Wall Breaker (abc400_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 286 OUT35 589
Code Generation - LiveCodeBench v6 AtCoder (set 7) 8 passed3 failed2 broken2 skipped
61.5%
 IN121 079 OUT428 928
–
LcbAPowNLiveCodeBench / atcoder / hard: A^n (arc191_c) NOTE: special judge - any valid (A,M) pair is accepted; exact-match may unfairly fail a correct model output.0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbArcArcLiveCodeBench / atcoder / medium: ARC Arc (arc192_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 355 OUT18 080
!
LcbBasicGridUpdatesLiveCodeBench / atcoder / hard: Basic Grid Problem with Updates (arc190_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 418 OUT62 144
✓
LcbBrokenWheelLiveCodeBench / atcoder / hard: Broken Wheel (arc193_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 335 OUT57 129
✓
LcbComplementIntervalGraphLiveCodeBench / atcoder / hard: Complement Interval Graph (arc193_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 382 OUT40 697
✓
LcbFennecVsSnuke2LiveCodeBench / atcoder / hard: Fennec VS. Snuke 2 (arc192_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 275 OUT14 590
×
LcbFractionLineLiveCodeBench / atcoder / hard: Fraction Line (arc192_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FractionLine case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:11: Expected a variable name, found '['. Values: run.Compiled = false
 Failed IN9 318 OUT15 279
–
LcbInsideOrOutsideLiveCodeBench / atcoder / hard: Inside or Outside (arc190_a) NOTE: special judge - multiple minimum-cost operation sequences are accepted; exact-match may unfairly fail a correct model output.0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
✓
LcbMatrixPowSumLiveCodeBench / atcoder / hard: Matrix Pow Sum (arc190_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 303 OUT34 136
!
LcbMovingPiecesOnGraphLiveCodeBench / atcoder / hard: Moving Pieces on Graph (arc191_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 312 OUT62 144
×
LcbPatisserieAbc3LiveCodeBench / atcoder / hard: Patisserie ABC 3 (abc400_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PatisserieAbc3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 85:41: Expected '(' after the List type. Lists are created with 'new List<T>()' or 'new List<T>(items)', found '{'. Values: run.Compiled = false
 Failed IN9 332 OUT25 283
✓
LcbReplaceDigitsLiveCodeBench / atcoder / medium: Replace Digits (arc191_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 239 OUT35 566
×
LcbRingoFavoriteNumbers3LiveCodeBench / atcoder / hard: Ringo's Favorite Numbers 3 (abc400_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: RingoFavoriteNumbers3 case0 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
 Failed IN9 281 OUT6 275
✓
LcbSnukeKyotoTripLiveCodeBench / atcoder / hard: Snuke's Kyoto Trip (arc192_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 298 OUT53 910
✓
LcbSumOfGeometricSeriesLiveCodeBench / atcoder / easy: Sum of Geometric Series (abc400_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
 Passed IN9 231 OUT3 695
Code Generation - LiveCodeBench v6 AtCoder (set 8) 7 passed4 failed3 broken1 skipped
50.0%
 IN130 396 OUT387 720
✓
LcbAdjacentDeleteLiveCodeBench / atcoder / hard: Adjacent Delete (arc196_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 203 OUT34 591
×
LcbCostToFlipLiveCodeBench / atcoder / hard: Cost to Flip (arc194_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: CostToFlip case2: expected [2867] got [3300]
 Failed IN9 276 OUT3 614
–
LcbHamiltonianPiecesLiveCodeBench / atcoder / hard: Hamiltonian Pieces (arc195_c) NOTE: special judge - any valid placement is accepted; exact-match may unfairly fail a correct model output.0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
 Skipped IN0 OUT0
!
LcbMagnetsLiveCodeBench / atcoder / hard: Magnets (arc193_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 353 OUT62 144
✓
LcbMinimumCostSortLiveCodeBench / atcoder / hard: Minimum Cost Sort (arc194_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 216 OUT18 036
✓
LcbOperationsOnStackLiveCodeBench / atcoder / medium: Operations on a Stack (arc194_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 235 OUT17 962
×
LcbRandomTreeDistanceLiveCodeBench / atcoder / hard: Random Tree Distance (arc195_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RandomTreeDistance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:35: Type 'List<string>' has no fields. Only struct values support '.Length'. Values: run.Compiled = false
 Failed IN9 367 OUT18 459
✓
LcbReverseBracketsLiveCodeBench / atcoder / hard: Reverse Brackets (arc194_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 278 OUT21 308
×
LcbRoadwayLiveCodeBench / atcoder / hard: Roadway (arc196_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Roadway case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:84: Char literals must contain exactly one character and close with '''. 11:31: Char literals must contain exactly one character and close with '''. 21:175: Char literals must contain exactly one character and close with '''. 21:276: Char literals must contain exactly one character and close with '''. 32:26: Unexpected character '✓'. 50:37: Unexpected character '≤'. 50:41: Unexpected character '≤'. 54:37: Unexpected character '≤'. 54:41: Unexpected character '≤'. 70:52: Char literals must contain exactly one character and close with '''. 74:66: Char literals must contain exactly one character and close with '''. 76:75: Char literals must contain exactly one character and close with '''. 81:42: Char literals must contain exactly one character and close with '''. 90:23: Unexpected character '∀'. 90:26: Unexpected character '∈'. 90:49: Unexpected character '∀'. 90:52: Unexpected character '∈'. 94:173: Char literals must contain exactly one character and close with '''. 98:151: Char literals must contain exactly one character and close with '''. 104:166: Char literals must contain exactly one character and close with '''. 106:13: Char literals must contain exactly one character and close with '''. 110:47: Unexpected character '≥'. 112:137: Unexpected character '≥'. 114:200: Unexpected character '≥'. 121:13: Unexpected character '→'. 121:24: Unexpected character '→'. 121:43: Unexpected character '→'. 123:95: Char literals must contain exactly one character and close with '''. 136:37: Unexpected character '≠'. 149:30: Unexpected character '→'. 150:29: Unexpected character '→'. 157:44: Char literals must contain exactly one character and close with '''. 179:44: Char literals must contain exactly one character and close with '''. 187:80: Char literals must contain exactly one character and close with '''. 189:36: Char literals must contain exactly one character and close with '''. 195:11: Char literals must contain exactly one character and close with '''. 213:24: Unexpected character '≤'. 213:28: Unexpected character '≤'. 214:31: Unexpected character '→'. 214:76: Unexpected character '→'. 217:24: Unexpected character '≤'. 217:28: Unexpected character '≤'. 218:31: Unexpected character '→'. 218:76: Unexpected character '→'. 228:38: Unexpected character '≥'. 245:86: Char literals must contain exactly one character and close with '''. 247:56: Char literals must contain exactly one character and close with '''. 249:70: Char literals must contain exactly one character and close with '''. 254:105: Char literals must contain exactly one character and close with '''. 254:148: Char literals must contain exactly one character and close with '''. 259:51: Unexpected character '→'. 260:50: Unexpected character '→'. 321:60: Char literals must contain exactly one character and close with '''. 323:174: Char literals must contain exactly one character and close with '''. 348:18: Char literals must contain exactly one character and close with '''. 360:140: Char literals must contain exactly one character and close with '''. 362:222: Char literals must contain exactly one character and close with '''. 364:89: Char literals must contain exactly one character and close with '''. 366:58: Char literals must contain exactly one character and close with '''. 368:14: Char literals must contain exactly one character and close with '''. 372:28: Char literals must contain exactly one character and close with '''. 390:50: Char literals must contain exactly one character and close with '''. 392:26: Char literals must contain exactly one character and close with '''. 397:32: Char literals must contain exactly one character and close with '''. 399:121: Char literals must contain exactly one character and close with '''. 415:105: Char literals must contain exactly one character and close with '''. 418:10: Char literals must contain exactly one character and close with '''. 419:10: Char literals mus ... (message truncated)
 Failed IN9 424 OUT43 914
!
LcbStronglyConnectedLiveCodeBench / atcoder / hard: Strongly Connected (arc196_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 299 OUT62 144
✓
LcbSwap0X1YLiveCodeBench / atcoder / hard: Swap 0^X and 1^Y (arc194_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 386 OUT15 355
!
LcbSwapAndEraseLiveCodeBench / atcoder / hard: Swap and Erase (arc195_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 314 OUT62 144
×
LcbTorusLoopLiveCodeBench / atcoder / hard: Torus Loop (arc196_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TorusLoop case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:20: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported. Values: run.Compiled = false
 Failed IN9 491 OUT10 571
✓
LcbTwiceSubsequenceLiveCodeBench / atcoder / medium: Twice Subsequence (arc195_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
 Passed IN9 256 OUT8 117
✓
LcbUniformSumLiveCodeBench / atcoder / hard: Uniform Sum (arc195_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
 Passed IN9 298 OUT9 361
Code Generation - LiveCodeBench v6 LeetCode (set 1) 8 passed2 failed1 broken
72.7%
 IN101 289 OUT139 628
✓
LcbCountEvenDiffPartitionsLiveCodeBench 3704 / leetcode / easy: count partitions with even sum difference (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 173 OUT1 033
×
LcbCountMentionsPerUserLiveCodeBench 3721 / leetcode / medium: count mentions per user (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countMentionsPerUser case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 293 OUT3 196
!
LcbCountNonDecreasingSubarraysLiveCodeBench 3674 / leetcode / hard: count non-decreasing subarrays after k operations (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 212 OUT62 144
✓
LcbMaxFrequencyAfterOpLiveCodeBench 3751 / leetcode / medium: maximum frequency after subarray operation (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 178 OUT2 745
✓
LcbMinimizeMaxEdgeWeightLiveCodeBench 3720 / leetcode / medium: minimize the maximum edge weight of graph (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 236 OUT13 315
✓
LcbMinMaxSubarraySumsLiveCodeBench 3725 / leetcode / hard: max and min sums of at most size k subarrays (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 122 OUT15 556
✓
LcbMinMaxSubsequenceSumsLiveCodeBench 3714 / leetcode / medium: max and min sums of at most size k subsequences (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 160 OUT19 678
✓
LcbPaintHouseIVLiveCodeBench 3737 / leetcode / medium: paint house IV (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 263 OUT3 476
✓
LcbRobotMaxCoinsLiveCodeBench 3677 / leetcode / medium: maximum amount of money robot can earn (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 262 OUT11 402
✓
LcbVariableLengthSubarraySumLiveCodeBench 3731 / leetcode / easy: sum of variable length subarrays (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 141 OUT5 928
×
LcbZigzagGridSkipLiveCodeBench 3708 / leetcode / easy: zigzag grid traversal with skip (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: zigzagGridSkip case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 249 OUT1 155
Code Generation - LiveCodeBench v6 LeetCode (set 2) 10 passed
100.0%
 IN91 905 OUT72 656
✓
LcbAssignElementsToGroupsLiveCodeBench 3760 / leetcode / medium: assign elements to groups with constraints (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 254 OUT728
✓
LcbCountSubstringsDivLastDigitLiveCodeBench 3696 / leetcode / hard: count substrings divisible by last digit (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 123 OUT18 710
✓
LcbEatPizzasMaxWeightLiveCodeBench 3779 / leetcode / medium: eat pizzas (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 225 OUT2 388
✓
LcbMaxEvenOddFreqDiffLiveCodeBench 3753 / leetcode / easy: maximum difference between even and odd frequency I (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 161 OUT2 127
✓
LcbMaximizeMinGameScoreLiveCodeBench 3762 / leetcode / hard: maximize the minimum game score (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 231 OUT21 399
✓
LcbMaxManhattanAfterKLiveCodeBench 3754 / leetcode / medium: maximum manhattan distance after k changes (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 231 OUT6 014
✓
LcbMinIncrementsTargetMultiplesLiveCodeBench 3697 / leetcode / hard: minimum increments for target multiples in an array (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 157 OUT6 984
✓
LcbSelectKDisjointSpecialLiveCodeBench 3771 / leetcode / medium: select k disjoint special substrings (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 176 OUT10 969
✓
LcbSortMatrixDiagonalsLiveCodeBench 3748 / leetcode / medium: sort matrix by diagonals (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 182 OUT2 088
✓
LcbSpecialSubstringLengthKLiveCodeBench 3709 / leetcode / easy: find special substring of length k (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 165 OUT1 249
Code Generation - LiveCodeBench v6 LeetCode (set 3) 7 passed2 failed2 broken
63.6%
 IN101 383 OUT191 703
✓
LcbChooseKMaxSumLiveCodeBench / leetcode / medium / id 3759: for each i, sum of k largest nums2[j] where nums1[j] < nums1[i]1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 257 OUT1 567
✓
LcbFruitsIntoBasketsLiveCodeBench / leetcode / medium / id 3791: count fruit types that remain unplaced into baskets1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 231 OUT1 009
×
LcbLargestAlmostMissingLiveCodeBench / leetcode / easy / id 3705: largest integer appearing in exactly one size-k subarray1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: largestmissing case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 41:33: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported. Values: run.Compiled = false
 Failed IN9 180 OUT14 420
!
LcbLexSmallestGeneratedLiveCodeBench / leetcode / hard / id 3770: lexicographically smallest string generated from str1 and str21 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 236 OUT62 144
✓
LcbLongestPalinSubseqKOpsLiveCodeBench / leetcode / medium / id 3786: longest palindromic subsequence after at most k letter shifts1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 202 OUT4 900
×
LcbLongestVDiagonalLiveCodeBench / leetcode / hard / id 3733: length of longest V-shaped diagonal segment1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: vdiag case0: expected 5 got 3
 Failed IN9 279 OUT8 220
!
LcbMaxDistanceSquareLiveCodeBench / leetcode / hard / id 3781: maximize the minimum Manhattan distance among k boundary points1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 274 OUT62 144
✓
LcbMaxSubarraysConflictLiveCodeBench / leetcode / hard / id 3789: max non-empty subarrays after removing one conflicting pair1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 218 OUT7 771
✓
LcbMaxSumKSubarraysLiveCodeBench / leetcode / medium / id 3722: max sum of k non-overlapping subarrays each length >= m1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 155 OUT18 231
✓
LcbMaxSumWithLimitsLiveCodeBench / leetcode / medium / id 3764: maximum sum of at most k elements with per-row limits1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 190 OUT6 238
✓
LcbSameDigitsAfterOpsLiveCodeBench / leetcode / easy / id 3768: check if final two digits are equal after repeated pairwise sums1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 161 OUT5 059
Code Generation - LiveCodeBench v6 LeetCode (set 4) 8 passed1 failed1 broken
80.0%
 IN92 002 OUT161 071
✓
LcbClosestEqualQueriesLiveCodeBench / leetcode / medium / id 3750: circular min distance to an equal-valued element per query1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 203 OUT2 859
✓
LcbCountBeautifulNumbersLiveCodeBench / leetcode / hard / id 3801: count numbers in [l,r] whose digit-product is divisible by digit-sum1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 155 OUT2 001
✓
LcbLongestPalinConcatLiveCodeBench / leetcode / medium / id 3793: longest palindrome from a substring of s concatenated with one of t1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 165 OUT42 095
✓
LcbMaxContainersShipLiveCodeBench / leetcode / easy / id 3817: max containers of weight w on an n x n deck within maxWeight1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 171 OUT353
✓
LcbMaxUniqueSubarraySumLiveCodeBench / leetcode / easy / id 3788: max sum of a subarray with all-unique elements after deletions1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 174 OUT1 648
✓
LcbMinCostReachPositionsLiveCodeBench / leetcode / easy / id 3832: min total cost to reach each position via prefix-min swaps1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 225 OUT2 968
×
LcbMinOpsElementsZeroLiveCodeBench / leetcode / hard / id 3744: sum over queries of min pair-divide operations to zero a range1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minops case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:24: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 178 OUT9 123
!
LcbMinTimeBrewPotionsLiveCodeBench / leetcode / medium / id 3794: min synchronized time for n wizards to brew m potions in order1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: AI output broken/partial
 Broken IN9 247 OUT62 144
✓
LcbPropertiesGraphLiveCodeBench / leetcode / medium / id 3809: connected components where edges need >= k shared distinct values1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 234 OUT33 587
✓
LcbZeroArrayTransformIVLiveCodeBench / leetcode / medium / id 3795: min k queries to reduce nums to a zero array (subset decrements)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 250 OUT4 293
Code Generation - LiveCodeBench v6 LeetCode (set 5) 11 passed
100.0%
 IN101 094 OUT111 743
✓
LcbFindValidDigitPairLiveCodeBench / leetcode / easy: find-valid-pair-of-adjacent-digits-in-string (id 3736)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 161 OUT1 296
✓
LcbLongestSpecialPathLiveCodeBench / leetcode / hard: longest-special-path (id 3687)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 281 OUT4 280
✓
LcbManhattanArrangementsLiveCodeBench / leetcode / hard: manhattan-distances-of-all-arrangements-of-pieces (id 3739)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 177 OUT25 070
✓
LcbMaxAdjacentCircularLiveCodeBench / leetcode / easy: maximum-difference-between-adjacent-elements-in-a-circular-array (id 3747)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 104 OUT1 024
✓
LcbMaxFreeTimeLiveCodeBench / leetcode / medium: reschedule-meetings-for-maximum-free-time-i (id 3743)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 283 OUT20 377
✓
LcbMaxProductAlternatingSumLiveCodeBench / leetcode / hard: maximum-product-of-subsequences-with-an-alternating-sum-equal-to-k (id 3777)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 209 OUT8 479
✓
LcbMinCostGoodCaptionLiveCodeBench / leetcode / hard: minimum-cost-good-caption (id 3701)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 212 OUT24 884
✓
LcbMinOpsKSubarraysEqualLiveCodeBench / leetcode / hard: minimum-operations-to-make-elements-within-k-subarrays-equal (id 3717)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 185 OUT6 804
✓
LcbMinPairRemovalSortLiveCodeBench / leetcode / easy: minimum-pair-removal-to-sort-array-i (id 3773)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 132 OUT1 490
✓
LcbSeparateSquaresLiveCodeBench / leetcode / medium: separate-squares-i (id 3763)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 196 OUT16 913
✓
LcbSumOfGoodNumbersLiveCodeBench / leetcode / easy: sum-of-good-numbers (id 3723)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 154 OUT1 126
Code Generation - LiveCodeBench v6 LeetCode (set 6) 8 passed2 failed
80.0%
 IN91 892 OUT122 735
✓
LcbCountCopyArraysLiveCodeBench / leetcode / medium: find-the-number-of-copy-arrays (id 3785)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 255 OUT2 374
✓
LcbLongestCommonPrefixRemovalLiveCodeBench / leetcode / hard: longest-common-prefix-of-k-strings-after-removal (id 3784)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 197 OUT44 552
✓
LcbMaxActiveSectionsTradeLiveCodeBench / leetcode / medium: maximize-active-section-with-trade-i (id 3805)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
 Passed IN9 241 OUT22 477
✓
LcbMinCostDivideArrayLiveCodeBench / leetcode / hard: minimum-cost-to-divide-array-into-subarrays (id 3765)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 245 OUT5 134
×
LcbMinCostRemoveElementsLiveCodeBench / leetcode / medium: find-minimum-cost-to-remove-array-elements (id 3776)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: minCostRemove case0 runtime error: Integer overflow. Values: run.Success = false
 Failed IN9 173 OUT12 388
×
LcbPermutationsIVLiveCodeBench / leetcode / hard: permutations-iv (id 3783)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: permutationsIV case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected '<' after 'List', found '&'. Values: run.Compiled = false
 Failed IN9 162 OUT6 909
✓
LcbReverseDegreeLiveCodeBench / leetcode / easy: reverse-degree-of-a-string (id 3811)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 129 OUT743
✓
LcbShortestMatchingSubstringLiveCodeBench / leetcode / hard: shortest-matching-substring (id 3692)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
 Passed IN9 190 OUT26 507
✓
LcbTransformArrayParityLiveCodeBench / leetcode / easy: transform-array-by-parity (id 3778)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 147 OUT339
✓
LcbUnique3DigitEvenLiveCodeBench / leetcode / easy: unique-3-digit-even-numbers (id 3799)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
 Passed IN9 153 OUT1 312