Qwen 3.6 35B FP8 Instruct | Benchmark #15

Described in:Qwen 3.6 35B vs Qwen 3.6 27B: benchmark results analysisTesting Qwen 3.6 35B for hobby coding and agentic tasks

Benchmark summary

LiveCodeBench for SC#

ModelQwen 3.6 35B QuantizationFP8 ModeInstruct

LiveCodeBench adapted to SC#, adding an extra challenge: models must solve newer coding problems while generating correct code in a custom sandboxed language from its provided specification.

Score 407/1022 39.8% passed
407 passed601 failed14 broken32 skipped1054 total 1022 AI queries 0 tool calls TOKENS IN9 427 313 TOKENS OUT6 068 143

Results by difficulty

3 groups
Level Easy
196 / 320 61.3%
passed
320 AI queries 0 tool calls IN2 942 579 OUT356 942
Level Medium
152 / 375 40.5%
passed
375 AI queries 0 tool calls IN3 457 316 OUT1 524 832
Level Hard
59 / 327 18.0%
passed
327 AI queries 0 tool calls IN3 027 418 OUT4 186 369

Results by category

14 groups
Category CodeGeneration
39.8% 407/1022 passed
1022 AI queries 0 tool calls TOKENS IN9 427 313 TOKENS OUT6 068 143
Category V1@AtCoder
35.5% 70/197 passed
197 AI queries 0 tool calls TOKENS IN1 820 233 TOKENS OUT663 996
Category V1@Codeforces
22.2% 2/9 passed
9 AI queries 0 tool calls TOKENS IN83 336 TOKENS OUT15 844
Category V1@LeetCode
50.8% 92/181 passed
181 AI queries 0 tool calls TOKENS IN1 660 345 TOKENS OUT593 196
Category V2@AtCoder
38.9% 21/54 passed
54 AI queries 0 tool calls TOKENS IN500 887 TOKENS OUT161 902
Category V2@LeetCode
53.7% 29/54 passed
54 AI queries 0 tool calls TOKENS IN495 926 TOKENS OUT261 687
Category V3@AtCoder
31.4% 16/51 passed
51 AI queries 0 tool calls TOKENS IN471 871 TOKENS OUT262 000
Category V3@LeetCode
61.7% 29/47 passed
47 AI queries 0 tool calls TOKENS IN433 235 TOKENS OUT197 823
Category V4@AtCoder
26.2% 16/61 passed
61 AI queries 0 tool calls TOKENS IN564 985 TOKENS OUT709 918
Category V4@LeetCode
38.9% 14/36 passed
36 AI queries 0 tool calls TOKENS IN332 265 TOKENS OUT109 843
Category V5@AtCoder
34.3% 34/99 passed
99 AI queries 0 tool calls TOKENS IN916 341 TOKENS OUT1 069 170
Category V5@LeetCode
35.5% 22/62 passed
62 AI queries 0 tool calls TOKENS IN570 197 TOKENS OUT516 389
Category V6@AtCoder
31.5% 34/108 passed
108 AI queries 0 tool calls TOKENS IN998 001 TOKENS OUT1 056 965
Category V6@LeetCode
44.4% 28/63 passed
63 AI queries 0 tool calls TOKENS IN579 691 TOKENS OUT449 410

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Code Generation - LiveCodeBench v1 AtCoder (set 1) 2 passed6 failed
25.0%
IN74 056 OUT48 717
×
LcbAntiDdosCountLiveCodeBench / atcoder abc301_f / hard: Anti (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AntiDdosCount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 90:18: Expected ';' after the statement, found ':'. Values: run.Compiled = false
Failed IN9 282 OUT14 355
×
LcbAtCoderCardsLiveCodeBench / atcoder abc301_c / medium: AtCoder Cards (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AtCoderCards case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:38: Expected '(' after the HashSet type. Hash sets are created with 'new HashSet<T>()', found '{'. Values: run.Compiled = false
Failed IN9 214 OUT3 019
×
LcbAttackCountLiveCodeBench / atcoder abc302_a / easy: Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AttackCount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'return'. Values: run.Compiled = false
Failed IN9 168 OUT40
×
LcbBitmaskLeqNLiveCodeBench / atcoder abc301_d / medium: Bitmask (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BitmaskLeqN case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 74:16: Unknown variable 'Convert'. 92:20: Type 'string' has no supported method named 'PadLeft'. 141:28: Unknown function 'BacktrackSolution'. 157:25: Type 'string' has no supported method named 'TrimStart'. Values: run.Compiled = false
Failed IN9 242 OUT16 530
✓
LcbFillTheGapsLiveCodeBench / atcoder abc301_b / easy: Fill the Gaps (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 277 OUT1 746
×
LcbFindSnukeLiveCodeBench / atcoder abc302_b / medium: Find snuke (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: FindSnuke case0 runtime error: Cannot parse '6 6' as int. Values: run.Success = false
Failed IN9 318 OUT2 245
✓
LcbOverallWinnerLiveCodeBench / atcoder abc301_a / easy: Overall Winner (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 228 OUT1 936
×
LcbPacCandyPathLiveCodeBench / atcoder abc301_e / hard: Pac (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PacCandyPath case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:15: Expected ';' after the variable declaration, found ','. Values: run.Compiled = false
Failed IN9 327 OUT8 846
Code Generation - LiveCodeBench v1 AtCoder (set 10) 4 passed2 failed2 skipped
66.7%
IN55 283 OUT12 167
✓
LcbBlueSpringPassesLiveCodeBench / atcoder / medium: abc318_c Blue Spring (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 217 OUT2 117
–
LcbBookPrerequisitesLiveCodeBench / atcoder / hard: abc315_e Prerequisites (Pattern B, stdin) FLAG: non-unique output (any valid reading order accepted); exact-string driver can reject a correct answer -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: non-unique output: multiple valid reading orders accepted; exact-string driver would reject correct answers
Skipped IN0 OUT0
–
LcbCheckpointShortcutsLiveCodeBench / atcoder / hard: abc315_f Shortcuts (Pattern B, stdin) FLAG: float output (Euclidean distance sum); exact-string driver cannot do tolerance -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# stdin driver: floating-point distance output needs tolerance comparison; exact string compare unsafe
Skipped IN0 OUT0
✓
LcbFullMoonDaysLiveCodeBench / atcoder / easy: abc318_a Full Moon (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 187 OUT313
×
LcbIceCreamFlavorsLiveCodeBench / atcoder / medium: abc315_c Flavors (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IceCreamFlavors case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 50:16: Char literals must contain exactly one character and close with '''. 54:22: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 211 OUT2 969
×
LcbMagicalCookiesLiveCodeBench / atcoder / medium: abc315_d Magical Cookies (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MagicalCookies case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 29:33: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 251 OUT2 907
✓
LcbMiddleDayLiveCodeBench / atcoder / easy: abc315_b The Middle Day (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 229 OUT1 854
✓
LcbOverlappingSheetsLiveCodeBench / atcoder / easy: abc318_b Overlapping sheets (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 188 OUT2 007
Code Generation - LiveCodeBench v1 AtCoder (set 11) 2 passed5 failed1 skipped
28.6%
IN64 463 OUT19 799
×
LcbBusStopsQueriesLiveCodeBench / atcoder / hard: abc319_e Bus Stops (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 306 OUT1 473
–
LcbFalseHopeProbabilityLiveCodeBench / atcoder / medium: abc319_c False Hope (Pattern B, stdin) FLAG: float output (probability); exact-string driver cannot do tolerance -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: SC# stdin driver: probability (float) output needs tolerance comparison; exact string compare unsafe
Skipped IN0 OUT0
✓
LcbLeylandNumberLiveCodeBench / atcoder / easy: abc320_a Leyland Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 152 OUT1 158
✓
LcbLongestPalindromeSubLiveCodeBench / atcoder / easy: abc320_b Longest Palindrome (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 161 OUT979
×
LcbMeasureDivisorsLiveCodeBench / atcoder / easy: abc319_b Measure (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MeasureDivisors case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:16: Expected a type name after 'new', found 'string'. Values: run.Compiled = false
Failed IN9 214 OUT2 583
×
LcbMinimumWindowWidthLiveCodeBench / atcoder / medium: abc319_d Minimum Width (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: MinimumWindowWidth case0: expected [26] got [27]
Failed IN9 233 OUT2 904
×
LcbSandwichTriplesLiveCodeBench / atcoder / hard: abc318_e Sandwiches (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SandwichTriples case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:26: Expected '(' to declare a function or '=' to declare a global variable after 'Initialize suffix_counts', found 'with'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 180 OUT6 322
×
LcbWeightedMaxMatchingLiveCodeBench / atcoder / medium: abc318_d General Weighted Max Matching (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WeightedMaxMatching case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 50:7: Type 'Dictionary<int, long>' has no supported method named 'Add' with 2 argument(s). 84:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 217 OUT4 380
Code Generation - LiveCodeBench v1 AtCoder (set 12) 4 passed5 failed
44.4%
IN83 129 OUT42 930
✓
Lcb321LikeLiveCodeBench / atcoder / easy: abc321_a 321-like Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 245 OUT216
×
LcbCompleteBinaryTreeLiveCodeBench / atcoder / hard: abc321_e Complete Binary Tree (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CompleteBinaryTree case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:19: The shift count of '<<' must be 'int', but got 'long'. Values: run.Compiled = false
Failed IN9 235 OUT9 506
✓
LcbCutoffLiveCodeBench / atcoder / easy: abc321_b Cutoff (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 263 OUT6 236
✓
LcbFirstAbc2LiveCodeBench / atcoder / easy: abc322_a First ABC 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 186 OUT227
×
LcbKth321LikeLiveCodeBench / atcoder / medium: abc321_c K-th 321-like Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: Kth321Like case0: expected [32] got [40]
Failed IN9 222 OUT8 121
×
LcbRelativePositionLiveCodeBench / atcoder / medium: abc320_d Relative Position (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RelativePosition case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:40: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 243 OUT2 067
✓
LcbSetMenuLiveCodeBench / atcoder / medium: abc321_d Set Menu (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 221 OUT1 276
×
LcbSlotStrategy2LiveCodeBench / atcoder / medium: abc320_c Slot Strategy 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SlotStrategy2 case1: expected [20] got [-1]
Failed IN9 260 OUT9 989
×
LcbSomenNagashiLiveCodeBench / atcoder / hard: abc320_e Somen Nagashi (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SomenNagashi case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:28: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 254 OUT5 292
Code Generation - LiveCodeBench v1 AtCoder (set 13) 2 passed7 failed
22.2%
IN83 159 OUT38 154
×
LcbFestivalLiveCodeBench / atcoder / medium: abc322_c Festival (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 220 OUT2 268
×
LcbMergeSlimesLiveCodeBench / atcoder / hard: abc323_d Merge Slimes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: MergeSlimes case0: expected [3] got []
Failed IN9 202 OUT4 569
×
LcbPlaylistProbLiveCodeBench / atcoder / hard: abc323_e Playlist (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PlaylistProb case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 87:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 297 OUT16 720
×
LcbPolyominoLiveCodeBench / atcoder / medium: abc322_d Polyomino (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Polyomino case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:6: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 274 OUT7 874
✓
LcbPrefixSuffixLiveCodeBench / atcoder / easy: abc322_b Prefix and Suffix (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 232 OUT278
×
LcbProductDevelopmentLiveCodeBench / atcoder / hard: abc322_e Product Development (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: ProductDevelopment case0: expected [9] got [-1]
Failed IN9 235 OUT2 586
×
LcbRoundRobinRankLiveCodeBench / atcoder / easy: abc323_b Round (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RoundRobinRank case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 33:33: Unknown type 'object'. Supported types: bool, byte, int, decimal, double, char, string, Date, DateTime, TimeSpan, List<...>, Dictionary<...>, HashSet<...> and declared structs. 36:26: Unknown type 'object'. Supported types: bool, byte, int, decimal, double, char, string, Date, DateTime, TimeSpan, List<...>, Dictionary<...>, HashSet<...> and declared structs. Values: run.Compiled = false
Failed IN9 243 OUT2 115
✓
LcbWeakBeatsLiveCodeBench / atcoder / easy: abc323_a Weak Beats (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 188 OUT680
×
LcbWorldTourFinalsLiveCodeBench / atcoder / medium: abc323_c World Tour Finals (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 268 OUT1 064
Code Generation - LiveCodeBench v1 AtCoder (set 14) 2 passed4 failed1 skipped
33.3%
IN55 080 OUT14 123
✓
Lcb2x3yLiveCodeBench / atcoder / easy: abc324_b 2^x 3^y (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 152 OUT285
×
LcbAllValuesEqualLiveCodeBench / atcoder / easy: abc324_a Same (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AllValuesEqual case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 149 OUT91
–
LcbBeautifulPathLiveCodeBench / atcoder / hard: abc324_f Beautiful Path (Pattern B, stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: float stdout: stdin driver compares stdout by exact trimmed string, cannot tolerance-match a floating-point ratio like 0.7500000000000000
Skipped IN0 OUT0
×
LcbErrorCorrectionLiveCodeBench / atcoder / medium: abc324_c Error Correction (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: ErrorCorrection case0: expected [4 1 2 3 4] got [3 1 3 4]
Failed IN9 268 OUT4 237
×
LcbJointTwoStringsLiveCodeBench / atcoder / hard: abc324_e Joint Two Strings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: JointTwoStrings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 73:5: Function 'Solve' must return 'long', but this return statement has type 'string'. Values: run.Compiled = false
Failed IN9 202 OUT6 805
×
LcbSquarePermutationLiveCodeBench / atcoder / hard: abc324_d Square Permutation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SquarePermutation case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
Failed IN9 165 OUT2 200
✓
LcbSurnameSanLiveCodeBench / atcoder / easy: abc325_a Takahashi san (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 144 OUT505
Code Generation - LiveCodeBench v1 AtCoder (set 15) 2 passed6 failed1 skipped
25.0%
IN74 293 OUT24 704
✓
Lcb326LikeNumberLiveCodeBench / atcoder / abc326_b: 3261 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 225 OUT306
–
LcbAbcPuzzleLiveCodeBench / atcoder / abc326_d: ABC Puzzle NOTE: output is NON-UNIQUE (any valid grid is accepted); exact string compare is unsafe -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: non-unique output: any valid grid is accepted, exact string compare unsafe
Skipped IN0 OUT0
×
LcbCarTrainTravelLiveCodeBench / atcoder / abc325_e: Our clients, please wait a moment1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CarTrainTravel case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected a name, found '('. Values: run.Compiled = false
Failed IN9 357 OUT3 524
✓
LcbGiftIntervalLiveCodeBench / atcoder / abc326_c: Peak1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 249 OUT2 548
×
LcbPrintingMachineLiveCodeBench / atcoder / abc325_d: Printing Machine1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PrintingMachine case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 85:5: Not all code paths in function 'CompareProducts' return a value. Values: run.Compiled = false
Failed IN9 286 OUT6 107
×
LcbSensorClustersLiveCodeBench / atcoder / abc325_c: Sensors1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SensorClusters case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 42:38: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 310 OUT2 424
×
LcbSensorCostDilemmaLiveCodeBench / atcoder / abc325_f: Sensor Optimization Dilemma1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SensorCostDilemma case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:23: Unknown variable 'Enumerable'. 28:27: Unknown variable 'Enumerable'. 30:28: Unknown variable 'Enumerable'. 35:31: Unknown variable 'Enumerable'. 57:24: Unknown variable 'Enumerable'. Values: run.Compiled = false
Failed IN9 380 OUT9 394
×
LcbStairsOrElevatorLiveCodeBench / atcoder / abc326_a: 2UP3DOWN1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StairsOrElevator case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int x', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 201 OUT80
×
LcbWorldMeetingLiveCodeBench / atcoder / abc325_b: World Meeting1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WorldMeeting case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 285 OUT321
Code Generation - LiveCodeBench v1 AtCoder (set 16) 3 passed4 failed1 skipped
42.9%
IN64 711 OUT8 770
✓
LcbAdjacentABLiveCodeBench / atcoder / abc327_a: ab1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 198 OUT242
×
LcbGoodTupleLiveCodeBench / atcoder / abc327_d: Good Tuple Problem1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GoodTuple case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:21: Expected a type name after 'new', found 'int'. Values: run.Compiled = false
Failed IN9 279 OUT1 986
–
LcbMaximizeRatingLiveCodeBench / atcoder / abc327_e: Maximize Rating NOTE: output is a FLOAT with tolerance 1e-6; exact trimmed string compare is unsafe -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: floating-point output with 1e-6 tolerance; exact string compare unsafe
Skipped IN0 OUT0
✓
LcbNotTooHardLiveCodeBench / atcoder / abc328_a: Not Too Hard1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 199 OUT226
×
LcbNumberPlaceLiveCodeBench / atcoder / abc327_c: Number Place1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NumberPlace case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 48:16: Expected a loop variable name, found 'in'. Values: run.Compiled = false
Failed IN9 297 OUT625
×
LcbPerfectPowerAALiveCodeBench / atcoder / abc327_b: A^A1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PerfectPowerAA case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'while'. Values: run.Compiled = false
Failed IN9 179 OUT227
×
LcbRepdigitDatesLiveCodeBench / atcoder / abc328_b: 11/111 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RepdigitDates case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:23: Unknown function 'Range'. 23:27: Unknown function 'Range'. Values: run.Compiled = false
Failed IN9 216 OUT2 979
✓
LcbSalaryExpectationLiveCodeBench / atcoder / abc326_e: Revenge of "The Salary of AtCoder Inc."1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 343 OUT2 485
Code Generation - LiveCodeBench v1 AtCoder (set 17) 1 passed7 failed
12.5%
IN73 854 OUT36 002
×
LcbConsecutivePairsLiveCodeBench / atcoder / abc328_c: Consecutive1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ConsecutivePairs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 15:16: Type 'List<long>' has no supported method named 'Last' with 0 argument(s). Values: run.Compiled = false
Failed IN9 283 OUT1 682
×
LcbCountRepeatsLiveCodeBench / atcoder / abc329_c: Count xxx1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountRepeats case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:5: Function 'Solve' must return 'long', but this return statement has type 'string'. Values: run.Compiled = false
Failed IN9 198 OUT2 597
×
LcbElectionReportLiveCodeBench / atcoder / abc329_d: Election Quick Report1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 262 OUT2 024
×
LcbModuloMstLiveCodeBench / atcoder / abc328_e: Modulo MST1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ModuloMst case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 29:14: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 294 OUT13 345
×
LcbSecondLargestLiveCodeBench / atcoder / abc329_b: Next1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SecondLargest case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 187 OUT797
×
LcbSpreadCharsLiveCodeBench / atcoder / abc329_a: Spread1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SpreadChars case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 175 OUT148
×
LcbStampMatchLiveCodeBench / atcoder / abc329_e: Stamp1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: StampMatch case0: expected [Yes] got [No]
Failed IN9 254 OUT14 398
✓
LcbTakeAbcLiveCodeBench / atcoder / abc328_d: Take ABC1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 201 OUT1 011
Code Generation - LiveCodeBench v1 AtCoder (set 18) 3 passed6 failed
33.3%
IN82 896 OUT19 488
×
LcbColoredBallLiveCodeBench / atcoder / hard: Colored Ball [LCB id: abc329_f]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ColoredBall case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 30:12: Char literals must contain exactly one character and close with '''. 35:7: Unexpected character '`'. 35:16: Unexpected character '`'. 36:20: Unexpected character '→'. Values: run.Compiled = false
Failed IN9 247 OUT1 860
×
LcbCountingLsLiveCodeBench / atcoder / medium: Counting Ls [LCB id: abc330_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountingLs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:23: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 296 OUT2 860
×
LcbCountingPassesLiveCodeBench / atcoder / easy: Counting Passes [LCB id: abc330_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountingPasses case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 166 OUT108
✓
LcbEggPacksLiveCodeBench / atcoder / easy: Buy One Carton of Milk (egg packs) [LCB id: abc331_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 178 OUT9 352
×
LcbMexAndUpdateLiveCodeBench / atcoder / hard: Mex and Update [LCB id: abc330_e]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MexAndUpdate case0 runtime error: Cannot parse '2 0 2 2 1 1 2 5' as long. Values: run.Success = false
Failed IN9 252 OUT2 763
✓
LcbMinimizeAbs1LiveCodeBench / atcoder / easy: Minimize Abs 1 [LCB id: abc330_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 240 OUT377
✓
LcbMinimizeAbs2LiveCodeBench / atcoder / medium: Minimize Abs 2 [LCB id: abc330_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 146 OUT976
×
LcbSumGreaterThanMeLiveCodeBench / atcoder / medium: Sum of Numbers Greater Than Me [LCB id: abc331_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SumGreaterThanMe case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 188 OUT362
×
LcbTomorrowCalendarLiveCodeBench / atcoder / easy: Tomorrow [LCB id: abc331_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TomorrowCalendar case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:14: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 183 OUT830
Code Generation - LiveCodeBench v1 AtCoder (set 19) 2 passed6 failed
25.0%
IN74 311 OUT31 978
×
LcbGlassAndMugLiveCodeBench / atcoder / easy: Glass and Mug [LCB id: abc332_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GlassAndMug case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 29:18: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 269 OUT4 564
×
LcbOnlineShoppingLiveCodeBench / atcoder / easy: Online Shopping [LCB id: abc332_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OnlineShopping case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected '(' to declare a function or '=' to declare a global variable after 'long n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 238 OUT157
✓
LcbPentagonDiagonalLiveCodeBench / atcoder / easy: Pentagon [LCB id: abc333_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 250 OUT1 168
×
LcbSetMealLiveCodeBench / atcoder / hard: Set Meal [LCB id: abc331_e]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SetMeal case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:27: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. 38:40: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 306 OUT6 066
×
LcbSwappingPuzzleLiveCodeBench / atcoder / hard: Swapping Puzzle [LCB id: abc332_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SwappingPuzzle case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:31: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '.'. Values: run.Compiled = false
Failed IN9 364 OUT13 181
×
LcbThreeThreesLiveCodeBench / atcoder / easy: Three Threes [LCB id: abc333_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ThreeThrees case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 142 OUT44
×
LcbTilePatternLiveCodeBench / atcoder / hard: Tile Pattern [LCB id: abc331_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TilePattern case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:20: Unknown function 'f'. 70:20: Unknown function 'f'. 71:20: Unknown function 'f'. 72:20: Unknown function 'f'. Values: run.Compiled = false
Failed IN9 346 OUT4 586
✓
LcbTShirtsLiveCodeBench / atcoder / medium: T-Shirts [LCB id: abc332_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 396 OUT2 212
Code Generation - LiveCodeBench v1 AtCoder (set 2) 3 passed5 failed
37.5%
IN74 107 OUT18 323
×
LcbAlmostEqualRearrangeLiveCodeBench / atcoder abc302_c / medium: Almost Equal (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: AlmostEqualRearrange case0 runtime error: Cannot parse '4 4' as int. Values: run.Success = false
Failed IN9 220 OUT5 447
×
LcbDashHealthLiveCodeBench / atcoder abc303_c / medium: Dash (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DashHealth case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 38:22: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 312 OUT692
×
LcbDiscordBadMoodLiveCodeBench / atcoder abc303_b / easy: Discord (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DiscordBadMood case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:39: Type 'List<string>' has no supported method named 'ToList' with 0 argument(s). Values: run.Compiled = false
Failed IN9 237 OUT507
✓
LcbImpartialGiftLiveCodeBench / atcoder abc302_d / medium: Impartial Gift (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 262 OUT858
×
LcbIsolationQueriesLiveCodeBench / atcoder abc302_e / hard: Isolation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 249 OUT2 972
×
LcbMergeSetLiveCodeBench / atcoder abc302_f / hard: Merge Set (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MergeSet case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 42:26: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 304 OUT4 896
✓
LcbShiftVsCapsLockLiveCodeBench / atcoder abc303_d / medium: Shift vs. CapsLock (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 272 OUT2 174
✓
LcbSimilarStringLiveCodeBench / atcoder abc303_a / easy: Similar String (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 251 OUT777
Code Generation - LiveCodeBench v1 AtCoder (set 20) 4 passed3 failed1 skipped
57.1%
IN64 697 OUT22 371
×
LcbChristmasColorGridLiveCodeBench / atcoder / hard: Christmas Color Grid 1 [LCB id: abc334_e]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ChristmasColorGrid case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found '.'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 375 OUT10 490
✓
LcbChristmasPresentLiveCodeBench / atcoder / easy: Christmas Present [LCB id: abc334_a]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 159 OUT180
✓
LcbChristmasTreesLiveCodeBench / atcoder / medium: Christmas Trees [LCB id: abc334_b]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 236 OUT2 372
✓
LcbEraseLeavesLiveCodeBench / atcoder / medium: Erase Leaves [LCB id: abc333_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 238 OUT2 094
×
LcbReindeerSleighLiveCodeBench / atcoder / medium: Reindeer and Sleigh [LCB id: abc334_d]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 254 OUT1 466
×
LcbRepunitTrioLiveCodeBench / atcoder / medium: Repunit Trio [LCB id: abc333_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RepunitTrio case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:84: Unexpected character '≥'. 9:60: Char literals must contain exactly one character and close with '''. 20:6: Char literals must contain exactly one character and close with '''. 22:51: Char literals must contain exactly one character and close with '''. 34:16: Char literals must contain exactly one character and close with '''. 48:9: Char literals must contain exactly one character and close with '''. 50:27: Char literals must contain exactly one character and close with '''. 52:12: Char literals must contain exactly one character and close with '''. 54:10: Unexpected character '≤'. 54:38: Unexpected character '≤'. 56:46: Unexpected character '≤'. 56:48: Unexpected character '≤'. 58:83: Unexpected character '≈'. 58:150: Char literals must contain exactly one character and close with '''. 62:27: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 180 OUT1 108
✓
LcbSocks2LiveCodeBench / atcoder / medium: Socks 2 [LCB id: abc334_c]1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 255 OUT4 661
–
LcbTakahashiQuestLiveCodeBench / atcoder / hard: Takahashi Quest [LCB id: abc333_e]0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: non-unique output: any valid pick-up sequence achieving K_min is accepted, cannot value-compare against a single oracle line
Skipped IN0 OUT0
Code Generation - LiveCodeBench v1 AtCoder (set 21) 3 passed5 failed1 skipped
37.5%
IN73 608 OUT9 395
✓
Lcb2023To2024LiveCodeBench / atcoder / abc335_a: 2023 -> 2024 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 149 OUT236
×
LcbCtzLiveCodeBench / atcoder / abc336_b: CTZ (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Ctz case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected '(' to declare a function or '=' to declare a global variable after 'long n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 176 OUT52
✓
LcbEvenDigitsLiveCodeBench / atcoder / abc336_c: Even Digits (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 233 OUT1 500
✓
LcbLongLoongLiveCodeBench / atcoder / abc336_a: Long Loong (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 176 OUT417
–
LcbLoongAndTakahashiLiveCodeBench / atcoder / abc335_d: Loong and Takahashi (Pattern B, stdin) [NON-UNIQUE output]0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbLoongTrackingLiveCodeBench / atcoder / abc335_c: Loong Tracking (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: LoongTracking case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:31: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 242 OUT4 303
×
LcbPyramidSequenceLiveCodeBench / atcoder / abc336_d: Pyramid (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PyramidSequence case1: expected [3] got [2]
Failed IN9 230 OUT2 422
×
LcbScoreboardLiveCodeBench / atcoder / abc337_a: Scoreboard (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Scoreboard case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:6: Expected '(' to declare a function or '=' to declare a global variable after 'int i', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 195 OUT153
×
LcbTetrahedralNumberLiveCodeBench / atcoder / abc335_b: Tetrahedral Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 207 OUT312
Code Generation - LiveCodeBench v1 AtCoder (set 22) 3 passed4 failed1 skipped
42.9%
IN64 426 OUT18 562
–
LcbBadJuiceLiveCodeBench / atcoder / abc337_e: Bad Juice (INTERACTIVE — not expressible as batch stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# subset: interactive problem (two-way judge interaction + non-unique valid output)
Skipped IN0 OUT0
✓
LcbCapitalizedLiveCodeBench / atcoder / abc338_a: Capitalized? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 143 OUT683
×
LcbCheatingGomokuLiveCodeBench / atcoder / abc337_d: Cheating Gomoku Narabe (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: CheatingGomoku case0: expected [2] got [1]
Failed IN9 232 OUT2 751
✓
LcbExtendedAbcLiveCodeBench / atcoder / abc337_b: Extended ABC (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 198 OUT1 199
×
LcbFrequencyLiveCodeBench / atcoder / abc338_b: Frequency (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Frequency case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:26: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 146 OUT266
×
LcbIslandTourLiveCodeBench / atcoder / abc338_d: Island Tour (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IslandTour case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 42:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 284 OUT7 370
×
LcbLeftoverRecipesLiveCodeBench / atcoder / abc338_c: Leftover Recipes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: LeftoverRecipes case0 runtime error: Integer overflow. Values: run.Success = false
Failed IN9 226 OUT5 653
✓
LcbLiningUp2LiveCodeBench / atcoder / abc337_c: Lining Up 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 197 OUT640
Code Generation - LiveCodeBench v1 AtCoder (set 23) 4 passed4 failed
50.0%
IN73 620 OUT16 367
×
LcbAppendQueryLiveCodeBench / atcoder / abc340_b: Append (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 185 OUT291
✓
LcbArithmeticProgressionLiveCodeBench / atcoder / abc340_a: Arithmetic Progression (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 150 OUT1 218
×
LcbChordsLiveCodeBench / atcoder / abc338_e: Chords (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Chords case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 72:14: Expected ';' after the statement, found ','. Values: run.Compiled = false
Failed IN9 193 OUT4 371
×
LcbLangtonsTakahashiLiveCodeBench / atcoder / abc339_b: Langton's Takahashi (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 255 OUT1 766
✓
LcbNegativeTspLiveCodeBench / atcoder / abc338_f: Negative Traveling Salesman (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 244 OUT1 783
✓
LcbPerfectBusLiveCodeBench / atcoder / abc339_c: Perfect Bus (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 192 OUT851
×
LcbSynchronizedPlayersLiveCodeBench / atcoder / abc339_d: Synchronized Players (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SynchronizedPlayers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:17: Expected ';' after the variable declaration, found ','. Values: run.Compiled = false
Failed IN9 242 OUT5 646
✓
LcbTldLiveCodeBench / atcoder / abc339_a: TLD (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 159 OUT441
Code Generation - LiveCodeBench v1 AtCoder (set 24) 4 passed6 failed
40.0%
IN92 508 OUT41 040
×
LcbAlternatingStringLiveCodeBench / atcoder abc341_e / hard: Alternating String (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 263 OUT5 051
×
LcbBreakdownLiveCodeBench / atcoder abc341_f / hard: Breakdown (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Breakdown case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 37:37: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 326 OUT7 083
×
LcbDivideAndDivideLiveCodeBench / atcoder abc340_c / medium: Divide and Divide (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DivideAndDivide case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:27: Expected '(' to declare a function or '=' to declare a global variable after 'Dictionary<long, long> memo', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 248 OUT3 778
✓
LcbForeignExchangeLiveCodeBench / atcoder abc341_b / easy: Foreign Exchange (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 301 OUT3 270
×
LcbMancala2LiveCodeBench / atcoder abc340_e / hard: Mancala 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Mancala2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 31:5: Expected an expression, found 'void'. Values: run.Compiled = false
Failed IN9 303 OUT11 542
✓
LcbOnlyOneOfTwoLiveCodeBench / atcoder abc341_d / medium: Only one of two (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 187 OUT3 285
✓
LcbPrint341LiveCodeBench / atcoder abc341_a / easy: Print 341 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 148 OUT777
×
LcbSuperTakahashiBrosLiveCodeBench / atcoder abc340_d / hard: Super Takahashi Bros. (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SuperTakahashiBros case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 292 OUT4 286
✓
LcbTakahashiGetsLostLiveCodeBench / atcoder abc341_c / medium: Takahashi Gets Lost (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 277 OUT563
×
LcbYayLiveCodeBench / atcoder abc342_a / easy: Yay! (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Yay case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 37:5: Expected ';' after the statement, found ':'. Values: run.Compiled = false
Failed IN9 163 OUT1 405
Code Generation - LiveCodeBench v1 AtCoder (set 25) 2 passed5 failed2 skipped
28.6%
IN64 827 OUT43 155
✓
LcbAdjacencyMatrixLiveCodeBench / atcoder abc343_b / easy: Adjacency Matrix (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 254 OUT1 858
×
LcbDiversityOfScoresLiveCodeBench / atcoder abc343_d / medium: Diversity of Scores (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 274 OUT3 048
×
LcbLastTrainLiveCodeBench / atcoder abc342_e / hard: Last Train (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: LastTrain case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 71:31: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '<'. Values: run.Compiled = false
Failed IN9 411 OUT1 700
×
LcbManyReplacementLiveCodeBench / atcoder abc342_c / medium: Many Replacement (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ManyReplacement case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:35: Cannot assign a value of type 'int' to variable 'ch' of type 'char'. Values: run.Compiled = false
Failed IN9 240 OUT1 018
✓
LcbPalindromicCubeLiveCodeBench / atcoder abc343_c / medium: 343 (palindromic cube) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 185 OUT718
–
LcbSevenCubedLiveCodeBench / atcoder abc343_e / hard: 7x7x7 (Pattern B, stdin) Non-unique output: any valid 9-integer placement is accepted; exact-match oracle cannot judge the Yes case.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: Non-unique output: any valid tuple is accepted for the Yes case; exact-match oracle cannot judge
Skipped IN0 OUT0
×
LcbSquarePairLiveCodeBench / atcoder abc342_d / medium: Square Pair (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SquarePair case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3160:23: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 3180:5: Function 'Solve' must return 'long', but this return statement has type 'string'. Values: run.Compiled = false
Failed IN9 224 OUT33 829
×
LcbWhichIsAheadLiveCodeBench / atcoder abc342_b / easy: Which is ahead? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 239 OUT984
–
LcbWrongAnswerLiveCodeBench / atcoder abc343_a / easy: Wrong Answer (Pattern B, stdin) Non-unique output: ANY integer 0..9 not equal to A+B is accepted; exact-match oracle cannot judge it.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Skipped: Non-unique output: any integer 0..9 != A+B is a valid answer; exact-match oracle cannot judge
Skipped IN0 OUT0
Code Generation - LiveCodeBench v1 AtCoder (set 3) 4 passed5 failed
44.4%
IN83 159 OUT41 556
✓
LcbAbcdefgDistLiveCodeBench / atcoder abc305_b / easy: ABCDEFG (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 212 OUT1 039
×
LcbCookiePickerLiveCodeBench / atcoder abc305_c / medium: Snuke the Cookie Picker (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CookiePicker case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 95:30: Expected ';' after the statement, found ':'. Values: run.Compiled = false
Failed IN9 236 OUT3 139
✓
LcbFirstPlayerLiveCodeBench / atcoder abc304_a / easy: First Player (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 208 OUT562
×
LcbGiftFromStarsLiveCodeBench / atcoder abc303_e / hard: A Gift From the Stars (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: GiftFromStars case1: expected [2 2 2] got [2 2 2 2]
Failed IN9 264 OUT30 735
×
LcbGoodGraphLiveCodeBench / atcoder abc304_e / hard: Good Graph (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GoodGraph case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:13: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 260 OUT1 863
×
LcbPieceOfCakeLiveCodeBench / atcoder abc304_d / medium: A Piece of Cake (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PieceOfCake case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 71:28: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 258 OUT839
✓
LcbSubscribersLiveCodeBench / atcoder abc304_b / easy: Subscribers (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 316 OUT2 172
✓
LcbVirusSpreadLiveCodeBench / atcoder abc304_c / medium: Virus (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 207 OUT573
×
LcbWaterStationLiveCodeBench / atcoder abc305_a / easy: Water Station (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WaterStation case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:11: Char literals must contain exactly one character and close with '''. 24:29: Unexpected character '✓'. 25:29: Unexpected character '✓'. 26:29: Unexpected character '✓'. 27:29: Unexpected character '✓'. 28:29: Unexpected character '✓'. 29:30: Unexpected character '✓'. Values: run.Compiled = false
Failed IN9 198 OUT634
Code Generation - LiveCodeBench v1 AtCoder (set 4) 2 passed6 failed
25.0%
IN73 793 OUT31 809
×
LcbArtGalleryLiveCodeBench / atcoder abc305_e / hard: Art Gallery on Graph (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ArtGallery case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 32:30: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 254 OUT1 312
×
LcbBase2LiveCodeBench / atcoder abc306_b / easy: Base 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Base2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 34:38: Expected ')' to close the StringBuilder constructor. Use 'new StringBuilder()'., found 'result'. Values: run.Compiled = false
Failed IN9 197 OUT806
×
LcbBestPerformancesLiveCodeBench / atcoder abc306_e / hard: Best Performances (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: BestPerformances case0: expected [5 6 8 8 15 13 13 11 1 0] got []
Failed IN9 232 OUT20 267
×
LcbCentersLiveCodeBench / atcoder abc306_c / medium: Centers (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Centers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:38: Expected '>' to close the List type, found '<'. Values: run.Compiled = false
Failed IN9 208 OUT1 956
×
LcbEchoStringLiveCodeBench / atcoder abc306_a / easy: Echo (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EchoString case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 172 OUT72
✓
LcbPoisonousFullLiveCodeBench / atcoder abc306_d / medium: Poisonous Full (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 259 OUT3 298
×
LcbSleepLogLiveCodeBench / atcoder abc305_d / hard: Sleep Log (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SleepLog case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:19: Expected ';' after the variable declaration, found ','. Values: run.Compiled = false
Failed IN9 261 OUT3 220
✓
LcbWeeklyRecordsLiveCodeBench / atcoder abc307_a / easy: Weekly Records (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 210 OUT878
Code Generation - LiveCodeBench v1 AtCoder (set 5) 2 passed6 failed
25.0%
IN73 787 OUT37 938
×
LcbDefaultPriceLiveCodeBench / atcoder abc308_b / easy: Default Price (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DefaultPrice case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 213 OUT431
✓
LcbDistinctAdjacentLiveCodeBench / atcoder abc307_e / hard: Distinct Adjacent (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 214 OUT2 427
×
LcbIdealSheetLiveCodeBench / atcoder abc307_c / medium: Ideal Sheet (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IdealSheet case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:77: Expected ')' to close the argument list, found '('. Values: run.Compiled = false
Failed IN9 303 OUT19 879
×
LcbMismatchedParensLiveCodeBench / atcoder abc307_d / medium: Mismatched Parentheses (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MismatchedParens case0 runtime error: List index 5 is out of range. The list has 5 element(s). Values: run.Success = false
Failed IN9 186 OUT1 766
✓
LcbNewSchemeLiveCodeBench / atcoder abc308_a / easy: New Scheme (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 205 OUT327
×
LcbRacecarPalindromeLiveCodeBench / atcoder abc307_b / easy: racecar (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: RacecarPalindrome case1: expected [No] got [Yes]
Failed IN9 212 OUT6 248
×
LcbSnukeMazeLiveCodeBench / atcoder abc308_d / medium: Snuke Maze (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SnukeMaze case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 23:31: Unknown type 'object'. Supported types: bool, byte, int, decimal, double, char, string, Date, DateTime, TimeSpan, List<...>, Dictionary<...>, HashSet<...> and declared structs. 75:48: Unknown type 'object'. Supported types: bool, byte, int, decimal, double, char, string, Date, DateTime, TimeSpan, List<...>, Dictionary<...>, HashSet<...> and declared structs. Values: run.Compiled = false
Failed IN9 254 OUT4 232
×
LcbStandingsLiveCodeBench / atcoder abc308_c / medium: Standings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Standings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:5: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 22:12: Unknown variable 'j'. 24:20: Unknown variable 'j'. 25:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 25:9: Unknown variable 'j'. 31:5: Unknown variable 'k'. Declare it first, e.g. 'int k = ...;'. 32:12: Unknown variable 'k'. 34:13: Unknown variable 'k'. 38:26: Unknown variable 'k'. 39:9: Unknown variable 'k'. Declare it first, e.g. 'int k = ...;'. 39:9: Unknown variable 'k'. 47:17: Unknown variable 'a'. 48:17: Unknown variable 'a'. 48:25: Unknown variable 'b'. 49:17: Unknown variable 'a'. 50:17: Unknown variable 'a'. 50:25: Unknown variable 'b'. Values: run.Compiled = false
Failed IN9 200 OUT2 628
Code Generation - LiveCodeBench v1 AtCoder (set 6) 1 passed8 failed
11.1%
IN83 440 OUT18 851
×
LcbAddEdgeMaxDistanceLiveCodeBench / atcoder / medium: abc309_d Add One Edge1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: AddEdgeMaxDistance case0: expected [5] got [3]
Failed IN9 357 OUT2 174
✓
LcbDrinkCouponLiveCodeBench / atcoder / easy: abc310_a Order Something Else1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 227 OUT328
×
LcbFamilyInsuranceLiveCodeBench / atcoder / hard: abc309_e Family and Insurance1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FamilyInsurance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:26: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 217 OUT773
×
LcbMedicineDayLiveCodeBench / atcoder / medium: abc309_c Medicine1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MedicineDay case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 238 OUT336
×
LcbMexTriplesLiveCodeBench / atcoder / hard: abc308_e MEX1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MexTriples case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:34: Expected '(' after the List type. Lists are created with 'new List<T>()' or 'new List<T>(items)', found '['. Values: run.Compiled = false
Failed IN9 257 OUT6 379
×
LcbNineAdjacentLiveCodeBench / atcoder / easy: abc309_a Nine1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NineAdjacent case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '1'. Values: run.Compiled = false
Failed IN9 226 OUT876
×
LcbRotateOuterLiveCodeBench / atcoder / easy: abc309_b Rotate1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RotateOuter case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 73:26: Type 'string' has no supported method named 'Remove'. 82:26: Type 'string' has no supported method named 'Remove'. 91:34: Type 'string' has no supported method named 'Remove'. 100:26: Type 'string' has no supported method named 'Remove'. Values: run.Compiled = false
Failed IN9 316 OUT1 800
×
LcbStrictlySuperiorLiveCodeBench / atcoder / easy: abc310_b Strictly Superior1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StrictlySuperior case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:14: Cannot assign a value of type 'HashSet<int>' to an element of type 'List<HashSet<int>>'. 42:31: 'Contains' on a List requires scalar or keyable struct elements, but the list has type 'List<HashSet<int>>'. Values: run.Compiled = false
Failed IN9 356 OUT2 561
×
LcbVouchersDiscountLiveCodeBench / atcoder / hard: abc308_f Vouchers1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: VouchersDiscount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:24: Unknown comparator function 'CouponByL'. 73:5: Not all code paths in function 'ItemByPrice' return a value. Values: run.Compiled = false
Failed IN9 246 OUT3 624
Code Generation - LiveCodeBench v1 AtCoder (set 7) 4 passed3 failed1 skipped
57.1%
IN64 957 OUT21 538
–
LcbFindCycleLiveCodeBench / atcoder / medium: abc311_c Find it! (NON-UNIQUE output: any valid directed cycle is accepted; exact-match unreliable)0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: non-unique output: any valid directed cycle is accepted, exact string match unreliable
Skipped IN0 OUT0
✓
LcbFirstAbcLiveCodeBench / atcoder / easy: abc311_a First ABC1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 191 OUT647
×
LcbGridIceFloorLiveCodeBench / atcoder / medium: abc311_d Grid Ice Floor1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GridIceFloor case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 44:12: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 349 OUT3 319
×
LcbMake10AgainLiveCodeBench / atcoder / hard: abc310_f Make 10 Again1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Make10Again case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 330 OUT5 841
✓
LcbNandRepeatedlyLiveCodeBench / atcoder / hard: abc310_e NAND repeatedly1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 296 OUT3 967
×
LcbPeacefulTeamsLiveCodeBench / atcoder / medium: abc310_d Peaceful Teams1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PeacefulTeams case0: expected [4] got []
Failed IN9 273 OUT6 953
✓
LcbReversibleSticksLiveCodeBench / atcoder / medium: abc310_c Reversible1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 267 OUT345
✓
LcbVacationTogetherLiveCodeBench / atcoder / easy: abc311_b Vacation Together1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 251 OUT466
Code Generation - LiveCodeBench v1 AtCoder (set 8) 2 passed6 failed
25.0%
IN74 147 OUT30 166
×
LcbBecomeStrongestLiveCodeBench / atcoder / easy: abc313_a To Be Saikyo1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: BecomeStrongest case2: expected [1] got [0]
Failed IN9 204 OUT444
×
LcbCansOpenersLiveCodeBench / atcoder / hard: abc312_f Cans and Openers1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CansOpeners case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 70:31: Cannot assign a value of type 'long' to variable 'rMax' of type 'int'. Values: run.Compiled = false
Failed IN9 295 OUT11 503
✓
LcbChordCheckLiveCodeBench / atcoder / easy: abc312_a Chord1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 156 OUT183
✓
LcbCountBracketsLiveCodeBench / atcoder / medium: abc312_d Count Bracket Sequences1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 253 OUT713
×
LcbCuboidTangencyLiveCodeBench / atcoder / hard: abc312_e Tangency of Cuboids1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CuboidTangency case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:12: Expected ';' after the struct field, found ','. Values: run.Compiled = false
Failed IN9 343 OUT4 956
×
LcbHolelessSquaresLiveCodeBench / atcoder / hard: abc311_e Defect1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: HolelessSquares case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 38:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 39:16: Unknown variable 'j'. 41:47: Unknown variable 'j'. 44:23: Unknown variable 'j'. 48:23: Unknown variable 'j'. 48:54: Unknown variable 'j'. 48:64: Unknown variable 'j'. 48:79: Unknown variable 'j'. 50:26: Unknown variable 'j'. 51:13: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 51:13: Unknown variable 'j'. Values: run.Compiled = false
Failed IN9 324 OUT1 655
×
LcbInvisibleHandLiveCodeBench / atcoder / medium: abc312_c Invisible Hand1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: InvisibleHand case0 runtime error: Integer overflow. Values: run.Success = false
Failed IN9 212 OUT4 869
×
LcbTakCodeLiveCodeBench / atcoder / easy: abc312_b TaK Code1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TakCode case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:28: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 360 OUT5 843
Code Generation - LiveCodeBench v1 AtCoder (set 9) 5 passed3 failed1 skipped
62.5%
IN73 922 OUT16 093
✓
LcbApproxEqualizationLiveCodeBench / atcoder / medium: abc313_c Approximate Equalization 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 191 OUT918
×
LcbCertainGameExpectedLiveCodeBench / atcoder / hard: abc314_f A Certain Game (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CertainGameExpected case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 306 OUT5 390
✓
LcbLowerUpperOpsLiveCodeBench / atcoder / medium: abc314_d LOWER (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 225 OUT3 549
✓
LcbPiTruncateLiveCodeBench / atcoder / easy: abc314_a 3.14 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 270 OUT1 416
✓
LcbRemoveVowelsLiveCodeBench / atcoder / easy: abc315_a tcdr (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 155 OUT652
✓
LcbRotateColoredSubsequenceLiveCodeBench / atcoder / medium: abc314_c Rotate Colored Subsequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 254 OUT524
×
LcbRouletteFewestBetsLiveCodeBench / atcoder / easy: abc314_b Roulette (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RouletteFewestBets case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:1: Expected '(' to declare a function or '=' to declare a global variable after 'N C_1', found 'A_'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 271 OUT1 560
–
LcbRoulettesExpectedLiveCodeBench / atcoder / hard: abc314_e Roulettes (Pattern B, stdin) FLAG: float output (expected value); exact-string driver cannot do tolerance -> SkipTest.0 AI queries 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# stdin driver: float/expected-value output needs tolerance comparison; exact string compare unsafe
Skipped IN0 OUT0
×
LcbStrongestProgrammerLiveCodeBench / atcoder / medium: abc313_b Who is Saikyo? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StrongestProgrammer case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 26:40: Expected '>' to close the List type, found '['. Values: run.Compiled = false
Failed IN9 250 OUT2 084
Code Generation - LiveCodeBench v1 Codeforces (set 1) 2 passed7 failed
22.2%
IN83 336 OUT15 844
×
LcbChemistryPalindromeLiveCodeBench / codeforces 1883_B / medium: Chemistry (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ChemistryPalindrome case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 31:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 252 OUT2 238
×
LcbGameWithIntegersLiveCodeBench / codeforces 1899_A / easy: Game with Integers (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 257 OUT2 625
×
LcbGoodKidLiveCodeBench / codeforces 1873_B / easy: Good Kid (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: GoodKid case0 runtime error: Cannot parse '2 2 1 2' as long. Values: run.Success = false
Failed IN9 246 OUT835
✓
LcbOneDEraserLiveCodeBench / codeforces 1873_D / easy: 1D Eraser (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
Passed IN9 242 OUT642
×
LcbRaspberriesLiveCodeBench / codeforces 1883_C / medium: Raspberries (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 250 OUT2 499
×
LcbShortSortLiveCodeBench / codeforces 1873_A / easy: Short Sort (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 229 OUT825
×
LcbTruckWeightDifferenceLiveCodeBench / codeforces 1899_B / hard: 250 Thousand Tons of TNT (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: TruckWeightDifference case0 runtime error: Cannot parse '1 2' as long. Values: run.Success = false
Failed IN9 308 OUT2 589
✓
LcbYarikArrayAltParityLiveCodeBench / codeforces 1899_C / hard: Yarik and Array (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench
Passed IN9 270 OUT1 728
×
LcbYarikMusicalNotesLiveCodeBench / codeforces 1899_D / hard: Yarik and Musical Notes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@Codeforceslevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: YarikMusicalNotes case0 runtime error: Cannot parse '3 1 3 2' as long. Values: run.Success = false
Failed IN9 282 OUT1 863
Code Generation - LiveCodeBench v1 LeetCode (set 1) 4 passed5 failed
44.4%
IN82 636 OUT12 727
✓
LcbBuyChocoLiveCodeBench / leetcode / easy: buy-two-chocolates (LCB 2756)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 158 OUT165
✓
LcbColorTheArrayLiveCodeBench / leetcode / medium: number-of-adjacent-elements-with-the-same-color (LCB 2779)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 235 OUT1 445
×
LcbCountOfIntegersLiveCodeBench / leetcode / hard: count-of-integers (LCB 2757)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: count case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 15:32: Expected ')' to close the StringBuilder constructor. Use 'new StringBuilder()'., found 'n'. Values: run.Compiled = false
Failed IN9 202 OUT4 876
✓
LcbCountSeniorsLiveCodeBench / leetcode / easy: number-of-senior-citizens (LCB 2727)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 238 OUT87
×
LcbDistinctDifferenceArrayLiveCodeBench / leetcode / easy: find-the-distinct-difference-array (LCB 2777)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: distinctDifference case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 23:23: Unknown function 'Range'. Values: run.Compiled = false
Failed IN9 179 OUT1 122
✓
LcbMatrixSumLiveCodeBench / leetcode / medium: sum-in-a-matrix (LCB 2728)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 153 OUT914
×
LcbMaximumOrLiveCodeBench / leetcode / medium: maximum-or (LCB 2730)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maximumOr case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:5: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 20:12: Unknown variable 'j'. 23:37: Unknown variable 'j'. 24:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 24:9: Unknown variable 'j'. 33:5: Unknown variable 'm'. Declare it first, e.g. 'int m = ...;'. 34:12: Unknown variable 'm'. 37:13: Unknown variable 'm'. 37:42: Unknown variable 'm'. 38:13: Unknown variable 'm'. 38:46: Unknown variable 'm'. 40:49: Unknown variable 'm'. 42:9: Unknown variable 'm'. Declare it first, e.g. 'int m = ...;'. 42:9: Unknown variable 'm'. Values: run.Compiled = false
Failed IN9 165 OUT1 624
×
LcbMaxStrengthLiveCodeBench / leetcode / medium: maximum-strength-of-a-group (LCB 2754)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxStrength case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'foreach'. Values: run.Compiled = false
Failed IN9 144 OUT2 034
×
LcbMinExtraCharLiveCodeBench / leetcode / medium: extra-characters-in-a-string (LCB 2755)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minExtraChar case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 162 OUT460
Code Generation - LiveCodeBench v1 LeetCode (set 10) 4 passed5 failed
44.4%
IN83 020 OUT28 431
✓
LcbCanBeEqualSwapLiveCodeBench / leetcode / easy: check-if-strings-can-be-made-equal-with-operations-i (id 2999)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 184 OUT1 321
✓
LcbCanMakeSubsequenceCyclicLiveCodeBench / leetcode / medium: make-string-a-subsequence-using-cyclic-increments (id 3018)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 249 OUT911
×
LcbConstructProductMatrixLiveCodeBench / leetcode / medium: construct-product-matrix (id 3031)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<List<List<int>>>(run.ResultJson) == FromJson<List<List<int>>>(expected[i]) Context: constructProduct case0: expected [[24, 12], [8, 6]] got [[2649,5298],[7947,10596]]
Failed IN9 198 OUT580
✓
LcbFurthestDistanceFromOriginLiveCodeBench / leetcode / easy: furthest-point-from-origin (id 3019)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 196 OUT195
×
LcbMaxBallPassingValueLiveCodeBench / leetcode / hard: maximize-value-of-function-in-a-ball-passing-game (id 3032)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxBallPassing case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 51:17: Unknown variable 'Long'. Values: run.Compiled = false
Failed IN9 310 OUT5 524
✓
LcbMinAbsoluteDifferenceApartLiveCodeBench / leetcode / medium: minimum-absolute-difference-between-elements-with-constraint (id 3000)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 206 OUT2 487
×
LcbMinOperationsSubsequenceSumLiveCodeBench / leetcode / hard: minimum-operations-to-form-subsequence-with-target-sum (id 3025)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minOpsSubseqSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:12: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 263 OUT5 020
×
LcbNumberOfBeautifulIntegersLiveCodeBench / leetcode / hard: number-of-beautiful-integers-in-the-range (id 3017)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: numBeautiful case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:5: Function 'numberOfBeautifulIntegers' must return 'int', but this return statement has type 'long'. 33:19: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. 34:50: Cannot call method 'GetValueOrDefault' on nullable type 'long?'. Check it with '!= null' first. Values: run.Compiled = false
Failed IN9 184 OUT6 533
×
LcbStringTransformationWaysLiveCodeBench / leetcode / hard: string-transformation (id 3024)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: stringTransform case0: expected 2 got 8
Failed IN9 230 OUT5 860
Code Generation - LiveCodeBench v1 LeetCode (set 11) 5 passed4 failed
55.6%
IN82 747 OUT21 885
×
LcbMaximumCompleteSubsetSumLiveCodeBench / leetcode / hard: maximum-element-sum-of-a-complete-subset-of-indices (id 3047)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxCompleteSubset case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:8: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 236 OUT5 129
×
LcbMaximumOddBinaryNumberLiveCodeBench / leetcode / easy: maximum-odd-binary-number (id 3055)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxOddBinary case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:5: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 29:12: Unknown variable 'j'. 32:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 32:9: Unknown variable 'j'. Values: run.Compiled = false
Failed IN9 152 OUT1 096
✓
LcbMinArrayLengthAfterRemovalsLiveCodeBench / leetcode / medium: minimum-array-length-after-pair-removals (id 3081)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 210 OUT2 552
×
LcbMinCostMakeStringsEqualLiveCodeBench / leetcode / medium: apply-operations-to-make-two-strings-equal (id 3033)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minCostEqual case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 283 OUT8 248
✓
LcbMinimumRightShiftsLiveCodeBench / leetcode / easy: minimum-right-shifts-to-sort-the-array (id 3045)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 161 OUT175
✓
LcbMinOperationsCollectElementsLiveCodeBench / leetcode / easy: minimum-operations-to-collect-elements (id 3044)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 172 OUT189
×
LcbMinOperationsSpecialNumberLiveCodeBench / leetcode / medium: minimum-operations-to-make-a-special-number (id 3046)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minOpsSpecial case1: expected 3 got 4
Failed IN9 160 OUT264
✓
LcbNumberOfPointsCarsLiveCodeBench / leetcode / easy: points-that-intersect-with-cars (id 3034)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 171 OUT961
✓
LcbSplitArrayMaxSubarraysLiveCodeBench / leetcode / medium: split-array-into-maximum-number-of-subarrays (id 3080)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 202 OUT3 271
Code Generation - LiveCodeBench v1 LeetCode (set 12) 2 passed6 failed
25.0%
IN73 740 OUT49 614
×
LcbBeautifulTowersMaxSumLiveCodeBench / leetcode / medium: beautiful-towers-i (id 3114)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: beautifulTowers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:7: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 266 OUT11 103
×
LcbCountSubMultisetsBoundedSumLiveCodeBench / leetcode / hard: count-of-sub-multisets-with-bounded-sum (id 3091)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countSubMultisets case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:24: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 293 OUT3 201
×
LcbCountWaysHappyStudentsLiveCodeBench / leetcode / medium: happy-students (id 3104)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countWaysHappy case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:23: Unknown function 'Range'. 1:5: Not all code paths in function 'countWays' return a value. Values: run.Compiled = false
Failed IN9 202 OUT3 549
×
LcbLongestSubsequenceSumTargetLiveCodeBench / leetcode / medium: length-of-the-longest-subsequence-that-sums-to-target (id 3106)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestSubseqSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 202 OUT458
✓
LcbMinOperationsMakeArrayEmptyLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-array-empty (id 3094)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 177 OUT759
×
LcbMinSizeSubarrayInfiniteLiveCodeBench / leetcode / medium: minimum-size-subarray-in-infinite-array (id 3141)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minSizeSubarray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:16: Unknown function 'shortestSubarray'. 28:5: Cannot assign a value of type 'double' to variable 'q' of type 'long'. 38:19: Unknown function 'shortestSubarray'. Values: run.Compiled = false
Failed IN9 183 OUT29 364
×
LcbShortestBeautifulSubstringLiveCodeBench / leetcode / medium: shortest-and-lexicographically-smallest-beautiful-string (id 3150)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: shortestBeautiful case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 23:5: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 24:12: Unknown variable 'j'. 26:36: Unknown variable 'j'. 27:34: Unknown variable 'j'. 33:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 33:9: Unknown variable 'j'. 37:5: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 38:12: Unknown variable 'j'. 40:36: Unknown variable 'j'. 41:34: Unknown variable 'j'. 51:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 51:9: Unknown variable 'j'. Values: run.Compiled = false
Failed IN9 227 OUT363
✓
LcbSumIndicesKSetBitsLiveCodeBench / leetcode / easy: sum-of-values-at-indices-with-k-set-bits (id 3093)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 190 OUT817
Code Generation - LiveCodeBench v1 LeetCode (set 13) 5 passed4 failed
55.6%
IN82 352 OUT14 013
✓
LcbDivisibleSumsDifferenceLiveCodeBench / leetcode / easy: 3172 divisible-and-non-divisible-sums-difference (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 118 OUT758
✓
LcbLastVisitedIntegersLiveCodeBench / leetcode / easy: 3164 last-visited-integers (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 202 OUT961
×
LcbMaxOrderedTripletValueLiveCodeBench / leetcode / easy: 3154 maximum-value-of-an-ordered-triplet-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxOrderedTripletValue case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:43: Cannot assign a value of type 'long' to variable 'runningMax' of type 'int'. 20:43: Cannot assign a value of type 'long' to variable 'runningMax' of type 'int'. Values: run.Compiled = false
Failed IN9 131 OUT2 597
×
LcbMaxSumOfSquaresLiveCodeBench / leetcode / hard: 3153 apply-operations-on-array-to-maximize-sum-of-squares (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxSumOfSquares case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:8: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 188 OUT2 697
✓
LcbMinChangesBinaryBeautifulLiveCodeBench / leetcode / medium: 3174 minimum-number-of-changes-to-make-binary-string-beautiful (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 124 OUT83
×
LcbMinEqualSumReplaceZerosLiveCodeBench / leetcode / medium: 3171 minimum-equal-sum-of-two-arrays-after-replacing-zeros (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinEqualSumReplaceZeros case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 70:12: Unknown function 'max'. Values: run.Compiled = false
Failed IN9 121 OUT1 568
✓
LcbMinGroupsValidAssignmentLiveCodeBench / leetcode / medium: 3166 minimum-number-of-groups-to-create-a-valid-assignment (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 153 OUT2 480
✓
LcbMinProcessingTimeLiveCodeBench / leetcode / medium: 3151 minimum-processing-time (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 193 OUT1 144
×
LcbSumDistinctSquaresLiveCodeBench / leetcode / easy: 3163 subarrays-distinct-element-sum-of-squares-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SumDistinctSquares case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'for'. Values: run.Compiled = false
Failed IN9 122 OUT1 725
Code Generation - LiveCodeBench v1 LeetCode (set 14) 6 passed3 failed
66.7%
IN82 225 OUT13 573
×
LcbFindChampionILiveCodeBench / leetcode / easy: 3188 find-champion-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: FindChampionI case0: expected 0 got 1
Failed IN9 150 OUT88
✓
LcbFindKOrLiveCodeBench / leetcode / easy: 3183 find-the-k-or-of-an-array (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 141 OUT129
✓
LcbFindWordsContainingLiveCodeBench / leetcode / easy: 3194 find-words-containing-character (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 098 OUT150
×
LcbMaxBalancedSubseqSumLiveCodeBench / leetcode / hard: 3184 maximum-balanced-subsequence-sum (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxBalancedSubseqSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 30:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 159 OUT4 345
×
LcbMaximumXorProductLiveCodeBench / leetcode / medium: 3192 maximum-xor-product (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: MaximumXorProduct case0: expected 98 got 4
Failed IN9 121 OUT5 222
✓
LcbMaxStrongPairXorLiveCodeBench / leetcode / easy: 3193 maximum-strong-pair-xor-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 149 OUT234
✓
LcbMinMountainTripletSumLiveCodeBench / leetcode / easy: 3176 minimum-sum-of-mountain-triplets-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 118 OUT326
✓
LcbMinOpsMaximizeLastLiveCodeBench / leetcode / medium: 3190 minimum-operations-to-maximize-last-elements-in-arrays (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 164 OUT1 651
✓
LcbSeparateBlackWhiteBallsLiveCodeBench / leetcode / medium: 3195 separate-black-and-white-balls (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 125 OUT1 428
Code Generation - LiveCodeBench v1 LeetCode (set 15) 5 passed3 failed
62.5%
IN73 170 OUT24 772
×
LcbCountBeautifulSubstringsLiveCodeBench / leetcode / medium: 3210 count-beautiful-substrings-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountBeautifulSubstrings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:36: Expected '(' after the HashSet type. Hash sets are created with 'new HashSet<T>()', found '{'. Values: run.Compiled = false
Failed IN9 145 OUT839
✓
LcbDistributeCandiesILiveCodeBench / leetcode / easy: 3199 distribute-candies-among-children-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 086 OUT438
✓
LcbFindCommonElementsLiveCodeBench / leetcode / easy: 3206 find-common-elements-between-two-arrays (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 161 OUT235
✓
LcbGoodStringsLeetLiveCodeBench / leetcode / medium: 3200 number-of-strings-which-can-be-rearranged-to-contain-substring (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 117 OUT3 235
✓
LcbMakeThreeStringsEqualLiveCodeBench / leetcode / easy: 3207 make-three-strings-equal (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 148 OUT2 051
✓
LcbMaxFrequencyScoreLiveCodeBench / leetcode / hard: 3196 apply-operations-to-maximize-frequency-score (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 129 OUT4 235
×
LcbMinCoinsForFruitsLiveCodeBench / leetcode / medium: 3209 minimum-number-of-coins-for-fruits (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MinCoinsForFruits case0 runtime error: List index 4 is out of range. The list has 4 element(s). Values: run.Success = false
Failed IN9 150 OUT1 912
×
LcbPalindromeRearrangeQueriesLiveCodeBench / leetcode / hard: 3203 palindrome-rearrangement-queries (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<List<bool>>(run.ResultJson) == FromJson<List<bool>>(expected[i]) Context: PalindromeRearrangeQueries case2: expected [true] got [false]
Failed IN9 234 OUT11 827
Code Generation - LiveCodeBench v1 LeetCode (set 16) 2 passed7 failed
22.2%
IN82 354 OUT22 744
×
LcbCompleteSubstringsLiveCodeBench / leetcode / hard: count-complete-substrings (id 3223)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: completeSub case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 54:25: Type 'Dictionary<char, int>' has no supported method named 'Add' with 2 argument(s). 81:25: Type 'Dictionary<char, int>' has no supported method named 'Add' with 2 argument(s). 97:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 145 OUT2 895
×
LcbCountTestedDevicesLiveCodeBench / leetcode / easy: count-tested-devices-after-test-operations (id 3220)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: testedDev case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 192 OUT1 692
×
LcbFindPeaksLiveCodeBench / leetcode / easy: find-the-peaks (id 3221)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: findPeaks case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '{'. Values: run.Compiled = false
Failed IN9 117 OUT943
✓
LcbGoodPartitionsCountLiveCodeBench / leetcode / hard: count-the-number-of-good-partitions (id 3212)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 118 OUT2 745
×
LcbInfectionSequencesLiveCodeBench / leetcode / hard: count-the-number-of-infection-sequences (id 3224)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: infectionSeq case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 31:9: Variable 'MOD' is already declared in this scope or an enclosing one. Values: run.Compiled = false
Failed IN9 217 OUT4 772
×
LcbLexSmallestSwapLiveCodeBench / leetcode / medium: make-lexicographically-smallest-array-by-swapping-elements (id 3219)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: lexSwap case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 58:13: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 174 OUT3 409
×
LcbLongestSubarrayKFreqLiveCodeBench / leetcode / medium: length-of-longest-subarray-with-at-most-k-frequency (id 3225)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestKFreq case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:14: Operator '==' cannot compare 'List<int>' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. 21:17: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
Failed IN9 133 OUT236
✓
LcbMaxNonDecreasingLengthLiveCodeBench / leetcode / hard: find-maximum-non-decreasing-array-length (id 3211)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 157 OUT3 759
×
LcbSubarraysMaxKTimesLiveCodeBench / leetcode / medium: count-subarrays-where-max-element-appears-at-least-k-times (id 3213)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: subMaxK case0: expected 6 got 2
Failed IN9 101 OUT2 293
Code Generation - LiveCodeBench v1 LeetCode (set 17) 3 passed6 failed
33.3%
IN82 456 OUT65 123
✓
LcbDoubleModExpLiveCodeBench / leetcode / medium: double-modular-exponentiation (id 3234)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 150 OUT2 007
✓
LcbEqualindromicCostLiveCodeBench / leetcode / medium: minimum-cost-to-make-array-equalindromic (id 3229)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 202 OUT5 991
×
LcbMaxPartitionsOpsLiveCodeBench / leetcode / hard: maximize-the-number-of-partitions-after-operations (id 3233)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxPartOps case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 68:9: Expected ';' after the statement, found ','. Values: run.Compiled = false
Failed IN9 166 OUT47 170
×
LcbMaxSetSizeRemovalsLiveCodeBench / leetcode / medium: maximum-size-of-a-set-after-removals (id 3228)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxSetSize case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:17: Type 'HashSet<int>' has no supported method named 'IntersectWith' with 1 argument(s). Values: run.Compiled = false
Failed IN9 131 OUT3 259
×
LcbMinCoinsToAddLiveCodeBench / leetcode / medium: minimum-number-of-coins-to-be-added (id 3231)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minCoins case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:41: Unexpected character '`'. 6:51: Unexpected character '`'. 6:104: Char literals must contain exactly one character and close with '''. 8:74: Char literals must contain exactly one character and close with '''. 11:48: Unexpected character '`'. 11:50: Unexpected character '`'. 12:9: Unexpected character '`'. 12:24: Unexpected character '`'. 12:154: Unexpected character '`'. 12:156: Unexpected character '`'. 12:207: Unexpected character '`'. 12:222: Unexpected character '`'. 12:267: Unexpected character '`'. 12:282: Unexpected character '`'. 13:9: Unexpected character '`'. 13:23: Unexpected character '`'. 13:73: Unexpected character '`'. 13:83: Unexpected character '`'. 13:106: Unexpected character '`'. 13:116: Unexpected character '`'. 13:161: Unexpected character '`'. 13:171: Unexpected character '`'. 13:216: Unexpected character '`'. 13:231: Unexpected character '`'. 13:322: Unexpected character '`'. 13:337: Unexpected character '`'. 13:370: Unexpected character '`'. 13:372: Unexpected character '`'. 17:14: Unexpected character '`'. 17:28: Unexpected character '`'. 20:9: Unexpected character '`'. 20:29: Unexpected character '`'. 21:38: Unexpected character '`'. 21:64: Unexpected character '`'. 22:26: Unexpected character '`'. 22:52: Unexpected character '`'. 24:38: Unexpected character '`'. 24:48: Unexpected character '`'. 25:7: Unexpected character '`'. 25:30: Unexpected character '`'. 25:39: Unexpected character '`'. 25:54: Unexpected character '`'. 28:40: Char literals must contain exactly one character and close with '''. 28:104: Unexpected character '`'. 28:114: Unexpected character '`'. 28:128: Unexpected character '—'. 28:162: Unexpected character '`'. 28:172: Unexpected character '`'. 28:203: Unexpected character '`'. 28:213: Unexpected character '`'. 40:40: Unexpected character '✓'. 55:30: Unexpected character '✓'. 59:32: Unexpected character '#'. Values: run.Compiled = false
Failed IN9 163 OUT2 751
×
LcbMinCostConvertStringLiveCodeBench / leetcode / medium: minimum-cost-to-convert-string-i (id 3235)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minCostConvert case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:15: Variable 'INF' has type 'int' but its initializer has type 'long'. Values: run.Compiled = false
Failed IN9 234 OUT2 217
✓
LcbMinimumNumberGameLiveCodeBench / leetcode / easy: minimum-number-game (id 3226)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 139 OUT624
×
LcbMissingAndRepeatedLiveCodeBench / leetcode / easy: find-missing-and-repeated-values (id 3227)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: missingRepeated case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:21: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). 24:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 153 OUT876
×
LcbRemoveAlmostEqualLiveCodeBench / leetcode / medium: remove-adjacent-almost-equal-characters (id 3230)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: removeAlmost case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:14: Operator '==' cannot compare 'string' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. Values: run.Compiled = false
Failed IN9 118 OUT228
Code Generation - LiveCodeBench v1 LeetCode (set 18) 5 passed3 failed
62.5%
IN73 246 OUT20 496
✓
LcbBeautifulIndicesLiveCodeBench / leetcode / medium: find-beautiful-indices-in-the-given-array-i (id 3245)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 174 OUT2 164
×
LcbBitwiseOrTrailingZerosLiveCodeBench / leetcode / easy: check-if-bitwise-or-has-trailing-zeros (id 3246)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<bool>(run.ResultJson) == FromJson<bool>(expected[i]) Context: trailingZeros case2: expected false got true
Failed IN9 159 OUT105
✓
LcbMaxFrequencyElementsLiveCodeBench / leetcode / easy: count-elements-with-maximum-frequency (id 3242)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 093 OUT378
×
LcbMaxNumberPricesSumLiveCodeBench / leetcode / medium: maximum-number-that-sum-of-the-prices-is-less-than-or-equal-to-k (id 3240)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: maxNumberPrices case0: expected 6 got 7
Failed IN9 193 OUT2 763
✓
LcbMinArrayLengthModLiveCodeBench / leetcode / medium: minimize-length-of-array-using-operations (id 3244)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 156 OUT4 311
✓
LcbMinOpsXYEqualLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-x-and-y-equal (id 3239)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 133 OUT8 778
×
LcbMissingSeqPrefixSumLiveCodeBench / leetcode / easy: smallest-missing-integer-greater-than-sequential-prefix-sum (id 3236)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: missingSeq case0: expected 6 got 8
Failed IN9 132 OUT299
✓
LcbPowerfulIntegersLiveCodeBench / leetcode / hard: count-the-number-of-powerful-integers (id 3243)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 206 OUT1 698
Code Generation - LiveCodeBench v1 LeetCode (set 19) 4 passed5 failed
44.4%
IN82 287 OUT33 478
✓
LcbAreaOfMaxDiagonalLiveCodeBench / leetcode / easy: maximum-area-of-longest-diagonal-rectangle (id 3251)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 130 OUT208
✓
LcbCountMatchingSubarraysLiveCodeBench / leetcode / medium: number-of-subarrays-that-match-a-pattern-i (id 3269)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 203 OUT1 225
×
LcbIncremovableSubarrayCountLiveCodeBench / leetcode / easy: count-the-number-of-incremovable-subarrays-i (id 3252)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: incremovable case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'incremovableSubarrayCount' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, incremovableSubbarayCount. Values: run.Compiled = false
Failed IN9 123 OUT8 392
×
LcbLargestPerimeterLiveCodeBench / leetcode / medium: find-polygon-with-the-largest-perimeter (id 3262)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: largestPerimeter case1: expected 12 got -1
Failed IN9 189 OUT265
×
LcbLongestSpecialThriceLiveCodeBench / leetcode / medium: find-longest-special-substring-that-occurs-thrice-i (id 3267)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestSpecial case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 48:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 117 OUT2 405
×
LcbMaximumGoodSubarraySumLiveCodeBench / leetcode / medium: maximum-good-subarray-sum (id 3265)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxGoodSub case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 134 OUT2 059
✓
LcbMinimumCostThreeSubarraysLiveCodeBench / leetcode / easy: divide-an-array-into-subarrays-with-minimum-cost-i (id 3263)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 098 OUT1 677
✓
LcbMinOpsXorEqualKLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-array-xor-equal-to-k (id 3249)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 141 OUT1 067
×
LcbMinOrAfterOperationsLiveCodeBench / leetcode / hard: minimize-or-of-remaining-elements-using-operations (id 3261)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minOr case0: expected 3 got 0
Failed IN9 152 OUT16 180
Code Generation - LiveCodeBench v1 LeetCode (set 2) 7 passed2 failed
77.8%
IN82 512 OUT15 277
✓
LcbCircularGameLosersLiveCodeBench / leetcode / easy: find-the-losers-of-the-circular-game (LCB 2791)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 186 OUT1 438
✓
LcbCollectingChocolatesLiveCodeBench / leetcode / medium: collecting-chocolates (LCB 2810)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 184 OUT2 590
✓
LcbLongestSemiRepetitiveLiveCodeBench / leetcode / medium: find-the-longest-semi-repetitive-substring (LCB 2786)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 161 OUT1 278
✓
LcbMinLengthRemoveSubstrLiveCodeBench / leetcode / easy: minimum-string-length-after-removing-substrings (LCB 2800)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 129 OUT1 248
✓
LcbNeighboringXorLiveCodeBench / leetcode / medium: neighboring-bitwise-xor (LCB 2792)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 189 OUT832
×
LcbPaintWallsLiveCodeBench / leetcode / hard: painting-the-walls (LCB 2808)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: paintWalls case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'for'. Values: run.Compiled = false
Failed IN9 195 OUT3 052
×
LcbPowerOfHeroesLiveCodeBench / leetcode / hard: power-of-heroes (LCB 2784)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: sumOfPower case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:9: Expected a name, found '.'. Values: run.Compiled = false
Failed IN9 156 OUT2 190
✓
LcbPunishmentNumberLiveCodeBench / leetcode / medium: find-the-punishment-number-of-an-integer (LCB 2802)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 149 OUT764
✓
LcbSemiOrderedPermutationLiveCodeBench / leetcode / easy: semi-ordered-permutation (LCB 2785)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 163 OUT1 885
Code Generation - LiveCodeBench v1 LeetCode (set 20) 2 passed5 failed1 broken
25.0%
IN73 165 OUT89 428
×
LcbCanSortArrayBySetBitsLiveCodeBench / leetcode / medium: find-if-array-can-be-sorted (id 3291)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: canSort case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 40:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 46:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 13:6: Not all code paths in function 'canSortArray' return a value. Values: run.Compiled = false
Failed IN9 117 OUT2 226
✓
LcbCountPrefixSuffixPairsLiveCodeBench / leetcode / easy: count-prefix-and-suffix-pairs-i (id 3309)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 133 OUT170
×
LcbEarliestSecondToMarkLiveCodeBench / leetcode / medium: earliest-second-to-mark-indices-i (id 3292)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: earliestSecond case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 35:50: Expected '>' to close the List type, found '<'. Values: run.Compiled = false
Failed IN9 194 OUT8 596
✓
LcbFlowerGameLiveCodeBench / leetcode / medium: alice-and-bob-playing-flower-game (id 3279)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 149 OUT1 613
×
LcbLastNonEmptyStringLiveCodeBench / leetcode / medium: apply-operations-to-make-string-empty (id 3308)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson) == FromJson<string>(expected[i]) Context: lastNonEmpty case0: expected "ba" got "ab"
Failed IN9 101 OUT2 189
!
LcbMaxSelectedConsecutiveLiveCodeBench / leetcode / hard: maximize-consecutive-elements-in-an-array-after-modification (id 3298)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 148 OUT62 144
×
LcbMaxSubsetPowerPatternLiveCodeBench / leetcode / medium: find-the-maximum-number-of-elements-in-subset (id 3299)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxSubsetPower case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 195 OUT7 942
×
LcbMinTimeRevertWordLiveCodeBench / leetcode / medium: minimum-time-to-revert-word-to-initial-state-i (id 3297)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minTimeRevert case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Not all code paths in function 'minimumTimeToInitialState' return a value. Values: run.Compiled = false
Failed IN9 128 OUT4 548
Code Generation - LiveCodeBench v1 LeetCode (set 21) 4 passed4 failed
50.0%
IN73 182 OUT7 812
✓
LcbAntOnBoundaryLiveCodeBench / leetcode / easy: ant-on-the-boundary (id 3311)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 156 OUT101
×
LcbCountKeyChangesLiveCodeBench / leetcode / easy: number-of-changing-keys (id 3312)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countKeyChanges case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:25: Type 'char' has no supported method named 'ToLower'. 9:29: Type 'char' has no supported method named 'ToLower'. Values: run.Compiled = false
Failed IN9 126 OUT113
×
LcbDistributeTwoArraysLiveCodeBench / leetcode / easy: distribute-elements-into-two-arrays-i (id 3347)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: distributeTwo case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:9: Expected a name, found '.'. Values: run.Compiled = false
Failed IN9 180 OUT1 113
✓
LcbLongestCommonPrefixDigitsLiveCodeBench / leetcode / medium: find-the-length-of-the-longest-common-prefix (id 3329)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 192 OUT379
✓
LcbMaxOperationsSameScoreLiveCodeBench / leetcode / easy: maximum-number-of-operations-with-the-same-score-i (id 3320)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 126 OUT3 498
×
LcbMaxPalindromesAfterOpsLiveCodeBench / leetcode / medium: maximum-palindromes-after-operations (id 3317)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: maxPalindromes case0: expected 3 got 4
Failed IN9 169 OUT1 970
✓
LcbMinOpsExceedThresholdLiveCodeBench / leetcode / easy: minimum-operations-to-exceed-threshold-value-i (id 3331)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 109 OUT397
×
LcbSplitArrayDistinctLiveCodeBench / leetcode / easy: split-the-array (id 3324)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: splitArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:17: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
Failed IN9 124 OUT241
Code Generation - LiveCodeBench v1 LeetCode (set 3) 3 passed5 failed
37.5%
IN73 151 OUT31 738
×
LcbGcdTraversalLiveCodeBench / leetcode / hard: greatest-common-divisor-traversal (LCB 2827)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: canTraverseAllPairs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 43:33: Unknown function 'Find'. 44:33: Unknown function 'Find'. 68:29: Unknown function 'Find'. 69:29: Unknown function 'Find'. 83:16: Unknown function 'Find'. 86:13: Unknown function 'Find'. Values: run.Compiled = false
Failed IN9 171 OUT3 382
×
LcbIsFascinatingLiveCodeBench / leetcode / easy: check-if-the-number-is-fascinating (LCB 2824)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: isFascinating case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:15: Expected ';' after the variable declaration, found ','. Values: run.Compiled = false
Failed IN9 138 OUT1 029
✓
LcbKAvoidingArrayLiveCodeBench / leetcode / medium: determine-the-minimum-sum-of-a-k-avoiding-array (LCB 2811)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 125 OUT2 406
✓
LcbMaxAchievableNumberLiveCodeBench / leetcode / easy: find-the-maximum-achievable-number (LCB 2812)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 139 OUT884
×
LcbMinCostEqualCharsLiveCodeBench / leetcode / medium: minimum-cost-to-make-all-characters-equal (LCB 2817)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimumCost case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 167 OUT21 238
✓
LcbMinimizeStringLengthLiveCodeBench / leetcode / easy: minimize-string-length (LCB 2825)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 156 OUT1 615
×
LcbRemoveTrailingZerosLiveCodeBench / leetcode / easy: remove-trailing-zeros-from-a-string (LCB 2819)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: removeTrailingZeros case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'removeTrailingZeros' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, RemoveTrailingZeros. Values: run.Compiled = false
Failed IN9 109 OUT85
×
LcbSmallestPalindromeLiveCodeBench / leetcode / easy: lexicographically-smallest-palindrome (LCB 2816)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: makeSmallestPalindrome case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '{'. Values: run.Compiled = false
Failed IN9 146 OUT1 099
Code Generation - LiveCodeBench v1 LeetCode (set 4) 4 passed5 failed
44.4%
IN83 007 OUT21 952
✓
LcbBeautifulPairsLiveCodeBench / leetcode / easy: number-of-beautiful-pairs (id 2831)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 191 OUT312
×
LcbCountZeroRequestServersLiveCodeBench / leetcode / medium: count-zero-request-servers (id 2833)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countServers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:35: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 290 OUT4 694
×
LcbLongestEqualSubarrayLiveCodeBench / leetcode / medium: find-the-longest-equal-subarray (id 2832)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestEqualSubarray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 195 OUT1 751
✓
LcbMakeIntegerZeroLiveCodeBench / leetcode / medium: minimum-operations-to-make-the-integer-zero (id 2837)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 182 OUT6 375
×
LcbMaximumSumQueriesLiveCodeBench / leetcode / hard: maximum-sum-queries (id 2839)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maximumSumQueries case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 38:23: Unknown comparator function 'CompareQueryXDescending'. 57:24: Unknown function 'BinarySearch'. 77:22: Unknown function 'LowerBound'. 81:24: Unknown function 'QueryRangeMax'. 97:9: Unknown variable 'nums1_global'. 97:27: Unknown variable 'nums1_global'. 98:9: Unknown variable 'nums1_global'. 98:27: Unknown variable 'nums1_global'. Values: run.Compiled = false
Failed IN9 342 OUT6 092
✓
LcbRelocateMarblesLiveCodeBench / leetcode / medium: relocate-marbles (id 2834)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 268 OUT886
×
LcbSmallestStringOpLiveCodeBench / leetcode / medium: lexicographically-smallest-string-after-substring-operation (id 2828)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: smallestString case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:14: Cannot assign a value of type 'int' to an element of type 'char'. 28:18: Cannot assign a value of type 'int' to an element of type 'char'. Values: run.Compiled = false
Failed IN9 207 OUT244
×
LcbSumOfSquaresSpecialLiveCodeBench / leetcode / easy: sum-of-squares-of-special-elements (id 2844)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: sumOfSquares case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 156 OUT905
✓
LcbValueOfPartitionLiveCodeBench / leetcode / medium: find-the-value-of-the-partition (id 2845)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 176 OUT693
Code Generation - LiveCodeBench v1 LeetCode (set 5) 6 passed3 failed
66.7%
IN82 916 OUT41 632
✓
LcbCountCompleteSubarraysLiveCodeBench / leetcode / medium: count-complete-subarrays-in-an-array (id 2856)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 161 OUT1 178
×
LcbDecrementalConcatLiveCodeBench / leetcode / medium: decremental-string-concatenation (id 2854)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimizeConcatenatedLength case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 58:24: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 273 OUT4 579
×
LcbLongestEvenOddThresholdLiveCodeBench / leetcode / easy: longest-even-odd-subarray-with-threshold (id 2866)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestEvenOdd case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:14: Operator '==' cannot compare 'List<int>' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. Values: run.Compiled = false
Failed IN9 245 OUT212
×
LcbLongestNewStringLiveCodeBench / leetcode / medium: construct-the-longest-new-string (id 2850)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestString case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 197 OUT19 423
✓
LcbMaximumJumpsLiveCodeBench / leetcode / medium: maximum-number-of-jumps-to-reach-the-last-index (id 2855)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 244 OUT4 022
✓
LcbMaxStringPairsLiveCodeBench / leetcode / easy: find-maximum-number-of-string-pairs (id 2847)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 195 OUT139
✓
LcbSpecialPermutationsLiveCodeBench / leetcode / medium: special-permutations (id 2848)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 178 OUT1 125
✓
LcbSumImbalanceNumbersLiveCodeBench / leetcode / hard: sum-of-imbalance-numbers-of-all-subarrays (id 2849)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 200 OUT10 849
✓
LcbTotalDistanceTraveledLiveCodeBench / leetcode / easy: total-distance-traveled (id 2857)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 223 OUT105
Code Generation - LiveCodeBench v1 LeetCode (set 6) 6 passed2 failed
75.0%
IN73 684 OUT21 898
✓
LcbContinuousSubarraysLiveCodeBench / leetcode / medium: continuous-subarrays (id 2868)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 186 OUT1 943
✓
LcbEmployeesMetTargetLiveCodeBench / leetcode / easy: number-of-employees-who-met-the-target (id 2876)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 200 OUT89
✓
LcbGoodSubarraySplitsLiveCodeBench / leetcode / medium: ways-to-split-array-into-good-subarrays (id 2867)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 181 OUT1 979
✓
LcbLongestAlternatingLiveCodeBench / leetcode / easy: longest-alternating-subarray (id 2870)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 265 OUT1 413
✓
LcbLongestNonDecreasingLiveCodeBench / leetcode / medium: longest-non-decreasing-subarray-from-two-arrays (id 2869)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 264 OUT2 493
✓
LcbMaxArrayValueMergeLiveCodeBench / leetcode / medium: largest-element-in-an-array-after-merge-operations (id 2872)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 193 OUT955
×
LcbPrimePairsSumLiveCodeBench / leetcode / medium: prime-pairs-with-target-sum (id 2873)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: findPrimePairs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'findPrimePairs' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, FindPrimePairs. Values: run.Compiled = false
Failed IN9 195 OUT283
×
LcbShortestThreeStringsLiveCodeBench / leetcode / medium: shortest-string-that-contains-three-strings (id 2877)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimumString case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:20: Unknown function 'MergeThree'. 15:20: Unknown function 'MergeThree'. 17:20: Unknown function 'MergeThree'. 19:20: Unknown function 'MergeThree'. 21:20: Unknown function 'MergeThree'. 23:20: Unknown function 'MergeThree'. 27:15: Type 'List<string>' has no supported method named 'SortByLengthThenLex' with 0 argument(s). Values: run.Compiled = false
Failed IN9 200 OUT12 743
Code Generation - LiveCodeBench v1 LeetCode (set 7) 5 passed4 failed
55.6%
IN82 444 OUT21 975
×
LcbCheckArrayZeroableLiveCodeBench / leetcode / medium: apply-operations-to-make-all-array-elements-equal-to-zero (id 2878)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CheckArrayZeroable case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:17: Expected '(' to declare a function or '=' to declare a global variable after 'Initialize diff', found 'as'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 155 OUT2 239
✓
LcbFaultyKeyboardLiveCodeBench / leetcode / easy: faulty-keyboard (id 2886)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 115 OUT492
✓
LcbLongestValidSubstringForbiddenLiveCodeBench / leetcode / hard: length-of-the-longest-valid-substring (id 2884)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 139 OUT3 150
×
LcbMinBeautifulSubstringsLiveCodeBench / leetcode / medium: partition-string-into-minimum-beautiful-substrings (id 2883)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinBeautifulSubstrings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:8: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 149 OUT3 920
×
LcbMinChangesKSemiPalindromesLiveCodeBench / leetcode / hard: minimum-changes-to-make-k-semi-palindromes (id 2879)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinChangesKSemiPalindromes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 94:50: Expected ')' to close the argument list, found 'c'. Values: run.Compiled = false
Failed IN9 178 OUT5 575
✓
LcbMinIndexValidSplitLiveCodeBench / leetcode / medium: minimum-index-of-a-valid-split (id 2888)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 213 OUT1 280
×
LcbSortVowelsInStringLiveCodeBench / leetcode / medium: sort-vowels-in-a-string (id 2887)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson) == FromJson<string>(expected[i]) Context: SortVowelsInString case0: expected "lEOtcede" got "lEetcOde"
Failed IN9 141 OUT984
✓
LcbSplitWordsBySeparatorLiveCodeBench / leetcode / easy: split-strings-by-separator (id 2881)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 179 OUT799
✓
LcbWaysSumOfPowersLiveCodeBench / leetcode / medium: ways-to-express-an-integer-as-sum-of-powers (id 2882)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 175 OUT3 536
Code Generation - LiveCodeBench v1 LeetCode (set 8) 6 passed3 failed
66.7%
IN82 568 OUT16 210
✓
LcbCanSplitArrayMLiveCodeBench / leetcode / medium: check-if-it-is-possible-to-split-array (id 2916)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 199 OUT1 208
×
LcbCountInterestingSubarraysLiveCodeBench / leetcode / medium: count-of-interesting-subarrays (id 2915)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: CountInterestingSubarrays case0: expected 3 got 0
Failed IN9 186 OUT3 491
✓
LcbCountPairsSumLessTargetLiveCodeBench / leetcode / easy: count-pairs-whose-sum-is-less-than-target (id 2917)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 146 OUT1 255
×
LcbIsArrayGoodLiveCodeBench / leetcode / easy: check-if-array-is-good (id 2892)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IsArrayGood case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:17: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
Failed IN9 194 OUT2 190
✓
LcbMaxBeautyAfterOpLiveCodeBench / leetcode / medium: maximum-beauty-of-an-array-after-applying-operation (id 2891)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 179 OUT421
✓
LcbMaxIncreasingGroupsLiveCodeBench / leetcode / hard: maximum-number-of-groups-with-increasing-length (id 2919)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 173 OUT1 309
✓
LcbMaxPairSumEqualDigitLiveCodeBench / leetcode / easy: max-pair-sum-in-an-array (id 2902)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 139 OUT282
✓
LcbMaxScoreVisitPositionsLiveCodeBench / leetcode / medium: visit-array-positions-to-maximize-score (id 2893)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 186 OUT4 144
×
LcbMinSecondsCircularEqualLiveCodeBench / leetcode / medium: minimum-seconds-to-equalize-a-circular-array (id 2920)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinSecondsCircularEqual case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 166 OUT1 910
Code Generation - LiveCodeBench v1 LeetCode (set 9) 4 passed4 failed
50.0%
IN73 483 OUT18 418
✓
LcbAccountBalanceRoundedLiveCodeBench / leetcode / easy: account-balance-after-rounded-purchase (id 2955)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 152 OUT943
×
LcbCountPairsDistanceKLiveCodeBench / leetcode / medium: count-pairs-of-points-with-distance-k (id 2953)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountPairsDistanceK case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:26: Operator '+' cannot be applied to 'string' and 'int'. It supports numbers and string/char concatenation. 25:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 42:31: Operator '+' cannot be applied to 'string' and 'int'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 206 OUT3 305
×
LcbCountSteppingNumbersLiveCodeBench / leetcode / hard: count-stepping-numbers-in-range (id 2921)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountSteppingNumbers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 158 OUT1 653
✓
LcbCountSymmetricIntegersLiveCodeBench / leetcode / easy: count-symmetric-integers (id 2998)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 151 OUT329
✓
LcbIsAcronymOfWordsLiveCodeBench / leetcode / easy: check-if-a-string-is-an-acronym-of-words (id 2977)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 165 OUT118
×
LcbMaximizeSalesmanProfitLiveCodeBench / leetcode / medium: maximize-the-profit-as-the-salesman (id 2979)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MaximizeSalesmanProfit case0 runtime error: List index 3 is out of range. The list has 3 element(s). Values: run.Success = false
Failed IN9 215 OUT404
✓
LcbMaxSumAlmostUniqueLiveCodeBench / leetcode / medium: maximum-sum-of-almost-unique-subarray (id 2954)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 210 OUT473
×
LcbMinTimeSumAtMostXLiveCodeBench / leetcode / hard: minimum-time-to-make-array-sum-at-most-x (id 2952)1 AI query 0 tool callscategory:CodeGenerationcategory:V1@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinTimeSumAtMostX case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:26: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 226 OUT11 193
Code Generation - LiveCodeBench v2 AtCoder (set 1) 2 passed6 failed
25.0%
IN73 816 OUT29 748
×
LcbABCSumQueryLiveCodeBench / atcoder abc344_c / medium: A+B+C (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 263 OUT842
✓
LcbCeilDivTenLiveCodeBench / atcoder abc345_b / easy: Integer Division Returns (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 149 OUT1 275
×
LcbDelimiterReverseLiveCodeBench / atcoder abc344_b / easy: Delimiter (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 196 OUT738
×
LcbGomamayoSequenceLiveCodeBench / atcoder abc346_d / medium: Gomamayo Sequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GomamayoSequence case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 259 OUT12 521
×
LcbInsertOrEraseLiveCodeBench / atcoder abc344_e / hard: Insert or Erase (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: InsertOrErase case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 50:21: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first. 67:21: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first. 73:28: Cannot call method 'GetValueOrDefault' on nullable type 'long?'. Check it with '!= null' first. 76:21: Cannot access field 'HasValue' on nullable type 'long?'. Check it with '!= null' first. 82:28: Cannot call method 'GetValueOrDefault' on nullable type 'long?'. Check it with '!= null' first. 93:16: Operator '!=' cannot compare 'long' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. 101:9: Cannot assign a value of type 'long?' to variable 'cur' of type 'long'. Values: run.Compiled = false
Failed IN9 251 OUT1 248
×
LcbSpoilerRemoveLiveCodeBench / atcoder abc344_a / easy: Spoiler (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SpoilerRemove case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:19: Expected '(' to declare a function or '=' to declare a global variable after 'int firstPipeIndex', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 151 OUT81
✓
LcbStringBagsLiveCodeBench / atcoder abc344_d / hard: String Bags (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 299 OUT2 183
×
LcbTilingGridLiveCodeBench / atcoder abc345_d / hard: Tiling (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TilingGrid case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:15: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 248 OUT10 860
Code Generation - LiveCodeBench v2 AtCoder (set 2) 2 passed5 failed
28.6%
IN64 489 OUT26 790
✓
LcbAdjacentProductLiveCodeBench / atcoder abc346_a / easy: Adjacent Product (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 174 OUT685
✓
LcbDivisibleQuotientsLiveCodeBench / atcoder abc347_a / easy: Divisible (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 184 OUT264
×
LcbIdealHolidaysLiveCodeBench / atcoder abc347_c / medium: Ideal Holidays (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: IdealHolidays case1: expected [No] got [Yes]
Failed IN9 220 OUT7 911
×
LcbPaintGridLiveCodeBench / atcoder abc346_e / hard: Paint (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PaintGrid case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 125:31: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 305 OUT9 854
×
LcbPianoSubstringLiveCodeBench / atcoder abc346_b / easy: Piano (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: PianoSubstring case1 runtime error: List index 25 is out of range. The list has 25 element(s). Values: run.Success = false
Failed IN9 190 OUT1 124
×
LcbSetAddQueryLiveCodeBench / atcoder abc347_e / hard: Set Add Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SetAddQuery case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 59:46: Expected ')' to close the argument list, found 'plist'. Values: run.Compiled = false
Failed IN9 249 OUT6 330
×
LcbSigmaMissingSumLiveCodeBench / atcoder abc346_c / medium: Sigma (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SigmaMissingSum case2 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
Failed IN9 167 OUT622
Code Generation - LiveCodeBench v2 AtCoder (set 3) 4 passed4 failed
50.0%
IN74 431 OUT16 391
✓
LcbAirportCodeLiveCodeBench / atcoder / abc349_c: Airport Code (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 292 OUT1 792
×
LcbColorfulBeansLiveCodeBench / atcoder / abc348_c: Colorful Beans (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ColorfulBeans case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 281 OUT843
✓
LcbDistinctSubstringsLiveCodeBench / atcoder / abc347_b: Substring (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 192 OUT615
×
LcbFarthestPointLiveCodeBench / atcoder / abc348_b: Farthest Point (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FarthestPoint case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 333 OUT639
×
LcbMedicinesOnGridLiveCodeBench / atcoder / abc348_d: Medicines on Grid (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MedicinesOnGrid case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 27:16: Expected ';' after the variable declaration, found ','. Values: run.Compiled = false
Failed IN9 512 OUT9 053
×
LcbMinimizeSumOfDistancesLiveCodeBench / atcoder / abc348_e: Minimize Sum of Distances (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinimizeSumOfDistances case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found '.'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 323 OUT2 930
✓
LcbPenaltyKickLiveCodeBench / atcoder / abc348_a: Penalty Kick (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 226 OUT261
✓
LcbZeroSumGameLiveCodeBench / atcoder / abc349_a: Zero Sum Game (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 272 OUT258
Code Generation - LiveCodeBench v2 AtCoder (set 4) 1 passed4 failed2 skipped
20.0%
IN46 659 OUT10 128
×
LcbCommencementLiveCodeBench / atcoder / abc349_b: Commencement (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Commencement case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:26: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 20:26: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 215 OUT1 196
×
LcbDentistAokiLiveCodeBench / atcoder / abc350_b: Dentist Aoki (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DentistAoki case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:5: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 15:12: Unknown variable 'j'. 17:48: Unknown variable 'j'. 19:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 19:9: Unknown variable 'j'. 22:5: Unknown variable 'k'. Declare it first, e.g. 'int k = ...;'. 23:12: Unknown variable 'k'. 25:22: Unknown variable 'k'. 29:9: Unknown variable 'k'. Declare it first, e.g. 'int k = ...;'. 29:9: Unknown variable 'k'. Values: run.Compiled = false
Failed IN9 279 OUT308
×
LcbDivideIntervalLiveCodeBench / atcoder / abc349_d: Divide Interval (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DivideInterval case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 54:33: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 413 OUT2 481
✓
LcbPastABCsLiveCodeBench / atcoder / abc350_a: Past ABCs (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 297 OUT821
–
LcbSortPermutationLiveCodeBench / atcoder / abc350_c: Sort (Pattern B, stdin) TRIAGE: 0 public tests in dump + non-unique output (any valid swap sequence accepted) — cannot oracle-compare.0 AI queries 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: no public tests in dump; output non-unique (any valid swap sequence is accepted) — exact-compare oracle inapplicable, coordinator triage
Skipped IN0 OUT0
–
LcbTowardZeroLiveCodeBench / atcoder / abc350_e: Toward 0 (Pattern B, stdin) TRIAGE: float output (absolute/relative error <= 1e-6) — RunLcbStdin does exact string compare; needs tolerance.0 AI queries 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: float output requires error tolerance (<=1e-6); RunLcbStdin does exact string compare — coordinator triage
Skipped IN0 OUT0
×
LcbWeightedTicLiveCodeBench / atcoder / abc349_e: Weighted Tic (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WeightedTic case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:10: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 455 OUT5 322
Code Generation - LiveCodeBench v2 AtCoder (set 5) 3 passed5 failed
37.5%
IN74 260 OUT25 912
✓
LcbBottomNinthLiveCodeBench / atcoder / abc351_a: The bottom of the ninth (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 330 OUT654
×
LcbCliqueConnectLiveCodeBench / atcoder / abc352_e: Clique Connect (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CliqueConnect case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:17: Expected '(' to declare a function or '=' to declare a global variable after 'List<int> parent', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 341 OUT3 954
×
LcbDoubleSumMaxDiffLiveCodeBench / atcoder / abc351_f: Double Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: DoubleSumMaxDiff case0 runtime error: Cannot parse '2 5 3' as long. Values: run.Success = false
Failed IN9 193 OUT3 237
×
LcbGridAndMagnetLiveCodeBench / atcoder / abc351_d: Grid and Magnet (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: GridAndMagnet case0 runtime error: Cannot parse '3 5' as int. Values: run.Success = false
Failed IN9 296 OUT6 659
✓
LcbJumpDistanceSumLiveCodeBench / atcoder / abc351_e: Jump Distance Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 297 OUT7 258
×
LcbMergeTheBallsLiveCodeBench / atcoder / abc351_c: Merge the balls (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MergeTheBalls case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:27: Type 'Dictionary<long, long>' has no supported method named 'GetValueOrDefault' with 2 argument(s). 19:37: Type 'Dictionary<long, long>' has no supported method named 'GetValueOrDefault' with 2 argument(s). 25:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 275 OUT2 270
✓
LcbNewFriendsLiveCodeBench / atcoder / abc350_d: New Friends (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 224 OUT1 515
×
LcbSpotTheDifferenceLiveCodeBench / atcoder / abc351_b: Spot the Difference (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SpotTheDifference case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 32:27: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 304 OUT365
Code Generation - LiveCodeBench v2 AtCoder (set 6) 4 passed3 failed
57.1%
IN64 841 OUT11 669
✓
LcbAmusementParkLiveCodeBench / atcoder / abc353_b: AtCoder Amusement Park (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 286 OUT484
✓
LcbAtcoderLineLiveCodeBench / atcoder / abc352_a: AtCoder Line (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 239 OUT591
×
LcbBuildingsTallerLiveCodeBench / atcoder / abc353_a: Buildings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BuildingsTaller case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 213 OUT125
×
LcbPermutationSubsequenceLiveCodeBench / atcoder / abc352_d: Permutation Subsequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PermutationSubsequence case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 15:36: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '<'. Values: run.Compiled = false
Failed IN9 301 OUT6 249
✓
LcbSigmaRemainderSumLiveCodeBench / atcoder / abc353_c: Sigma Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 219 OUT3 214
✓
LcbStandingOnShouldersLiveCodeBench / atcoder / abc352_c: Standing On The Shoulders (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 312 OUT819
×
LcbTypingBackspaceLiveCodeBench / atcoder / abc352_b: Typing (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TypingBackspace case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:18: Type 'string' has no fields. Only struct values support '.Count'. 11:34: Type 'string' has no fields. Only struct values support '.Count'. Values: run.Compiled = false
Failed IN9 271 OUT187
Code Generation - LiveCodeBench v2 AtCoder (set 7) 2 passed4 failed
33.3%
IN55 858 OUT12 615
✓
LcbAnotherSigmaProblemLiveCodeBench / atcoder / abc353_d: Another Sigma Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 320 OUT3 113
×
LcbAtcoderJanken2LiveCodeBench / atcoder / abc354_b: AtCoder Janken 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AtcoderJanken2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 304 OUT271
✓
LcbAtcoderMagicsLiveCodeBench / atcoder / abc354_c: AtCoder Magics (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 373 OUT754
×
LcbExponentialPlantLiveCodeBench / atcoder / abc354_a: Exponential Plant (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ExponentialPlant case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'while'. Values: run.Compiled = false
Failed IN9 257 OUT60
×
LcbRemovePairsLiveCodeBench / atcoder / abc354_e: Remove Pairs (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RemovePairs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 36:12: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 350 OUT2 523
×
LcbYetAnotherSigmaProblemLiveCodeBench / atcoder / abc353_e: Yet Another Sigma Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: YetAnotherSigmaProblem case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 45:31: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '<'. Values: run.Compiled = false
Failed IN9 254 OUT5 894
Code Generation - LiveCodeBench v2 AtCoder (set 8) 3 passed2 failed1 skipped
60.0%
IN46 533 OUT28 649
✓
LcbAtcoderWallpaperLiveCodeBench / atcoder / abc354_d: AtCoder Wallpaper (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 365 OUT20 018
✓
LcbBingo2LiveCodeBench / atcoder / abc355_c: Bingo 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 378 OUT1 912
–
LcbGuessTheSumLiveCodeBench / atcoder / abc355_e: Guess the Sum (Pattern B, stdin) — INTERACTIVE, cannot run in the batch harness0 AI queries 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: SC# subset: interactive problem (adaptive query/response dialogue; not expressible as a single stdin->stdout Solve)
Skipped IN0 OUT0
×
LcbIntersectingIntervalsLiveCodeBench / atcoder / abc355_d: Intersecting Intervals (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IntersectingIntervals case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 235 OUT5 382
✓
LcbPiano2LiveCodeBench / atcoder / abc355_b: Piano 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 303 OUT475
×
LcbWhoAteTheCakeLiveCodeBench / atcoder / abc355_a: Who Ate the Cake? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WhoAteTheCake case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:28: Expected ')' to close the argument list, found '='. Values: run.Compiled = false
Failed IN9 252 OUT862
Code Generation - LiveCodeBench v2 LeetCode (set 1) 6 passed3 failed
66.7%
IN82 585 OUT55 983
✓
LcbCountSubstringsStartEndCharLiveCodeBench / leetcode / medium: count-substrings-starting-and-ending-with-given-character (LCB 3337)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 105 OUT200
✓
LcbMaximumHappinessSumLiveCodeBench / leetcode / medium: maximize-happiness-of-selected-children (LCB 3351)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 200 OUT101
×
LcbMaximumStrengthSubarraysLiveCodeBench / leetcode / hard: maximum-strength-of-k-disjoint-subarrays (LCB 3313)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maximumStrength case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:15: Char literals must contain exactly one character and close with '''. 29:14: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 255 OUT17 080
✓
LcbMaxLengthTwoOccurrencesLiveCodeBench / leetcode / easy: maximum-length-substring-with-two-occurrences (LCB 3349)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 087 OUT2 295
✓
LcbMinDeletionsKSpecialLiveCodeBench / leetcode / medium: minimum-deletions-to-make-string-k-special (LCB 3360)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 160 OUT1 834
✓
LcbMinimumBoxesApplesLiveCodeBench / leetcode / easy: apple-redistribution-into-boxes (LCB 3334)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 190 OUT515
×
LcbMinMovesPickKOnesLiveCodeBench / leetcode / hard: minimum-moves-to-pick-k-ones (LCB 3327)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimumMoves case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 43:13: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 314 OUT29 154
✓
LcbShortestUncommonSubstringsLiveCodeBench / leetcode / medium: shortest-uncommon-substring-in-an-array (LCB 3356)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 168 OUT2 863
×
LcbSubstringInReverseLiveCodeBench / leetcode / easy: existence-of-a-substring-in-a-string-and-its-reverse (LCB 3353)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: isSubstringPresent case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:5: Unknown variable 'k'. Declare it first, e.g. 'int k = ...;'. 26:12: Unknown variable 'k'. 28:42: Unknown variable 'k'. 33:9: Unknown variable 'k'. Declare it first, e.g. 'int k = ...;'. 33:9: Unknown variable 'k'. Values: run.Compiled = false
Failed IN9 106 OUT1 941
Code Generation - LiveCodeBench v2 LeetCode (set 2) 4 passed5 failed
44.4%
IN82 482 OUT24 951
×
LcbCountAlternatingSubarraysLiveCodeBench / leetcode / medium: count-alternating-subarrays (LCB 3374)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countAlternatingSubarrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'if'. Values: run.Compiled = false
Failed IN9 118 OUT650
✓
LcbHarshadDigitSumLiveCodeBench / leetcode / easy: harshad-number (LCB 3371)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 117 OUT901
×
LcbLexSmallestWithinDistanceLiveCodeBench / leetcode / medium: lexicographically-smallest-string-after-operations-with-constraint (LCB 3346)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: getSmallestString case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:39: Cannot assign a value of type 'int' to variable 'ch' of type 'char'. 30:39: Cannot assign a value of type 'int' to variable 'ch' of type 'char'. Values: run.Compiled = false
Failed IN9 213 OUT2 488
×
LcbLongestCommonSuffixQueriesLiveCodeBench / leetcode / hard: longest-common-suffix-queries (LCB 3376)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: stringIndices case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:26: Unexpected character '#'. 9:33: Char literals must contain exactly one character and close with '''. 11:108: Unexpected character '→'. 13:15: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 212 OUT3 647
×
LcbLongestMonotonicSubarrayLiveCodeBench / leetcode / easy: longest-strictly-increasing-or-decreasing-subarray (LCB 3372)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestMonotonicSubarray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:14: Operator '==' cannot compare 'List<int>' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. Values: run.Compiled = false
Failed IN9 126 OUT248
✓
LcbMinimizeManhattanDistanceLiveCodeBench / leetcode / hard: minimize-manhattan-distances (LCB 3344)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 149 OUT3 975
✓
LcbMinOpsMedianKLiveCodeBench / leetcode / medium: minimum-operations-to-make-median-of-array-equal-to-k (LCB 3387)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 189 OUT3 171
×
LcbMinOpsSumAtLeastKLiveCodeBench / leetcode / medium: apply-operations-to-make-sum-of-array-ge-k (LCB 3328)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minOperations case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:9: Unexpected character '#'. 8:9: Unexpected character '#'. 9:54: Unexpected character '#'. 10:13: Unexpected character '#'. 14:13: Unexpected character '#'. Values: run.Compiled = false
Failed IN9 144 OUT7 826
✓
LcbMostFrequentIdsLiveCodeBench / leetcode / medium: most-frequent-ids (LCB 3363)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 214 OUT2 045
Code Generation - LiveCodeBench v2 LeetCode (set 3) 2 passed7 failed
22.2%
IN82 832 OUT42 826
×
LcbKthSmallestAmountLiveCodeBench 3375 / leetcode / hard: kth-smallest-amount-with-single-denomination-combination (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: kthSmallestAmount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 45:19: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 189 OUT1 609
✓
LcbLatestTimeReplaceLiveCodeBench 3361 / leetcode / easy: latest-time-you-can-obtain-after-replacing-characters (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 213 OUT2 912
✓
LcbMaximumPrimeDifferenceLiveCodeBench 3373 / leetcode / medium: maximum-prime-difference (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 158 OUT307
×
LcbMinimizeStringValueLiveCodeBench 3354 / leetcode / medium: replace-question-marks-in-string-to-minimize-its-value (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimizeStringValue case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:33: Cannot assign a value of type 'int' to variable 'c' of type 'char'. 17:33: Cannot assign a value of type 'int' to variable 'c' of type 'char'. 21:37: Cannot assign a value of type 'int' to variable 'c' of type 'char'. 33:41: Cannot assign a value of type 'int' to variable 'c' of type 'char'. Values: run.Compiled = false
Failed IN9 225 OUT4 450
×
LcbMinSumValuesDividingLiveCodeBench 3364 / leetcode / hard: minimum-sum-of-values-by-dividing-array (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minSumValuesDividing case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 53:14: Expected '>' to close the List type, found '['. Values: run.Compiled = false
Failed IN9 277 OUT20 443
×
LcbShortestSubarrayOrKLiveCodeBench 3381 / leetcode / easy: shortest-subarray-with-or-at-least-k-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: shortestSubarrayOrK case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:31: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 181 OUT2 047
×
LcbSumOfEncryptedIntsLiveCodeBench 3367 / leetcode / easy: find-the-sum-of-encrypted-integers (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: sumOfEncryptedInts case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 21:16: Unknown variable 'j'. 24:13: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 24:13: Unknown variable 'j'. Values: run.Compiled = false
Failed IN9 159 OUT1 430
×
LcbSumOfPowerSubsequencesLiveCodeBench 3345 / leetcode / hard: find-the-sum-of-the-power-of-all-subsequences (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: sumOfPowerSubsequences case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'for'. Values: run.Compiled = false
Failed IN9 174 OUT6 439
×
LcbUnmarkedSumArrayLiveCodeBench 3306 / leetcode / medium: mark-elements-on-array-by-performing-queries (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: unmarkedSumArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:32: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 256 OUT3 189
Code Generation - LiveCodeBench v2 LeetCode (set 4) 6 passed3 failed
66.7%
IN82 587 OUT66 844
✓
LcbAddedIntegerLiveCodeBench 3397 / leetcode / easy: find-the-integer-added-to-array-i (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 202 OUT680
✓
LcbMedianUniquenessArrayLiveCodeBench 3362 / leetcode / hard: find-the-median-of-the-uniqueness-array (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 222 OUT3 464
✓
LcbMinimumArrayEndLiveCodeBench 3394 / leetcode / medium: minimum-array-end (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 166 OUT136
×
LcbMinimumLevelsGainPointsLiveCodeBench 3355 / leetcode / medium: minimum-levels-to-gain-more-points (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minimumLevelsGainPoints case0: expected 1 got -1
Failed IN9 225 OUT364
✓
LcbNumberOfSpecialCharsLiveCodeBench 3408 / leetcode / easy: count-the-number-of-special-characters-i (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 121 OUT181
✓
LcbScoreOfStringLiveCodeBench 3379 / leetcode / easy: score-of-a-string (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 172 OUT117
×
LcbSubarraysBoundaryMaxLiveCodeBench 3382 / leetcode / hard: find-the-number-of-subarrays-where-boundary-elements-are-maximum (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: subarraysBoundaryMax case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:33: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '<'. Values: run.Compiled = false
Failed IN9 127 OUT7 845
×
LcbSumOfSubsequencePowersLiveCodeBench 3316 / leetcode / hard: find-the-sum-of-subsequence-powers (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: sumOfSubsequencePowers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 182 OUT53 474
✓
LcbValidWordLiveCodeBench 3396 / leetcode / easy: valid-word (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 170 OUT583
Code Generation - LiveCodeBench v2 LeetCode (set 5) 5 passed4 failed
55.6%
IN82 723 OUT24 378
×
LcbCanMakeSquareColorLiveCodeBench / leetcode / easy: make-a-square-with-the-same-color1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: CanMakeSquareColor case1 runtime error: List index 3 is out of range. The list has 3 element(s). Values: run.Success = false
Failed IN9 217 OUT665
✓
LcbIsArraySpecialILiveCodeBench / leetcode / easy: special-array-i1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 127 OUT103
✓
LcbMakeWordKPeriodicLiveCodeBench / leetcode / medium: minimum-number-of-operations-to-make-word-k-periodic1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 197 OUT1 634
×
LcbMinAnagramLengthLiveCodeBench / leetcode / medium: minimum-length-of-anagram-concatenation1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinAnagramLength case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 34:17: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 35:24: Unknown variable 'j'. 37:40: Unknown variable 'j'. 42:21: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 42:25: Unknown variable 'j'. Values: run.Compiled = false
Failed IN9 131 OUT1 396
✓
LcbMinCostEqualizeArrayLiveCodeBench / leetcode / hard: minimum-cost-to-equalize-array1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 261 OUT9 413
×
LcbMysticDungeonEnergyLiveCodeBench / leetcode / medium: taking-maximum-energy-from-the-mystic-dungeon1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: MysticDungeonEnergy case0: expected 3 got 5
Failed IN9 188 OUT1 783
✓
LcbNumberOfRightTrianglesLiveCodeBench / leetcode / medium: right-triangles1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 223 OUT357
×
LcbNumberOfStableArraysLiveCodeBench / leetcode / medium: find-all-possible-stable-binary-arrays-i1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NumberOfStableArrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:5: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 217 OUT8 826
✓
LcbPermutationDifferenceLiveCodeBench / leetcode / easy: permutation-difference-between-two-strings1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 162 OUT201
Code Generation - LiveCodeBench v2 LeetCode (set 6) 6 passed3 failed
66.7%
IN82 717 OUT46 705
✓
LcbMaxSumNonAdjacentQueriesLiveCodeBench / leetcode / hard: maximum-sum-of-subsequence-with-non-adjacent-elements1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 228 OUT2 528
×
LcbMinBalancedPartitionLiveCodeBench / leetcode / medium: minimum-substring-partition-of-equal-character-frequency1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinBalancedPartition case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:76: Type 'Dictionary<char, int>' has no supported method named 'Add' with 2 argument(s). 20:33: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 125 OUT3 671
✓
LcbNumberOfGoodPairsILiveCodeBench / leetcode / easy: find-the-number-of-good-pairs-i1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 207 OUT2 662
✓
LcbOccurrencesOfElementLiveCodeBench / leetcode / medium: find-occurrences-of-an-element-in-an-array1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 205 OUT187
×
LcbProductsBigArrayLiveCodeBench / leetcode / hard: find-products-of-elements-of-big-array1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ProductsBigArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:22: Unknown function 'PosToInt'. 25:22: Unknown function 'PosToInt'. 30:19: Unknown function 'Popcount'. 32:25: Unknown function 'BitsExponent'. 32:46: Unknown function 'Popcount'. 38:25: Unknown function 'G'. 38:37: Unknown function 'G'. 44:25: Unknown function 'BitsExponent'. 47:20: Unknown function 'PowMod'. Values: run.Compiled = false
Failed IN9 310 OUT14 118
✓
LcbStringCompressionIIILiveCodeBench / leetcode / medium: string-compression-iii1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 149 OUT109
×
LcbSumDigitDifferencesLiveCodeBench / leetcode / medium: sum-of-digit-differences-of-all-pairs1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: SumDigitDifferences case0: expected 4 got 28
Failed IN9 147 OUT2 595
✓
LcbWaysToReachStairLiveCodeBench / leetcode / hard: find-number-of-ways-to-reach-the-k-th-stair1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 204 OUT20 711
✓
LcbXorAppearingTwiceLiveCodeBench / leetcode / easy: find-the-xor-of-numbers-which-appear-twice1 AI query 0 tool callscategory:CodeGenerationcategory:V2@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 142 OUT124
Code Generation - LiveCodeBench v3 AtCoder (set 1) 1 passed6 failed
14.3%
IN64 954 OUT11 869
✓
LcbKeysCombinationsLiveCodeBench / atcoder / medium: abc356_c Keys (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 392 OUT615
×
LcbMaskedPopcountLiveCodeBench / atcoder / medium: abc356_d Masked Popcount (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
The value in FromJson result must be a JSON string (script type 'string'), but it is the number 4.
Failed IN9 229 OUT259
×
LcbMaxMinFloorSumLiveCodeBench / atcoder / hard: abc356_e Max/Min (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxMinFloorSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 216 OUT7 247
×
LcbNutrientsLiveCodeBench / atcoder / easy: abc356_b Nutrients (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Nutrients case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 9:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 293 OUT476
×
LcbSanitizeHandsLiveCodeBench / atcoder / easy: abc357_a Sanitize Hands (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SanitizeHands case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:13: Cannot assign a value of type 'long' to variable 'remaining' of type 'int'. Values: run.Compiled = false
Failed IN9 268 OUT1 336
×
LcbSierpinskiCarpetLiveCodeBench / atcoder / medium: abc357_c Sierpinski carpet (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SierpinskiCarpet case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Unexpected character '#'. 1:2: Unexpected character '#'. 1:3: Unexpected character '#'. 2:3: Unexpected character '#'. 2:5: Unexpected character '#'. 3:3: Unexpected character '#'. 3:4: Unexpected character '#'. 3:5: Unexpected character '#'. Values: run.Compiled = false
Failed IN9 321 OUT1 740
×
LcbSubsegmentReverseLiveCodeBench / atcoder / easy: abc356_a Subsegment Reverse (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SubsegmentReverse case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 235 OUT196
Code Generation - LiveCodeBench v3 AtCoder (set 2) 3 passed4 failed
42.9%
IN65 018 OUT27 164
×
LcbAlphabetTilesLiveCodeBench / atcoder / hard: abc358_e Alphabet Tiles (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AlphabetTiles case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 289 OUT3 656
✓
LcbConcatModuloLiveCodeBench / atcoder / medium: abc357_d 88888888 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 280 OUT4 231
×
LcbFunctionalGraphReachLiveCodeBench / atcoder / hard: abc357_e Reachability in Functional Graph (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FunctionalGraphReach case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 268 OUT5 237
✓
LcbPopcornStandsLiveCodeBench / atcoder / medium: abc358_c Popcorn (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 292 OUT1 152
×
LcbSouvenirsLiveCodeBench / atcoder / medium: abc358_d Souvenirs (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Souvenirs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:10: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 335 OUT10 575
✓
LcbTicketCounterLiveCodeBench / atcoder / easy: abc358_b Ticket Counter (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 333 OUT1 643
×
LcbUppercaseLowercaseLiveCodeBench / atcoder / easy: abc357_b Uppercase and Lowercase (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: UppercaseLowercase case0 runtime error: Cannot cast value to 'char' because it is outside the target type range. Values: run.Success = false
Failed IN9 221 OUT670
Code Generation - LiveCodeBench v3 AtCoder (set 3) 1 passed6 failed
14.3%
IN64 635 OUT56 583
×
LcbAvoidKPalindromeLiveCodeBench / atcoder abc359_d / hard: Avoid K Palindrome (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AvoidKPalindrome case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 223 OUT24 378
×
LcbCountTakahashiLiveCodeBench / atcoder abc359_a / easy: Count Takahashi (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountTakahashi case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 179 OUT73
×
LcbCouplesBetweenLiveCodeBench / atcoder abc359_b / easy: Couples (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CouplesBetween case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 192 OUT1 129
×
LcbMoveItBoxesLiveCodeBench / atcoder abc360_c / medium: Move It (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MoveItBoxes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 39:24: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 232 OUT1 586
×
LcbTileDistance2TollLiveCodeBench / atcoder abc359_c / medium: Tile Distance 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: TileDistance2Toll case0: expected [5] got [6]
Failed IN9 322 OUT16 969
×
LcbWaterTankFillLiveCodeBench / atcoder abc359_e / hard: Water Tank (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: WaterTankFill case0: expected [4 5 13 14 26] got [4 5 10 11 17]
Failed IN9 319 OUT11 942
✓
LcbWelcomeAtCoderLandLiveCodeBench / atcoder abc358_a / easy: Welcome to AtCoder Land (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 168 OUT506
Code Generation - LiveCodeBench v3 AtCoder (set 4) 4 passed2 failed1 broken
57.1%
IN64 713 OUT76 333
×
LcbGhostAntsPassLiveCodeBench / atcoder abc360_d / medium: Ghost Ants (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GhostAntsPass case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 181:9: Unknown variable 'hlo'. Declare it first, e.g. 'int hlo = ...;'. 182:9: Unknown variable 'hhi'. Declare it first, e.g. 'int hhi = ...;'. 183:16: Unknown variable 'hlo'. 183:22: Unknown variable 'hhi'. 185:23: Unknown variable 'hlo'. 185:29: Unknown variable 'hhi'. 188:17: Unknown variable 'hlo'. Declare it first, e.g. 'int hlo = ...;'. 192:17: Unknown variable 'hhi'. Declare it first, e.g. 'int hhi = ...;'. 195:19: Unknown variable 'hlo'. Values: run.Compiled = false
Failed IN9 302 OUT5 365
!
LcbGoStonePuzzleLiveCodeBench / atcoder abc361_d / hard: Go Stone Puzzle (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 288 OUT62 144
✓
LcbHealthyBreakfastLiveCodeBench / atcoder abc360_a / easy: A Healthy Breakfast (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 228 OUT539
✓
LcbInsertAfterKLiveCodeBench / atcoder abc361_a / easy: Insert (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 177 OUT326
✓
LcbIntersectCuboidsLiveCodeBench / atcoder abc361_b / medium: Intersection of Cuboids (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 209 OUT903
×
LcbRandomSwapsBallsLiveCodeBench / atcoder abc360_e / hard: Random Swaps of Balls (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RandomSwapsBalls case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 282 OUT4 488
✓
LcbVerticalReadingPairLiveCodeBench / atcoder abc360_b / easy: Vertical Reading (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 227 OUT2 568
Code Generation - LiveCodeBench v3 AtCoder (set 5) 3 passed3 failed1 skipped
50.0%
IN55 370 OUT22 900
✓
LcbBuyAPenLiveCodeBench / atcoder / easy: abc362_a Buy a Pen (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 205 OUT772
×
LcbCountArithmeticSubsequencesLiveCodeBench / atcoder / hard: abc362_e Count Arithmetic Subsequences (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountArithmeticSubsequences case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 67:30: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 263 OUT5 519
✓
LcbMakeThemNarrowLiveCodeBench / atcoder / medium: abc361_c Make Them Narrow (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 215 OUT595
✓
LcbPerfectPowerCountLiveCodeBench / atcoder / hard: abc361_f x = a^b (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 158 OUT11 354
×
LcbShortestPath3LiveCodeBench / atcoder / hard: abc362_d Shortest Path 3 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ShortestPath3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 282 OUT1 779
–
LcbSumZeroSequenceLiveCodeBench / atcoder / medium: abc362_c Sum = 0 (Pattern B, stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbTreeHamiltonPathLiveCodeBench / atcoder / hard: abc361_e Tree and Hamilton Path 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TreeHamiltonPath case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 61:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 100:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 247 OUT2 881
Code Generation - LiveCodeBench v3 AtCoder (set 6) 1 passed5 failed1 skipped
16.7%
IN55 524 OUT14 167
×
LcbAvoidKPalindrome2LiveCodeBench / atcoder / medium: abc363_c Avoid K Palindrome 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AvoidKPalindrome2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:40: Expected ')' to close the argument list, found 'count'. Values: run.Compiled = false
Failed IN9 271 OUT2 617
✓
LcbCursedDollLiveCodeBench / atcoder / easy: abc363_b Japanese Cursed Doll (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 241 OUT311
×
LcbNthPalindromeLiveCodeBench / atcoder / medium: abc363_d Palindromic Number (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: NthPalindrome case0: expected [363] got [373]
Failed IN9 181 OUT3 311
–
LcbPalindromicExpressionLiveCodeBench / atcoder / hard: abc363_f Palindromic Expression (Pattern B, stdin)0 AI queries 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbPilingUpLiveCodeBench / atcoder / easy: abc363_a Piling Up (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PilingUp case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int r', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 261 OUT64
×
LcbRightTriangleCheckLiveCodeBench / atcoder / easy: abc362_b Right Triangle (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RightTriangleCheck case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'if'. Values: run.Compiled = false
Failed IN9 211 OUT237
×
LcbSinkingLandLiveCodeBench / atcoder / hard: abc363_e Sinking Land (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SinkingLand case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 359 OUT7 627
Code Generation - LiveCodeBench v3 AtCoder (set 7) 2 passed4 failed
33.3%
IN55 537 OUT42 964
×
LcbGluttonTakahashiLiveCodeBench / atcoder / easy: Glutton Takahashi (abc364_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: GluttonTakahashi case1: expected [Yes] got [No]
Failed IN9 193 OUT689
✓
LcbGridWalkLiveCodeBench / atcoder / easy: Grid Walk (abc364_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 373 OUT1 404
✓
LcbKthClosestPointLiveCodeBench / atcoder / hard: K — k-th closest point (abc364_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 274 OUT695
×
LcbMaximumGluttonLiveCodeBench / atcoder / hard: Maximum Glutton (abc364_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: MaximumGlutton case0: expected [3] got [2]
Failed IN9 236 OUT2 971
×
LcbMinimumGluttonLiveCodeBench / atcoder / medium: Minimum Glutton (abc364_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: MinimumGlutton case0: expected [2] got [4]
Failed IN9 200 OUT7 854
×
LcbRangeConnectMstLiveCodeBench / atcoder / hard: Range Connect MST (abc364_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RangeConnectMst case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:22: Expected '(' to declare a function or '=' to declare a global variable after 'List<long> dsu_parent', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 261 OUT29 351
Code Generation - LiveCodeBench v3 AtCoder (set 8) 1 passed4 failed
20.0%
IN46 120 OUT10 020
×
LcbAtcoderJanken3LiveCodeBench / atcoder / medium: AtCoder Janken 3 (abc365_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: AtcoderJanken3 case0: expected [5] got [0]
Failed IN9 269 OUT980
×
LcbLeapYearLiveCodeBench / atcoder / easy: Leap Year (abc365_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: LeapYear case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:10: Expected '(' to declare a function or '=' to declare a global variable after 'int years', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 243 OUT69
✓
LcbSecondBestLiveCodeBench / atcoder / easy: Second Best (abc365_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 175 OUT558
×
LcbTransportationExpensesLiveCodeBench / atcoder / medium: Transportation Expenses (abc365_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: TransportationExpenses case0 runtime error: Cannot parse '1 3 2 4' as long. Values: run.Success = false
Failed IN9 235 OUT2 170
×
LcbXorSigmaProblemLiveCodeBench / atcoder / hard: Xor Sigma Problem (abc365_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: XorSigmaProblem case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:28: Cannot add a value of type 'long' to a 'List<int>'. 28:40: Cannot add a value of type 'long' to a 'List<int>'. Values: run.Compiled = false
Failed IN9 198 OUT6 243
Code Generation - LiveCodeBench v3 LeetCode (set 1) 6 passed2 failed
75.0%
IN73 393 OUT11 743
✓
LcbChildWithBallLiveCodeBench / leetcode / easy: find-the-child-who-has-the-ball-after-k-seconds (id 3450)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 181 OUT1 102
✓
LcbCompleteDayPairsLiveCodeBench / leetcode / easy: count-pairs-that-form-a-complete-day-i (id 3421)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 140 OUT237
×
LcbCountDaysWithoutMeetingsLiveCodeBench / leetcode / medium: count-days-without-meetings (id 3430)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: CountDays case1 runtime error: RemoveAt index 2 is out of range for a list of length 2. Values: run.Success = false
Failed IN9 198 OUT351
✓
LcbMaxTotalDamageLiveCodeBench / leetcode / medium: maximum-total-damage-with-spell-casting (id 3437)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 160 OUT3 563
✓
LcbMaxTotalRewardLiveCodeBench / leetcode / medium: maximum-total-reward-using-operations-i (id 3442)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 174 OUT1 809
✓
LcbMinimumChairsLiveCodeBench / leetcode / easy: minimum-number-of-chairs-in-a-waiting-room (id 3426)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 163 OUT130
✓
LcbSubarrayOrClosestKLiveCodeBench / leetcode / hard: find-subarray-with-bitwise-or-closest-to-k (id 3436)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 182 OUT1 205
×
LcbValueAfterKSecondsLiveCodeBench / leetcode / medium: find-the-n-th-value-after-k-seconds (id 3422)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ValueAfterKSeconds case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:13: The shift count of '>>' must be 'int', but got 'long'. Values: run.Compiled = false
Failed IN9 195 OUT3 346
Code Generation - LiveCodeBench v3 LeetCode (set 2) 5 passed3 failed
62.5%
IN73 563 OUT27 166
✓
LcbEncryptedStringLiveCodeBench / leetcode / easy: find-the-encrypted-string (id 3468)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 127 OUT1 014
×
LcbMaxTotalCostAlternatingLiveCodeBench / leetcode / medium: maximize-total-cost-of-alternating-subarrays (id 3464)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxTotalCostAlternating case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'for'. Values: run.Compiled = false
Failed IN9 218 OUT12 119
✓
LcbMaxTriangleHeightLiveCodeBench / leetcode / easy: maximum-height-of-a-triangle (id 3469)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 184 OUT3 752
✓
LcbMaxValidSubsequenceLiveCodeBench / leetcode / medium: find-the-maximum-length-of-valid-subsequence-i (id 3490)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 185 OUT3 209
×
LcbMinDiameterMergeTreesLiveCodeBench / leetcode / hard: find-minimum-diameter-after-merging-two-trees (id 3439)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinDiameterMergeTrees case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 58:40: Expected ')' to close the argument list, found 'neighbors'. Values: run.Compiled = false
Failed IN9 284 OUT3 731
✓
LcbMinimumAreaCoverOnesLiveCodeBench / leetcode / medium: find-the-minimum-area-to-cover-all-ones-i (id 3461)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 130 OUT289
✓
LcbMinimumAverageLiveCodeBench / leetcode / easy: minimum-average-of-smallest-and-largest-elements (id 3471)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 185 OUT132
×
LcbPeaksInArrayLiveCodeBench / leetcode / hard: peaks-in-array (id 3438)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PeaksInArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 27:5: Expected an expression, found 'void'. Values: run.Compiled = false
Failed IN9 250 OUT2 920
Code Generation - LiveCodeBench v3 LeetCode (set 3) 5 passed2 failed1 skipped
71.4%
IN64 797 OUT25 135
✓
LcbBitChangesEqualLiveCodeBench / leetcode / easy: 3508 number-of-bit-changes-to-make-two-integers-equal1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 223 OUT1 081
✓
LcbCountEqualXYSubmatricesLiveCodeBench / leetcode / medium: 3492 count-submatrices-with-equal-frequency-of-x-and-y1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 238 OUT1 354
✓
LcbMaxOpsMoveOnesLiveCodeBench / leetcode / medium: 3493 maximum-number-of-operations-to-move-ones-to-the-end1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 220 OUT7 506
×
LcbMinCostConstructStringLiveCodeBench / leetcode / hard: 3482 construct-string-with-minimum-cost1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimumCost case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 33:44: Expected ';' after the variable declaration, found '++'. Values: run.Compiled = false
Failed IN9 334 OUT4 080
✓
LcbMinCostCutCakeLiveCodeBench / leetcode / medium: 3494 minimum-cost-for-cutting-cake-i1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 350 OUT3 514
×
LcbSmallestStringAfterSwapLiveCodeBench / leetcode / easy: 3484 lexicographically-smallest-string-after-a-swap1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson) == FromJson<string>(expected[i]) Context: getSmallestString case0: expected "43520" got "43502"
Failed IN9 216 OUT2 440
–
LcbValidBinaryStringsLiveCodeBench / leetcode / medium: 3453 generate-binary-strings-without-adjacent-zeros0 AI queries 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
✓
LcbVowelsGameLiveCodeBench / leetcode / medium: 3462 vowels-game-in-a-string1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 216 OUT5 160
Code Generation - LiveCodeBench v3 LeetCode (set 4) 5 passed3 failed
62.5%
IN74 297 OUT45 962
✓
LcbAlternatingGroupsIIILiveCodeBench / leetcode / hard: 3527 alternating-groups-iii1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 403 OUT8 706
✓
LcbDigitGameWinLiveCodeBench / leetcode / easy: 3515 find-if-digit-game-can-be-won1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 257 OUT777
✓
LcbDominantOnesSubstringsLiveCodeBench / leetcode / medium: 3479 count-the-number-of-substrings-with-dominant-ones1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 187 OUT12 425
×
LcbMinOpsArrayToTargetLiveCodeBench / leetcode / hard: 3454 minimum-operations-to-make-array-equal-to-target1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimumOperations case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'for'. Values: run.Compiled = false
Failed IN9 216 OUT5 586
×
LcbNonSpecialCountLiveCodeBench / leetcode / medium: 3507 find-the-count-of-numbers-which-are-not-special1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: nonSpecialCount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 41:26: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 241 OUT2 968
×
LcbRectangleCornerReachableLiveCodeBench / leetcode / hard: 3478 check-if-the-rectangle-corner-is-reachable1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: canReachCorner case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:22: Expected a type name after 'new', found 'int'. Values: run.Compiled = false
Failed IN9 392 OUT13 634
✓
LcbShortestDistanceQueriesLiveCodeBench / leetcode / medium: 3517 shortest-distance-after-road-addition-queries-i1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 333 OUT1 219
✓
LcbSnakeFinalPositionLiveCodeBench / leetcode / easy: 3533 snake-in-matrix1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 268 OUT647
Code Generation - LiveCodeBench v3 LeetCode (set 5) 5 passed3 failed
62.5%
IN73 510 OUT30 282
×
LcbAlternatingGroupsCircleLiveCodeBench / leetcode / easy: alternating-groups-i (LCB id 3463)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: alternatingGroupsCircle case1: expected 3 got 2
Failed IN9 180 OUT205
✓
LcbClearDigitsLiveCodeBench / leetcode / easy: clear-digits (LCB id 3447)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 127 OUT820
×
LcbCountInversionPermutationsLiveCodeBench / leetcode / hard: count-the-number-of-inversions (LCB id 3460)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countInversionPermutations case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:13: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 282 OUT7 508
✓
LcbCountMonotonicPairsLiveCodeBench / leetcode / hard: find-the-count-of-monotonic-pairs-i (LCB id 3535)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 244 OUT8 627
✓
LcbFirstPlayerWinKGamesLiveCodeBench / leetcode / medium: find-the-first-player-to-win-k-games-in-a-row (LCB id 3413)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 228 OUT3 869
×
LcbMaxGoodSubsequenceLengthLiveCodeBench / leetcode / medium: find-the-maximum-length-of-a-good-subsequence-i (LCB id 3456)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxGoodSubsequenceLength case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 103:36: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 167 OUT7 537
✓
LcbMinOpsBinaryToOneLiveCodeBench / leetcode / medium: minimum-operations-to-make-binary-array-elements-equal-to-one-i (LCB id 3475)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 161 OUT1 599
✓
LcbMinOpsDivisibleThreeLiveCodeBench / leetcode / easy: find-minimum-operations-to-make-all-elements-divisible-by-three (LCB id 3476)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 121 OUT117
Code Generation - LiveCodeBench v3 LeetCode (set 6) 3 passed5 failed
37.5%
IN73 675 OUT57 535
✓
LcbCoinGameWinnerLiveCodeBench / leetcode / easy: find-the-winning-player-in-coin-game (LCB id 3511)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 176 OUT1 566
✓
LcbCountSubarraysAndKLiveCodeBench / leetcode / hard: number-of-subarrays-with-and-value-of-k (LCB id 3466)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 146 OUT199
×
LcbCountWinningPlayersLiveCodeBench / leetcode / easy: find-the-number-of-winning-players (LCB id 3519)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countWinningPlayers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 278 OUT1 816
×
LcbMaxPointsEnemyBattlesLiveCodeBench / leetcode / medium: maximum-points-after-enemy-battles (LCB id 3264)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: maxPointsEnemyBattles case0: expected 3 got 2
Failed IN9 243 OUT2 333
×
LcbMinChangesEqualDiffsLiveCodeBench / leetcode / medium: minimum-array-changes-to-make-differences-equal (LCB id 3498)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minChangesEqualDiffs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:26: Expected a loop variable name, found '<'. Values: run.Compiled = false
Failed IN9 197 OUT35 828
✓
LcbMinFlipsPalindromicGridLiveCodeBench / leetcode / medium: minimum-number-of-flips-to-make-binary-grid-palindromic-i (LCB id 3526)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 192 OUT1 110
×
LcbMinLengthAfterOpsLiveCodeBench / leetcode / medium: minimum-length-of-string-after-operations (LCB id 3455)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minLengthAfterOps case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 164 OUT2 570
×
LcbTimeTakenMarkNodesLiveCodeBench / leetcode / hard: time-taken-to-mark-all-nodes (LCB id 3532)1 AI query 0 tool callscategory:CodeGenerationcategory:V3@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: timeTakenMarkNodes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:6: Unexpected character '\'. Values: run.Compiled = false
Failed IN9 279 OUT12 113
Code Generation - LiveCodeBench v4 AtCoder (set 1) 2 passed6 failed1 skipped
25.0%
IN73 909 OUT52 824
×
LcbBallsAndBagQueryLiveCodeBench / atcoder / medium: abc366_c Balls and Bag Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 213 OUT757
×
LcbCuboidSumQueryLiveCodeBench / atcoder / medium: abc366_d Cuboid Sum Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 323 OUT2 414
×
LcbCutTrailingZerosLiveCodeBench / atcoder / easy: abc367_b Cut .0 (Pattern B, stdin) NOTE (triage): float-formatting output — model must print X with no trailing zeros and no trailing decimal point. Compared as a trimmed string. Flagged for coordinator.1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CutTrailingZeros case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:24: Type 'string' has no fields. Only struct values support '.Count'. Values: run.Compiled = false
Failed IN9 205 OUT2 555
✓
LcbElection2LiveCodeBench / atcoder / easy: abc366_a Election 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 219 OUT1 096
×
LcbManhattanEllipseLiveCodeBench / atcoder / hard: abc366_e Manhattan Multifocal Ellipse (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ManhattanEllipse case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:37: Expected ')' to close the argument list, found 'long'. Values: run.Compiled = false
Failed IN9 236 OUT35 086
×
LcbMaximumCompositionLiveCodeBench / atcoder / hard: abc366_f Maximum Composition (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaximumComposition case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 240 OUT9 698
✓
LcbShoutEverydayLiveCodeBench / atcoder / easy: abc367_a Shout Everyday (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 200 OUT706
×
LcbVerticalWritingLiveCodeBench / atcoder / easy: abc366_b Vertical Writing (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: VerticalWriting case0: expected [fda geb h*c i] got [adf beg c*h **i]
Failed IN9 273 OUT512
–
LcbXorNeighborsLiveCodeBench / atcoder / hard: abc366_g XOR Neighbors (Pattern B, stdin) NOTE (triage): non-unique answer — any valid assignment is accepted, so exact-string comparison against the sample output will reject other correct solutions. Flagged for coordinator.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
Code Generation - LiveCodeBench v4 AtCoder (set 2) 2 passed5 failed1 broken
25.0%
IN74 044 OUT124 635
×
LcbAddMultiplyQueriesLiveCodeBench / atcoder / hard: abc368_g Add and Multiply Queries (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AddMultiplyQueries case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 52:23: Type 'long' has no supported method named 'CompareTo'. 54:22: Type 'long' has no supported method named 'CompareTo'. Values: run.Compiled = false
Failed IN9 297 OUT36 880
✓
LcbCardCutLiveCodeBench / atcoder / easy: abc368_a Cut (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 219 OUT402
✓
LcbDecreaseTwoMaxLiveCodeBench / atcoder / easy: abc368_b Decrease 2 max elements (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 204 OUT1 103
×
LcbEnumerateSequencesLiveCodeBench / atcoder / medium: abc367_c Enumerate Sequences (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EnumerateSequences case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:39: Expected ')' to close the argument list, found 'results'. Values: run.Compiled = false
Failed IN9 216 OUT2 085
×
LcbPedometerLiveCodeBench / atcoder / medium: abc367_d Pedometer (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: Pedometer case1 runtime error: The script exceeded the timeout of 30000 ms. Values: run.Success = false
Failed IN9 269 OUT6 227
×
LcbPermuteKTimesLiveCodeBench / atcoder / hard: abc367_e Permute K times (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PermuteKTimes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:21: Variable 'newPosInCycle' has type 'int' but its initializer has type 'long'. Values: run.Compiled = false
Failed IN9 244 OUT12 146
×
LcbRearrangeQueryLiveCodeBench / atcoder / hard: abc367_f Rearrange Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RearrangeQuery case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 297 OUT3 648
!
LcbSumXorKLiveCodeBench / atcoder / hard: abc367_g Sum of (XOR^K or 0) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 298 OUT62 144
Code Generation - LiveCodeBench v4 AtCoder (set 3) 4 passed5 failed
44.4%
IN83 493 OUT71 885
✓
LcbArrangeArithmeticLiveCodeBench / atcoder / abc369_a: 369 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 211 OUT1 292
×
LcbAsFarAsPossibleLiveCodeBench / atcoder / abc369_g: As far as possible (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AsFarAsPossible case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:11: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 370 OUT36 254
×
LcbBonusExpLiveCodeBench / atcoder / abc369_d: Bonus EXP (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
The value in FromJson result must be a JSON string (script type 'string'), but it is the number 28.
Failed IN9 275 OUT4 586
×
LcbCountArithmeticSubarraysLiveCodeBench / atcoder / abc369_c: Count Arithmetic Subarrays (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: CountArithmeticSubarrays case0: expected [8] got [7]
Failed IN9 256 OUT1 886
×
LcbDividingGameLiveCodeBench / atcoder / abc368_f: Dividing Game (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: DividingGame case0 runtime error: Cannot parse '2 3 4' as long. Values: run.Success = false
Failed IN9 260 OUT2 043
✓
LcbMinimumSteinerTreeLiveCodeBench / atcoder / abc368_d: Minimum Steiner Tree (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 218 OUT4 081
✓
LcbPiano3LiveCodeBench / atcoder / abc369_b: Piano 3 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 308 OUT1 963
×
LcbTrainDelayLiveCodeBench / atcoder / abc368_e: Train Delay (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TrainDelay case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 342 OUT15 346
✓
LcbTripleAttackLiveCodeBench / atcoder / abc368_c: Triple Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 253 OUT4 434
Code Generation - LiveCodeBench v4 AtCoder (set 4) 2 passed6 failed
25.0%
IN74 383 OUT49 855
✓
LcbAvoidKPartitionLiveCodeBench / atcoder / abc370_e: Avoid K Partition (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 318 OUT2 892
×
LcbBinaryAlchemyLiveCodeBench / atcoder / abc370_b: Binary Alchemy (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BinaryAlchemy case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 250 OUT1 405
×
LcbCakeDivisionLiveCodeBench / atcoder / abc370_f: Cake Division (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CakeDivision case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 53:26: Operator '!=' cannot compare 'List<int>' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. 158:13: Function 'BuildPartition' must return 'List<int>', but this return statement has type 'null'. 162:5: Function 'BuildPartition' must return 'List<int>', but this return statement has type 'null'. Values: run.Compiled = false
Failed IN9 369 OUT1 238
×
LcbCrossExplosionLiveCodeBench / atcoder / abc370_d: Cross Explosion (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CrossExplosion case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 23:45: Expected ')' to close the argument list, found 'rec'. Values: run.Compiled = false
Failed IN9 346 OUT19 580
×
LcbDivisibleByThreeLiveCodeBench / atcoder / abc370_g: Divisible by 3 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: DivisibleByThree case0 runtime error: List index 2 is out of range. The list has 1 element(s). Values: run.Success = false
Failed IN9 194 OUT8 176
✓
LcbRaiseBothHandsLiveCodeBench / atcoder / abc370_a: Raise Both Hands (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 265 OUT916
×
LcbSightseeingTourLiveCodeBench / atcoder / abc369_e: Sightseeing Tour (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SightseeingTour case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found '.'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 366 OUT13 255
×
LcbWordLadderLiveCodeBench / atcoder / abc370_c: Word Ladder (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WordLadder case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 27:31: Expected a type name after 'new', found 'string'. Values: run.Compiled = false
Failed IN9 275 OUT2 393
Code Generation - LiveCodeBench v4 AtCoder (set 5) 3 passed6 failed
33.3%
IN83 455 OUT51 885
×
LcbCountABCAgainLiveCodeBench / atcoder / medium: abc372_c Count ABC Again (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 241 OUT1 181
✓
LcbDistinctSubarraySumLiveCodeBench / atcoder / hard: abc371_e I Hate Sigma Problems (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 209 OUT3 706
×
LcbKthLargestConnectedLiveCodeBench / atcoder / hard: abc372_e K (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: KthLargestConnected case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 279 OUT1 569
×
LcbLexSmallestPermLiveCodeBench / atcoder / hard: abc371_g Lexicographically Smallest Permutation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: LexSmallestPerm case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 15:23: Unknown variable 'Enumerable'. 45:36: Unknown variable 'Enumerable'. 52:32: Unknown variable 'Enumerable'. 60:17: Cannot assign a value of type 'long' to variable 'bestShift' of type 'int'. 67:32: Unknown variable 'Enumerable'. 79:15: Type 'StringBuilder' has no fields. Only struct values support '.Length'. Values: run.Compiled = false
Failed IN9 248 OUT8 649
×
LcbMakeIsomorphicLiveCodeBench / atcoder / medium: abc371_c Make Isomorphic (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MakeIsomorphic case0 runtime error: Cannot parse '1 2' as int. Values: run.Success = false
Failed IN9 402 OUT5 146
✓
LcbMiddleBrotherLiveCodeBench / atcoder / easy: abc371_a Jiro (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 228 OUT480
×
LcbNarrowRoadLiveCodeBench / atcoder / hard: abc371_f Takahashi in Narrow Road (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NarrowRoad case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 289 OUT30 030
×
LcbOneDCountryLiveCodeBench / atcoder / medium: abc371_d 1D Country (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OneDCountry case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:29: Unexpected character '×'. 6:9: Char literals must contain exactly one character and close with '''. 18:2: Char literals must contain exactly one character and close with '''. 30:48: Unexpected character '×'. 30:93: Char literals must contain exactly one character and close with '''. 32:46: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 281 OUT659
✓
LcbTaroNameLiveCodeBench / atcoder / easy: abc371_b Taro (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 278 OUT465
Code Generation - LiveCodeBench v4 AtCoder (set 6) 2 passed4 failed1 broken1 skipped
28.6%
IN64 731 OUT102 412
!
LcbAxByLessCLiveCodeBench / atcoder / hard: abc372_g Ax + By < C (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 304 OUT62 144
✓
LcbDeleteDotsLiveCodeBench / atcoder / easy: abc372_a delete . (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 153 OUT69
×
LcbDiminishingKnapsackLiveCodeBench / atcoder / hard: abc373_f Knapsack with Diminishing Values (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DiminishingKnapsack case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 110:5: Not all code paths in function 'SortByGainDescending' return a value. Values: run.Compiled = false
Failed IN9 245 OUT7 530
–
LcbNoCrossMatchingLiveCodeBench / atcoder / hard: abc373_g No Cross Matching (Pattern B, stdin) NOTE: non-unique answer — any non-crossing perfect matching R is valid; the exact-match oracle may reject a different valid R.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbOneDKeyboardLiveCodeBench / atcoder / easy: abc373_b 1D Keyboard (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OneDKeyboard case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:9: Cannot assign a value of type 'int' to variable 'c' of type 'char'. Values: run.Compiled = false
Failed IN9 246 OUT510
×
LcbSeptemberLengthsLiveCodeBench / atcoder / easy: abc373_a September (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SeptemberLengths case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:10: Expected '(' to declare a function or '=' to declare a global variable after 'int count', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 183 OUT63
×
LcbTeleportingWalksLiveCodeBench / atcoder / hard: abc372_f Teleporting Takahashi 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TeleportingWalks case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 364 OUT27 394
✓
LcbVisibleBuildingsLiveCodeBench / atcoder / medium: abc372_d Buildings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 236 OUT4 702
Code Generation - LiveCodeBench v4 AtCoder (set 7) 1 passed4 failed1 broken1 skipped
16.7%
IN55 578 OUT105 345
!
LcbAnnoyingStringLiveCodeBench / atcoder / hard: arc181_b Annoying String Problem (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 263 OUT62 144
×
LcbIncDecAgainLiveCodeBench / atcoder / hard: arc182_d Increment Decrement Again (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IncDecAgain case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 38:26: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 308 OUT10 512
✓
LcbMaxAiBjLiveCodeBench / atcoder / medium: abc373_c Max Ai+Bj (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 174 OUT389
×
LcbPrefixBubbleSortLiveCodeBench / atcoder / hard: arc181_d Prefix Bubble Sort (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PrefixBubbleSort case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:34: Expected a type name after 'new', found 'long'. Values: run.Compiled = false
Failed IN9 294 OUT12 738
–
LcbRowColumnOrderLiveCodeBench / atcoder / hard: arc181_c Row and Column Order (Pattern B, stdin) TRIAGE: non-unique answer (any valid grid accepted) — exact string compare may fail correct solutions.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbSortLeftRightLiveCodeBench / atcoder / medium: arc181_a Sort Left and Right (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 266 OUT14 027
×
LcbWinElectionLiveCodeBench / atcoder / hard: abc373_e How to Win the Election (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WinElection case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:23: Unknown variable 'Enumerable'. 1:8: Not all code paths in function 'Solve' return a value. Values: run.Compiled = false
Failed IN9 273 OUT5 535
Code Generation - LiveCodeBench v4 AtCoder (set 8) 5 failed1 broken1 skipped
0.0%
IN55 392 OUT151 077
×
LcbChmaxRushLiveCodeBench / atcoder / hard: arc182_a Chmax Rush! (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ChmaxRush case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:25: Expected a parameter name, found '['. Values: run.Compiled = false
Failed IN9 360 OUT33 365
×
LcbDivisorsOfProductLiveCodeBench / atcoder / hard: arc182_c Sum of Number of Divisors of Product (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DivisorsOfProduct case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:13: Unexpected character '≤'. 13:12: Unexpected character 'Σ'. 13:36: Unexpected character '·'. Values: run.Compiled = false
Failed IN9 205 OUT16 295
–
LcbKeepMatchedLiveCodeBench / atcoder / hard: arc183_d Keep Perfectly Matched (Pattern B, stdin) TRIAGE: non-unique answer (any maximizing procedure accepted) — exact string compare may fail correct solutions.0 AI queries 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbMedianGoodSeqLiveCodeBench / atcoder / medium: arc183_a Median of Good Sequences (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MedianGoodSeq case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:11: Expected a field name, found '('. Values: run.Compiled = false
Failed IN9 177 OUT19 240
×
LcbNearAssignmentLiveCodeBench / atcoder / hard: arc183_b Near Assignment (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 242 OUT1 638
×
LcbNotArgmaxLiveCodeBench / atcoder / hard: arc183_c Not Argmax (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NotArgmax case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:28: Expected '(' to declare a function or '=' to declare a global variable after 'Dictionary<long, long> fact', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 227 OUT18 395
!
LcbSumMinModLinearLiveCodeBench / atcoder / hard: arc182_e Sum of Min of Mod of Linear (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 181 OUT62 144
Code Generation - LiveCodeBench v4 LeetCode (set 1) 2 passed4 failed
33.3%
IN55 193 OUT14 634
×
LcbAlmostEqualPairsLiveCodeBench / leetcode / medium: count-almost-equal-pairs-i (id 3534)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: almostequal case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:17: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 200 OUT1 539
✓
LcbBeautifulArraySumLiveCodeBench / leetcode / medium: find-the-minimum-possible-sum-of-a-beautiful-array (id 3026)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 189 OUT2 377
✓
LcbFinalArrayStateLiveCodeBench / leetcode / easy: final-array-state-after-k-multiplication-operations-i (id 3555)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 212 OUT1 936
×
LcbKConstraintSubstringsLiveCodeBench / leetcode / easy: count-substrings-that-satisfy-k-constraint-i (id 3543)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: kconstraint case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:3: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 193 OUT1 888
×
LcbLargestKPalindromeLiveCodeBench / leetcode / hard: find-the-largest-palindrome-divisible-by-k (id 3552)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: kpalindrome case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 51:17: Type 'StringBuilder' has no fields. Only struct values support '.Length'. 55:20: Type 'StringBuilder' cannot be indexed with [...]. Only List, Dictionary and string values support indexing. 56:11: Type 'StringBuilder' cannot be assigned by index. Only List and Dictionary elements can be assigned. 56:19: Type 'StringBuilder' cannot be indexed with [...]. Only List, Dictionary and string values support indexing. 57:11: Type 'StringBuilder' cannot be assigned by index. Only List and Dictionary elements can be assigned. Values: run.Compiled = false
Failed IN9 164 OUT2 077
×
LcbMaxEnergyBoostLiveCodeBench / leetcode / medium: maximum-energy-boost-from-two-drinks (id 3525)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: energyboost case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 235 OUT4 817
Code Generation - LiveCodeBench v4 LeetCode (set 2) 4 passed2 failed
66.7%
IN55 280 OUT10 357
✓
LcbConvertDateBinaryLiveCodeBench / leetcode / easy: convert-date-to-binary (id 3567)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 183 OUT1 673
✓
LcbKthNearestObstacleLiveCodeBench / leetcode / medium: k-th-nearest-obstacle-queries (id 3495)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 252 OUT1 085
×
LcbMaxCellScoreLiveCodeBench / leetcode / hard: select-cells-in-grid-with-maximum-score (id 3563)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxcell case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:16: Type 'Dictionary<int, bool>' has no supported method named 'Add' with 2 argument(s). 43:16: Type 'Dictionary<int, bool>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
Failed IN9 180 OUT1 755
×
LcbMaxRangeScoreLiveCodeBench / leetcode / medium: maximize-score-of-numbers-in-ranges (id 3485)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: rangescore case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:14: Expected '>' to close the List type, found '['. Values: run.Compiled = false
Failed IN9 175 OUT1 576
✓
LcbMaxXorSubarrayLiveCodeBench / leetcode / hard: maximum-xor-score-subarray-queries (id 3551)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 315 OUT4 123
✓
LcbSameChessboardColorLiveCodeBench / leetcode / easy: check-if-two-chessboard-squares-have-the-same-color (id 3553)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 175 OUT145
Code Generation - LiveCodeBench v4 LeetCode (set 3) 2 passed4 failed
33.3%
IN55 521 OUT16 106
×
LcbKnightKillPawnsLiveCodeBench / leetcode / hard: maximum-number-of-moves-to-kill-all-pawns (LCB 3560)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: knightPawns case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 73:36: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('. Values: run.Compiled = false
Failed IN9 345 OUT7 685
×
LcbMaxMultiplicationScoreLiveCodeBench / leetcode / medium: maximum-multiplication-score (LCB 3518)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxMul case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 290 OUT2 906
×
LcbMinValidStringsLiveCodeBench / leetcode / medium: minimum-number-of-valid-strings-to-form-target-i (LCB 3559)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: minValid case0 runtime error: Substring(start: 4, length: 5) is out of range for a string of length 8. Values: run.Success = false
Failed IN9 187 OUT433
✓
LcbPowerKSizeSubarraysLiveCodeBench / leetcode / medium: find-the-power-of-k-size-subarrays-i (LCB 3522)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 255 OUT1 606
×
LcbReachEndMaxScoreLiveCodeBench / leetcode / medium: reach-end-of-array-with-max-score (LCB 3528)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: reachEnd case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 211 OUT2 008
✓
LcbThreeRooksMaxSumLiveCodeBench / leetcode / hard: maximum-value-sum-by-placing-three-rooks-i (LCB 3550)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 233 OUT1 468
Code Generation - LiveCodeBench v4 LeetCode (set 4) 1 passed5 failed
16.7%
IN55 672 OUT33 073
×
LcbCountGoodIntegersLiveCodeBench / leetcode / hard: find-the-count-of-good-integers (LCB 3548)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: goodInt case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 126:51: Operator '+' cannot be applied to 'string' and 'int'. It supports numbers and string/char concatenation. 153:13: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 154:20: Unknown variable 'i'. 156:36: Unknown variable 'i'. 158:43: Unknown variable 'i'. 160:17: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 160:17: Unknown variable 'i'. 183:5: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 184:12: Unknown variable 'i'. 187:9: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 187:9: Unknown variable 'i'. 190:5: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 200:9: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 201:16: Unknown variable 'i'. 203:38: Unknown variable 'i'. 204:13: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 204:13: Unknown variable 'i'. 212:9: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 213:16: Unknown variable 'i'. 215:33: Unknown variable 'totalPermissions'. 215:67: Unknown variable 'i'. 216:13: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 216:13: Unknown variable 'i'. 225:13: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 226:20: Unknown variable 'i'. 228:35: Unknown variable 'badPermissions'. 228:67: Unknown variable 'i'. 229:17: Unknown variable 'i'. Declare it first, e.g. 'int i = ...;'. 229:17: Unknown variable 'i'. Values: run.Compiled = false
Failed IN9 272 OUT3 143
×
LcbGenerateKeyNumbersLiveCodeBench / leetcode / easy: find-the-key-of-the-numbers (LCB 3568)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: genKey case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:32: Type 'string' has no supported method named 'PadLeft'. 4:32: Type 'string' has no supported method named 'PadLeft'. 5:32: Type 'string' has no supported method named 'PadLeft'. 7:34: 'Min' expects numeric arguments, but got 'char' and 'char'. 8:34: 'Min' expects numeric arguments, but got 'char' and 'char'. 9:34: 'Min' expects numeric arguments, but got 'char' and 'char'. 10:34: 'Min' expects numeric arguments, but got 'char' and 'char'. Values: run.Compiled = false
Failed IN9 296 OUT1 806
✓
LcbHashDividedStringLiveCodeBench / leetcode / medium: hash-divided-string (LCB 3540)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 273 OUT231
×
LcbMaxSequenceValueLiveCodeBench / leetcode / hard: find-the-maximum-sequence-value-of-array (LCB 3575)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxSeq case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:13: Expected '{' to start a block, found ':'. Values: run.Compiled = false
Failed IN9 236 OUT19 912
×
LcbMinDamageToBobLiveCodeBench / leetcode / hard: minimum-amount-of-damage-dealt-to-bob (LCB 3531)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minDmg case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 37:24: Expected ')' to close the parenthesized expression, found 'a'. Values: run.Compiled = false
Failed IN9 271 OUT482
×
LcbSafeWalkGridLiveCodeBench / leetcode / medium: find-a-safe-walk-through-a-grid (LCB 3558)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: safeWalk case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:23: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 324 OUT7 499
Code Generation - LiveCodeBench v4 LeetCode (set 5) 1 passed5 failed
16.7%
IN55 287 OUT22 588
×
LcbKthCharacterGameLiveCodeBench 3600 / leetcode / easy: find the k-th character in string game I (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: kthCharacterGame case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:5: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'while'. Values: run.Compiled = false
Failed IN9 208 OUT3 702
×
LcbLongestIncreasingPathLiveCodeBench 3571 / leetcode / hard: length of the longest increasing path (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestIncreasingPath case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:20: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
Failed IN9 281 OUT7 945
×
LcbMountainHeightZeroLiveCodeBench 3496 / leetcode / medium: minimum number of seconds to make mountain height zero (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: mountainHeightZero case1: expected 12 got 40
Failed IN9 281 OUT316
✓
LcbReportSpamLiveCodeBench 3541 / leetcode / medium: report spam message (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 164 OUT103
×
LcbSubstringsVowelsKConsonantsLiveCodeBench 3570 / leetcode / medium: count of substrings containing every vowel and k consonants I (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: substringsVowelsKConsonants case1: expected 1 got 0
Failed IN9 168 OUT4 495
×
LcbValidSubstringCountLiveCodeBench 3573 / leetcode / medium: count substrings that can be rearranged to contain a string I (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: validSubstringCount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 18:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 70:21: Variable 'oldNeed' is already declared in this scope or an enclosing one. Values: run.Compiled = false
Failed IN9 185 OUT6 027
Code Generation - LiveCodeBench v4 LeetCode (set 6) 4 passed2 failed
66.7%
IN55 312 OUT13 085
✓
LcbFirstAlmostEqualSubstringLiveCodeBench 3580 / leetcode / hard: find the occurrence of first almost equal substring (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 200 OUT214
×
LcbLexSmallestValidSequenceLiveCodeBench 3584 / leetcode / medium: find the lexicographically smallest valid sequence (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: lexSmallestValidSequence case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 53:33: Unknown function 'GetCanComplete'. 59:32: Unknown function 'GetCanComplete'. 63:32: Unknown function 'GetCanComplete'. 69:29: Unknown function 'MakeKey'. 74:10: Unknown function 'GetCanComplete'. 98:21: Unknown function 'GetCanComplete'. 108:21: Unknown function 'GetCanComplete'. Values: run.Compiled = false
Failed IN9 281 OUT6 742
×
LcbMaxBinaryConcatenationLiveCodeBench 3579 / leetcode / medium: maximum possible number by binary concatenation (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxBinaryConcatenation case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:19: Unknown variable 'Convert'. 18:19: Unknown variable 'Convert'. 19:19: Unknown variable 'Convert'. Values: run.Compiled = false
Failed IN9 168 OUT2 593
✓
LcbMaxUniqueTowerHeightsLiveCodeBench 3510 / leetcode / medium: maximize the total height of unique towers (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 205 OUT1 735
✓
LcbMinAfterDigitSumLiveCodeBench 3606 / leetcode / easy: minimum element after replacement with digit sum (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 161 OUT144
✓
LcbSortedGcdPairQueriesLiveCodeBench 3583 / leetcode / hard: sorted GCD pair queries (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V4@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 297 OUT1 657
Code Generation - LiveCodeBench v5 AtCoder (set 1) 5 passed5 failed2 skipped
50.0%
IN92 223 OUT27 203
✓
LcbAbaPalindromeLiveCodeBench / atcoder / medium: abc375_d ABA (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 191 OUT1 818
–
LcbLaserMarkingLiveCodeBench / atcoder / medium: abc374_d Laser Marking (Pattern B, stdin) [float output, tolerance 1e-6]0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Skipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected
Skipped IN0 OUT0
×
LcbOnlyOneProductNameLiveCodeBench / atcoder / hard: abc374_g Only One Product Name (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: OnlyOneProductName case1: expected [2] got [3]
Failed IN9 229 OUT3 660
×
LcbSeatsLiveCodeBench / atcoder / easy: abc375_a Seats (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Seats case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, CountPattern. Values: run.Compiled = false
Failed IN9 184 OUT763
✓
LcbSensorOptimizationLiveCodeBench / atcoder / hard: abc374_e Sensor Optimization Dilemma 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 280 OUT3 855
✓
LcbSeparatedLunchLiveCodeBench / atcoder / medium: abc374_c Separated Lunch (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 201 OUT640
×
LcbShippingLiveCodeBench / atcoder / hard: abc374_f Shipping (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Shipping case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:19: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 283 OUT8 204
×
LcbSpiralRotationLiveCodeBench / atcoder / medium: abc375_c Spiral Rotation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 251 OUT3 790
✓
LcbTakahashiSanLiveCodeBench / atcoder / easy: abc374_a Takahashi san 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 153 OUT57
×
LcbThreeTeamDivisionLiveCodeBench / atcoder / hard: abc375_e 3 Team Division (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ThreeTeamDivision case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 270 OUT4 242
–
LcbTravelingTakahashiLiveCodeBench / atcoder / easy: abc375_b Traveling Takahashi Problem (Pattern B, stdin) [float output, tolerance 1e-6]0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Skipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected
Skipped IN0 OUT0
✓
LcbUnvarnishedReportLiveCodeBench / atcoder / easy: abc374_b Unvarnished Report (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 181 OUT174
Code Generation - LiveCodeBench v5 AtCoder (set 2) 3 passed8 failed
27.3%
IN102 102 OUT124 316
×
LcbAvoidKnightAttackLiveCodeBench / atcoder / medium: abc377_c Avoid Knight Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AvoidKnightAttack case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 307 OUT2 456
✓
LcbAvoidRookAttackLiveCodeBench / atcoder / easy: abc377_b Avoid Rook Attack (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 255 OUT2 831
×
LcbCandyButtonLiveCodeBench / atcoder / easy: abc376_a Candy Button (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CandyButton case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 223 OUT123
×
LcbCycleMinEdgesLiveCodeBench / atcoder / medium: abc376_d Cycle (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CycleMinEdges case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 51:35: Operator '+' cannot be applied to 'long?' and 'int'. It supports numbers and string/char concatenation. 62:38: Operator '+' cannot be applied to 'long?' and 'int'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 245 OUT1 825
✓
LcbHandsOnRingEasyLiveCodeBench / atcoder / medium: abc376_b Hands on Ring (Easy) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 289 OUT5 116
×
LcbHandsOnRingHardLiveCodeBench / atcoder / hard: abc376_f Hands on Ring (Hard) (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: HandsOnRingHard case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:35: Expected ')' to close the argument list, found 'L'. Values: run.Compiled = false
Failed IN9 294 OUT49 191
×
LcbMaxTimesSumLiveCodeBench / atcoder / hard: abc376_e Max x Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaxTimesSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 281 OUT5 675
✓
LcbPrepareAnotherBoxLiveCodeBench / atcoder / medium: abc376_c Prepare Another Box (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 278 OUT5 010
×
LcbRoadBlockedLiveCodeBench / atcoder / hard: abc375_f Road Blocked (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 304 OUT1 880
×
LcbRoadBlocked2LiveCodeBench / atcoder / hard: abc375_g Road Blocked 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RoadBlocked2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 293 OUT27 943
×
LcbTreasureHuntingLiveCodeBench / atcoder / hard: abc376_g Treasure Hunting (Pattern B, stdin) [answer modulo 998244353]1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TreasureHunting case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:16: Variable 'MOD' is already declared in this scope or an enclosing one. 138:17: Cannot assign a value of type 'long' to variable 'offset' of type 'int'. Values: run.Compiled = false
Failed IN9 333 OUT22 266
Code Generation - LiveCodeBench v5 AtCoder (set 3) 5 passed9 failed
35.7%
IN128 802 OUT47 926
✓
LcbAddOneEdge2LiveCodeBench / atcoder abc378_f: Add One Edge 2 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 176 OUT4 702
×
LcbAvoidQueenAttackLiveCodeBench / atcoder abc377_f: Avoid Queen Attack (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AvoidQueenAttack case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected '(' to declare a function or '=' to declare a global variable after 'long N', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 247 OUT16 501
×
LcbCountSimplePathsLiveCodeBench / atcoder abc378_d: Count Simple Paths (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountSimplePaths case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int H', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 195 OUT2 864
×
LcbEditToMatchLiveCodeBench / atcoder abc377_g: Edit to Match (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EditToMatch case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:32: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '('. Values: run.Compiled = false
Failed IN9 250 OUT2 755
×
LcbEverlastingLidsLiveCodeBench / atcoder abc378_g: Everlasting LIDS (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EverlastingLids case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 227 OUT2 757
×
LcbGarbageCollectionLiveCodeBench / atcoder abc378_b: Garbage Collection (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 217 OUT1 325
✓
LcbManySegments2LiveCodeBench / atcoder abc377_d: Many Segments 2 (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 207 OUT5 549
✓
LcbModSigmaProblemLiveCodeBench / atcoder abc378_e: Mod Sigma Problem (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 183 OUT3 047
×
LcbPairingLiveCodeBench / atcoder abc378_a: Pairing (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Pairing case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:24: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 22:5: Function 'Solve' must return 'int', but this return statement has type 'string'. Values: run.Compiled = false
Failed IN9 168 OUT300
×
LcbPermuteKTimesLiveCodeBench / atcoder abc377_e: Permute K times 2 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PermuteKTimes case0: expected [6 1 3 2 4 5] got [4 5 3 6 1 2]
Failed IN9 203 OUT3 866
×
LcbRearrangingAbcLiveCodeBench / atcoder abc377_a: Rearranging ABC (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: RearrangingAbc case1: expected [No] got [Yes]
Failed IN9 164 OUT235
✓
LcbRepeatingLiveCodeBench / atcoder abc378_c: Repeating (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 185 OUT427
✓
LcbStrawberriesLiveCodeBench / atcoder abc379_b: Strawberries (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 188 OUT985
×
LcbSumOfAllSubstringsLiveCodeBench / atcoder abc379_e: Sum of All Substrings (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SumOfAllSubstrings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 42:12: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 192 OUT2 613
Code Generation - LiveCodeBench v5 AtCoder (set 4) 5 passed9 failed
35.7%
IN129 011 OUT102 217
✓
Lcb1122StringLiveCodeBench / atcoder abc381_a: 11/22 String (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 273 OUT778
×
Lcb1122SubsequenceLiveCodeBench / atcoder abc381_e: 11/22 Subsequence (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Subsequence1122 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 15:22: Type 'List<long>' has no supported method named 'Last' with 0 argument(s). 16:22: Type 'List<long>' has no supported method named 'Last' with 0 argument(s). Values: run.Compiled = false
Failed IN9 268 OUT2 933
×
LcbAnotherShuffleWindowLiveCodeBench / atcoder abc380_g: Another Shuffle Window (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AnotherShuffleWindow case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, ModInverse. Values: run.Compiled = false
Failed IN9 275 OUT33 347
×
LcbBucketToolLiveCodeBench / atcoder abc380_e: 1D Bucket Tool (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BucketTool case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 56:23: Assignment target must be a variable or an element like 'items[0]'. Assigning to struct fields is not supported. Values: run.Compiled = false
Failed IN9 211 OUT8 252
×
LcbBuildings2LiveCodeBench / atcoder abc379_f: Buildings 2 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 221 OUT2 488
×
LcbCountGrid3LiveCodeBench / atcoder abc379_g: Count Grid 3 (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountGrid3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 203 OUT9 831
✓
LcbCyclicLiveCodeBench / atcoder abc379_a: Cyclic (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 177 OUT122
✓
LcbDigitPattern123233LiveCodeBench / atcoder abc380_a: 123233 (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 164 OUT374
×
LcbExchangeGameLiveCodeBench / atcoder abc380_f: Exchange Game (hard)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ExchangeGame case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:5: Unexpected character '#'. 2:29: Char literals must contain exactly one character and close with '''. 3:5: Unexpected character '#'. 4:5: Unexpected character '#'. 7:23: Unexpected character '#'. 8:27: Unexpected character '#'. 14:13: Unexpected character '#'. 18:17: Unexpected character '#'. 18:22: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 255 OUT31 998
×
LcbHomeGardenLiveCodeBench / atcoder abc379_d: Home Garden (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: HomeGarden case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 191 OUT2 502
✓
LcbHurdleParsingLiveCodeBench / atcoder abc380_b: Hurdle Parsing (easy)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 175 OUT1 456
×
LcbMoveSegmentLiveCodeBench / atcoder abc380_c: Move Segment (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: MoveSegment case0 runtime error: Cannot parse '15 3' as int. Values: run.Success = false
Failed IN9 186 OUT1 427
✓
LcbSowingStonesLiveCodeBench / atcoder abc379_c: Sowing Stones (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 218 OUT1 969
×
LcbStrangeMirroringLiveCodeBench / atcoder abc380_d: Strange Mirroring (medium)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StrangeMirroring case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:8: Not all code paths in function 'Solve' return a value. Values: run.Compiled = false
Failed IN9 194 OUT4 740
Code Generation - LiveCodeBench v5 AtCoder (set 5) 5 passed8 failed
38.5%
IN121 123 OUT79 723
✓
Lcb1122StringLiveCodeBench / atcoder / easy: 1122 String (abc381_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 256 OUT691
✓
Lcb1122SubarrayLiveCodeBench / atcoder / hard: 1122 Substring (abc381_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 296 OUT2 511
✓
LcbDailyCookieLiveCodeBench / atcoder / easy: Daily Cookie (abc382_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 262 OUT771
×
LcbDailyCookie2LiveCodeBench / atcoder / easy: Daily Cookie 2 (abc382_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DailyCookie2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 284 OUT187
×
LcbFallingBarsLiveCodeBench / atcoder / hard: Falling Bars (abc382_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FallingBars case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:5: 'void' can only be used as a function return type, not here. Values: run.Compiled = false
Failed IN9 405 OUT7 942
✓
LcbHumidifier1LiveCodeBench / atcoder / easy: Humidifier 1 (abc383_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 255 OUT1 104
×
LcbHumidifier2LiveCodeBench / atcoder / medium: Humidifier 2 (abc383_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Humidifier2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:10: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 319 OUT2 171
×
LcbHumidifier3LiveCodeBench / atcoder / medium: Humidifier 3 (abc383_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Humidifier3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:10: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 309 OUT2 650
×
LcbKaitenSushiLiveCodeBench / atcoder / medium: Kaiten Sushi (abc382_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 315 OUT2 594
×
LcbKeepDistanceLiveCodeBench / atcoder / hard: Keep Distance (abc382_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: KeepDistance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:36: Expected ')' to close the argument list, found 'sequences'. Values: run.Compiled = false
Failed IN9 278 OUT2 760
✓
LcbMax1122SubstringLiveCodeBench / atcoder / medium: 11/22 Substring (abc381_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 381 OUT2 014
×
LcbSumOfMaxMatchingLiveCodeBench / atcoder / hard: Sum of Max Matching (abc383_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SumOfMaxMatching case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:17: Expected '(' to declare a function or '=' to declare a global variable after 'List<int> parent', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 367 OUT8 754
×
LcbTileDistance3LiveCodeBench / atcoder / hard: Tile Distance 3 (abc382_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TileDistance3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 36:16: Expected ';' after the variable declaration, found ','. Values: run.Compiled = false
Failed IN9 396 OUT45 574
Code Generation - LiveCodeBench v5 AtCoder (set 6) 6 passed7 failed1 skipped
46.2%
IN120 927 OUT84 411
×
LcbAbsSumLiveCodeBench / atcoder / hard: Abs Sum (abc384_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 316 OUT4 447
✓
LcbArcDivisionLiveCodeBench / atcoder / easy: ARC Division (abc384_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 363 OUT416
×
LcbDoubleSum2LiveCodeBench / atcoder / hard: Double Sum 2 (abc384_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DoubleSum2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 253 OUT36 163
✓
LcbEquallyLiveCodeBench / atcoder / easy: Equally (abc385_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 186 OUT1 233
×
LcbIlluminateBuildingsLiveCodeBench / atcoder / medium: Illuminate Buildings (abc385_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: IlluminateBuildings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 226 OUT2 266
×
LcbMaximizeXorLiveCodeBench / atcoder / hard: Maximize XOR (abc386_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaximizeXor case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:12: Expected '(' to declare a function or '=' to declare a global variable after 'long maxXor', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 242 OUT3 420
×
LcbPerfectStandingsLiveCodeBench / atcoder / medium: Perfect Standings (abc384_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PerfectStandings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:25: Unknown type 'Participant'. Supported types: bool, byte, int, decimal, double, char, string, Date, DateTime, TimeSpan, List<...>, Dictionary<...>, HashSet<...> and declared structs. 1:43: Unknown type 'Participant'. Supported types: bool, byte, int, decimal, double, char, string, Date, DateTime, TimeSpan, List<...>, Dictionary<...>, HashSet<...> and declared structs. Values: run.Compiled = false
Failed IN9 304 OUT1 913
✓
LcbRepeatedSequenceLiveCodeBench / atcoder / medium: Repeated Sequence (abc384_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 248 OUT14 538
✓
LcbReplaceExceptCharLiveCodeBench / atcoder / easy: aaaadaa (abc384_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 204 OUT688
×
LcbSantaClaus1LiveCodeBench / atcoder / easy: Santa Claus 1 (abc385_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SantaClaus1 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 80:19: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 469 OUT651
✓
LcbSantaClaus2LiveCodeBench / atcoder / hard: Santa Claus 2 (abc385_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 444 OUT3 306
×
LcbSlime2LiveCodeBench / atcoder / hard: Takahashi is Slime 2 (abc384_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Slime2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:8: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 378 OUT4 538
✓
LcbSnowflakeTreeLiveCodeBench / atcoder / hard: Snowflake Tree (abc385_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 294 OUT10 832
–
LcbVisibleBuildingsLiveCodeBench / atcoder / hard: Visible Buildings (abc385_f)0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: float output compared as exact string -- a correct answer within tolerance would be rejected
Skipped IN0 OUT0
Code Generation - LiveCodeBench v5 AtCoder (set 7) 3 passed8 failed1 broken1 skipped
25.0%
IN111 009 OUT256 184
×
LcbAccumulatingManyTimesLiveCodeBench / atcoder / hard: arc184_e Accumulating Many Times (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AccumulatingManyTimes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:10: Expected an expression, found 'List'. Values: run.Compiled = false
Failed IN9 291 OUT53 660
×
LcbAdjacentGcdLiveCodeBench / atcoder / hard: arc185_e Adjacent GCD (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AdjacentGcd case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 118:16: Unexpected character 'Σ'. 118:36: Unexpected character 'Σ'. 123:16: Unexpected character 'Σ'. 123:40: Unexpected character 'Σ'. 127:16: Unexpected character 'Σ'. 127:36: Unexpected character 'Σ'. 130:21: Unexpected character 'Σ'. 133:24: Char literals must contain exactly one character and close with '''. 136:21: Unexpected character 'Σ'. 137:11: Unexpected character 'Σ'. 137:31: Unexpected character 'Σ'. 137:54: Unexpected character 'φ'. 138:11: Unexpected character 'Σ'. 138:24: Unexpected character 'φ'. 138:31: Unexpected character 'Σ'. 140:23: Unexpected character 'Σ'. 142:26: Unexpected character 'Σ'. 142:39: Unexpected character 'φ'. 157:54: Unexpected character 'Σ'. 157:67: Unexpected character 'φ'. Values: run.Compiled = false
Failed IN9 267 OUT6 976
×
LcbCalculatorMinPressesLiveCodeBench / atcoder / easy: abc386_b Calculator (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CalculatorMinPresses case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:17: Expected ';' after the global variable declaration, found ','. Values: run.Compiled = false
Failed IN9 208 OUT1 144
✓
LcbDiagonalSeparationLiveCodeBench / atcoder / hard: abc386_d Diagonal Separation (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 287 OUT4 879
×
LcbEraseBalls2DLiveCodeBench / atcoder / hard: arc184_d Erase Balls 2D (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: EraseBalls2D case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:39: Expected ')' to close the parenthesized expression, found 'UL'. Values: run.Compiled = false
Failed IN9 253 OUT27 522
✓
LcbFullHouse2LiveCodeBench / atcoder / easy: abc386_a Full House 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 202 OUT2 077
×
LcbMountainValleyFoldsLiveCodeBench / atcoder / hard: arc184_c Mountain and Valley Folds (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MountainValleyFolds case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson, IsMountain. Values: run.Compiled = false
Failed IN9 311 OUT27 119
✓
LcbOperate1LiveCodeBench / atcoder / medium: abc386_c Operate 1 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 211 OUT1 824
×
LcbOperateKLiveCodeBench / atcoder / hard: abc386_f Operate K (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: OperateK case0 runtime error: List index 1 is out of range. The list has 1 element(s). Values: run.Success = false
Failed IN9 215 OUT15 479
×
LcbPlusOneAndLiveCodeBench / atcoder / hard: arc185_b +1 and (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PlusOneAnd case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:2: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 232 OUT24 100
!
LcbRandomWalkOnTreeLiveCodeBench / atcoder / hard: arc185_d Random Walk on Tree (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 282 OUT62 144
–
LcbSumOfThreeIntegersLiveCodeBench / atcoder / hard: arc185_c Sum of Three Integers (Pattern B, stdin) NOTE: multiple valid triples may exist; exact-match oracle may reject a different valid answer.0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbUndercluedLiveCodeBench / atcoder / hard: arc186_a Underclued (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Underclued case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Unexpected character '≠'. 3:2: Unexpected character '≠'. Values: run.Compiled = false
Failed IN9 250 OUT29 260
Code Generation - LiveCodeBench v5 AtCoder (set 8) 2 passed9 failed1 broken1 skipped
16.7%
IN111 144 OUT347 190
×
LcbAbcSymmetryLiveCodeBench / atcoder / hard: arc188_a ABC Symmetry (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AbcSymmetry case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 42:8: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 251 OUT12 908
×
LcbBallAndBoxLiveCodeBench / atcoder / hard: arc186_c Ball and Box (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 288 OUT24 564
!
LcbBallsAndBoxesLiveCodeBench / atcoder / hard: arc189_c Balls and Boxes (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 253 OUT62 144
–
LcbHonestLiarConfusedLiveCodeBench / atcoder / hard: arc188_c Honest or Liar or Confused (Pattern B, stdin) NOTE: multiple valid confused sets may exist; exact-match oracle may reject a different valid answer.0 AI queries 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
✓
LcbMinimizeSumLiveCodeBench / atcoder / hard: arc189_b Minimize Sum (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 237 OUT3 166
×
LcbMirrorAndOrderLiveCodeBench / atcoder / hard: arc188_d Mirror and Order (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: MirrorAndOrder case0: expected [1] got [2]
Failed IN9 322 OUT2 949
×
LcbMissingSubsequenceLiveCodeBench / atcoder / hard: arc186_e Missing Subsequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MissingSubsequence case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 245 OUT57 565
×
LcbPolishManiaLiveCodeBench / atcoder / hard: arc186_d Polish Mania (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: PolishMania case0: expected [2] got [134]
Failed IN9 266 OUT24 445
×
LcbReversi2LiveCodeBench / atcoder / medium: arc189_a Reversi 2 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Reversi2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 38:13: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 279 OUT37 231
×
LcbSumOfCCLiveCodeBench / atcoder / hard: arc187_b Sum of CC (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SumOfCC case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 69:13: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 284 OUT49 797
×
LcbSymmetricPaintingLiveCodeBench / atcoder / hard: arc188_b Symmetric Painting (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: SymmetricPainting case0: expected [Yes No Yes No] got [No No No No ]
Failed IN9 241 OUT17 631
✓
LcbTakahashiIsSlimeLiveCodeBench / atcoder / hard: arc189_d Takahashi is Slime (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 233 OUT3 533
×
LcbTypicalPermutationDescriptorLiveCodeBench / atcoder / hard: arc186_b Typical Permutation Descriptor (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TypicalPermutationDescriptor case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:8: Not all code paths in function 'Solve' return a value. Values: run.Compiled = false
Failed IN9 245 OUT51 257
Code Generation - LiveCodeBench v5 LeetCode (set 1) 3 passed8 failed
27.3%
IN101 058 OUT75 846
×
LcbCountWinningSequencesLiveCodeBench / leetcode / hard: count-the-number-of-winning-sequences1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countWinning case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:27: Expected '>' to close the List type, found '['. Values: run.Compiled = false
Failed IN9 255 OUT3 855
×
LcbDfsPalindromesLiveCodeBench / leetcode / hard: check-if-dfs-strings-are-palindromes1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: dfsPalindromes case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:9: Unexpected character '\'. 4:7: Unexpected character '\'. Values: run.Compiled = false
Failed IN9 259 OUT8 992
×
LcbFindXSumLiveCodeBench / leetcode / easy: find-x-sum-of-all-k-long-subarrays-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: findXSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 231 OUT4 012
✓
LcbIsBalancedStringLiveCodeBench / leetcode / easy: check-balanced-string1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 121 OUT1 368
×
LcbLengthAfterTransformationsLiveCodeBench / leetcode / medium: total-characters-in-string-after-transformations-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: lengthAfter case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:2: Expected a name, found '('. Values: run.Compiled = false
Failed IN9 173 OUT7 018
×
LcbMaxFactorScoreLiveCodeBench / leetcode / medium: find-the-maximum-factor-score-of-array1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxScore case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:22: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 166 OUT5 107
✓
LcbMinDivisionOperationsLiveCodeBench / leetcode / medium: minimum-division-operations-to-make-array-non-decreasing1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 155 OUT5 881
×
LcbMinTimeToReachRoomLiveCodeBench / leetcode / medium: find-minimum-time-to-reach-last-room-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minTimeToReach case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 73:16: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 225 OUT7 512
×
LcbNumberOfSubstringsKFreqLiveCodeBench / leetcode / medium: count-substrings-with-k-frequency-characters-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: numSubstrings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:3: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 111 OUT4 009
✓
LcbStringSequenceLiveCodeBench / leetcode / medium: find-the-sequence-of-strings-appeared-on-the-screen1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 174 OUT2 018
×
LcbSubsequencePairCountGcdLiveCodeBench / leetcode / hard: find-the-number-of-subsequences-with-equal-gcd1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: subseqPair case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 23:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 47:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 188 OUT26 074
Code Generation - LiveCodeBench v5 LeetCode (set 2) 4 passed6 failed
40.0%
IN92 112 OUT97 774
×
LcbCountBalancedPermutationsLiveCodeBench / leetcode / hard: count-number-of-balanced-permutations1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countBalPerm case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 90:10: Expected '(' to declare a function or '=' to declare a global variable after 'long Fact', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 158 OUT7 523
×
LcbCountKReducibleNumbersLiveCodeBench / leetcode / hard: count-k-reducible-numbers-less-than-n1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countKReducible case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 185 OUT36 226
✓
LcbCountValidSelectionsLiveCodeBench / leetcode / easy: make-array-elements-equal-to-zero1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 241 OUT18 861
✓
LcbHasIncreasingSubarraysLiveCodeBench / leetcode / easy: adjacent-increasing-subarrays-detection-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 221 OUT173
✓
LcbIsZeroArrayLiveCodeBench / leetcode / medium: zero-array-transformation-i1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 213 OUT1 543
×
LcbMaximizeSumOfWeightsLiveCodeBench / leetcode / hard: maximize-sum-of-weights-after-edge-removals1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maximizeSumWeights case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 134:22: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
Failed IN9 268 OUT9 505
×
LcbMinAdjacentDifferenceLiveCodeBench / leetcode / hard: minimize-the-maximum-adjacent-element-difference1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minDifference case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 123:30: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 171 OUT9 369
×
LcbMinArraySumLiveCodeBench / leetcode / medium: minimum-array-sum1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minArraySum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 57:45: Expected ')' to close the argument list, found 'var'. Values: run.Compiled = false
Failed IN9 282 OUT12 056
✓
LcbMinimumPositiveSumSubarrayLiveCodeBench / leetcode / easy: minimum-positive-sum-subarray1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 215 OUT284
×
LcbSumOfGoodSubsequencesLiveCodeBench / leetcode / hard: sum-of-good-subsequences1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: sumGood case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:8: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 158 OUT2 234
Code Generation - LiveCodeBench v5 LeetCode (set 3) 6 passed5 failed
54.5%
IN101 333 OUT108 591
×
LcbMaxCollectedFruitsLiveCodeBench / leetcode / hard: find-the-maximum-number-of-fruits-collected (id 3648)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxCollectedFruits case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Not all code paths in function 'maxCollectedFruits' return a value. Values: run.Compiled = false
Failed IN9 358 OUT50 718
×
LcbMaxFrequencyOpsLiveCodeBench / leetcode / medium: maximum-frequency-of-an-element-after-performing-operations-i (id 3622)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxFrequency case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 41:32: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 177 OUT10 329
✓
LcbMaxRemovalsSourceLiveCodeBench / leetcode / medium: find-maximum-removals-from-source-string (id 3487)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 275 OUT13 981
×
LcbMaxScoreTouristLiveCodeBench / leetcode / medium: maximum-points-tourist-can-earn (id 3587)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxScore case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'maxScore' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 267 OUT3 511
×
LcbMinBitwiseArrayLiveCodeBench / leetcode / easy: construct-the-minimum-bitwise-array-i (id 3605)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minBitwiseArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 20:40: The shift count of '<<' must be 'int', but got 'long'. Values: run.Compiled = false
Failed IN9 189 OUT8 305
✓
LcbNumberOfWaysEventLiveCodeBench / leetcode / hard: find-the-number-of-possible-ways-for-an-event (id 3604)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 216 OUT3 557
✓
LcbPossibleStringCountLiveCodeBench / leetcode / easy: find-the-original-typed-string-i (id 3617)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 135 OUT4 701
✓
LcbShiftDistanceLiveCodeBench / leetcode / medium: shift-distance-between-two-strings (id 3591)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 203 OUT1 815
✓
LcbSmallestDivisibleDigitProductLiveCodeBench / leetcode / easy: smallest-divisible-digit-product-i (id 3626)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 125 OUT161
✓
LcbStoneRemovalGameLiveCodeBench / leetcode / easy: stone-removal-game (id 3625)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 134 OUT2 136
×
LcbZeroArrayTransformIIILiveCodeBench / leetcode / medium: zero-array-transformation-iii (id 3647)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxRemoval case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 91:5: Expected an expression, found 'void'. Values: run.Compiled = false
Failed IN9 254 OUT9 377
Code Generation - LiveCodeBench v5 LeetCode (set 4) 4 passed6 failed
40.0%
IN91 869 OUT37 442
✓
LcbButtonLongestTimeLiveCodeBench / leetcode / easy: button-with-longest-push-time (id 3632)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 204 OUT945
×
LcbCountComponentsLcmLiveCodeBench / leetcode / hard: count-connected-components-in-lcm-graph (id 3680)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countComponents case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 70:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 173 OUT2 660
×
LcbDigitOpsEqualLiveCodeBench / leetcode / medium: digit-operations-to-make-two-integers-equal (id 3655)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: digitOpsEqual case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:31: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '<'. Values: run.Compiled = false
Failed IN9 199 OUT15 139
×
LcbLargestOutlierLiveCodeBench / leetcode / medium: identify-the-largest-outlier-in-an-array (id 3594)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: getLargestOutlier case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 198 OUT3 345
×
LcbMaxRectangleAreaLiveCodeBench / leetcode / medium: maximum-area-rectangle-with-point-constraints-i (id 3681)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxRectangleArea case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:24: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 212 OUT2 747
✓
LcbMaxSubarraySumDivKLiveCodeBench / leetcode / medium: maximum-subarray-sum-with-length-divisible-by-k (id 3653)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 148 OUT2 432
✓
LcbMinOpsEqualKLiveCodeBench / leetcode / easy: minimum-operations-to-make-array-values-equal-to-k (id 3621)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 187 OUT3 084
✓
LcbMinTimeBreakLocksLiveCodeBench / leetcode / medium: minimum-time-to-break-locks-i (id 3649)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 182 OUT3 657
×
LcbSmallestAllSetBitsLiveCodeBench / leetcode / easy: smallest-number-with-all-set-bits (id 3676)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: smallestAllBits case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '{'. Values: run.Compiled = false
Failed IN9 121 OUT1 595
×
LcbTransformedArrayLiveCodeBench / leetcode / easy: transformed-array (id 3651)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: constructTransformedArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '{'. Values: run.Compiled = false
Failed IN9 245 OUT1 838
Code Generation - LiveCodeBench v5 LeetCode (set 5) 3 passed7 failed
30.0%
IN91 765 OUT69 518
✓
LcbBeautifulSplitsLiveCodeBench / leetcode / medium: count beautiful splits in an array (LCB id 3686)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 146 OUT5 416
×
LcbCountGoodArraysLiveCodeBench / leetcode / hard: count arrays with k matching adjacent elements (LCB id 3682)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countGoodArrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found 'if'. Values: run.Compiled = false
Failed IN9 183 OUT2 707
×
LcbCountLen3SubarraysLiveCodeBench / leetcode / easy: count length-3 subarrays with a condition (LCB id 3685)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countSubarrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:14: Operator '==' cannot compare 'List<int>' and 'null'. Only numbers, bools, chars, strings, date/time values and recursively comparable containers/structs can be compared. Values: run.Compiled = false
Failed IN9 115 OUT148
×
LcbCountSpecialSubsequencesLiveCodeBench / leetcode / medium: count special subsequences (LCB id 3699)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: numberOfSubsequences case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 197 OUT9 250
✓
LcbLargestBoxStringLiveCodeBench / leetcode / medium: lexicographically largest string from the box I (LCB id 3683)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 147 OUT3 928
×
LcbMakeStringGoodLiveCodeBench / leetcode / hard: minimum operations to make character frequencies equal (LCB id 3638)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: makeStringGood case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 16:29: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 151 OUT33 376
×
LcbMaxCurrencyAmountLiveCodeBench / leetcode / medium: maximize amount after two days of conversions (LCB id 3613)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxAmount case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 59:56: Expected '>' to close the List type, found '<'. Values: run.Compiled = false
Failed IN9 327 OUT4 808
✓
LcbMaxDistinctElementsLiveCodeBench / leetcode / medium: maximum number of distinct elements after operations (LCB id 3620)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 154 OUT1 638
×
LcbMinIdenticalSubstringLiveCodeBench / leetcode / hard: smallest substring with identical characters I (LCB id 3690)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: minLength case0: expected 2 got 3
Failed IN9 176 OUT3 183
×
LcbMinOpsDistinctLiveCodeBench / leetcode / easy: minimum operations to make elements distinct (LCB id 3656)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimumOperations case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 169 OUT5 064
Code Generation - LiveCodeBench v5 LeetCode (set 6) 2 passed8 failed
20.0%
IN92 060 OUT127 218
×
LcbCheckValidCutsLiveCodeBench / leetcode / medium: check if grid can be cut into sections (LCB id 3657)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: checkValidCuts case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:46: Unknown function 'CheckVertical'. Values: run.Compiled = false
Failed IN9 265 OUT16 403
×
LcbCountXorPathsLiveCodeBench / leetcode / medium: count paths with the given xor value (LCB id 3659)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countPathsWithXorValue case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:13: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). 37:37: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 48:36: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). 57:37: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 68:36: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). Values: run.Compiled = false
Failed IN9 250 OUT4 201
×
LcbLongestDecreasingDiffLiveCodeBench / leetcode / medium: longest subsequence with decreasing adjacent difference (LCB id 3716)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestSubsequence case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:35: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 37:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 206 OUT2 536
×
LcbMaxCoinsKBagsLiveCodeBench / leetcode / medium: maximum coins from k consecutive bags (LCB id 3715)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: maximumCoins case0: expected 10 got 9
Failed IN9 195 OUT8 043
×
LcbMaxIntervalScoreLiveCodeBench / leetcode / hard: maximum score of non-overlapping intervals (LCB id 3562)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maximumWeight case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 57:19: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 259 OUT13 697
×
LcbMaxProductEquivalentLiveCodeBench / leetcode / easy: maximum subarray with equal products (LCB id 3702)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: maxLength case0: expected 5 got 1
Failed IN9 183 OUT10 514
×
LcbMaxSubarrayAfterRemovalLiveCodeBench / leetcode / hard: maximize subarray sum after removing all occurrences of one element (LCB id 3688)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxSubarraySum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 144:198: Char literals must contain exactly one character and close with '''. 146:122: Char literals must contain exactly one character and close with '''. 148:125: Char literals must contain exactly one character and close with '''. 150:124: Char literals must contain exactly one character and close with '''. 156:107: Unexpected character '✓'. 158:60: Unexpected character '✓'. 160:129: Unexpected character '✓'. 162:39: Unexpected character '#'. 164:98: Unexpected character '#'. 166:6: Unexpected character '#'. Values: run.Compiled = false
Failed IN9 154 OUT34 107
×
LcbMiddleModeSubsequencesLiveCodeBench / leetcode / hard: subsequences with a unique middle mode I (LCB id 3700)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<int>(run.ResultJson) == FromJson<int>(expected[i]) Context: subsequencesWithMiddleMode case0: expected 6 got 30
Failed IN9 211 OUT35 929
✓
LcbMirrorScoreLiveCodeBench / leetcode / medium: find mirror score of a string (LCB id 3634)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 184 OUT307
✓
LcbSubstringPatternLiveCodeBench / leetcode / easy: substring matching pattern (LCB id 3684)1 AI query 0 tool callscategory:CodeGenerationcategory:V5@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 153 OUT1 481
Code Generation - LiveCodeBench v6 AtCoder (set 1) 9 passed7 failed
56.3%
IN147 241 OUT119 792
✓
LcbComingOfAgeLiveCodeBench / atcoder abc388_d / medium: Coming of Age Celebration1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 208 OUT11 673
×
LcbCountArraysLiveCodeBench / atcoder abc387_f / hard: Count Arrays1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CountArrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 230 OUT36 116
×
LcbDangerousSugorokuLiveCodeBench / atcoder abc388_f / hard: Dangerous Sugoroku1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: DangerousSugoroku case0: expected [Yes] got [No]
Failed IN9 247 OUT25 227
✓
LcbDigitProductLiveCodeBench / atcoder abc389_a / easy: 9x91 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 148 OUT868
✓
LcbFactorialInverseLiveCodeBench / atcoder abc389_b / easy: tcaF1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 154 OUT536
×
LcbHeavySnakeLiveCodeBench / atcoder abc388_b / easy: Heavy Snake1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 193 OUT742
×
LcbKagamimochi2LiveCodeBench / atcoder abc388_g / hard: Simultaneous Kagamimochi 21 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Kagamimochi2 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 257 OUT2 415
✓
LcbNotXSumLiveCodeBench / atcoder abc387_b / easy: 9x9 Sum1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 209 OUT589
×
LcbOddEvenGraphLiveCodeBench / atcoder abc389_g / hard: Odd Even Graph1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: OddEvenGraph case0: expected [12 9 3 0] got [12 12 3 0]
Failed IN9 244 OUT17 042
✓
LcbQuestionUpcLiveCodeBench / atcoder abc388_a / easy: ?UPC1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 154 OUT450
✓
LcbRatedRangeLiveCodeBench / atcoder abc389_f / hard: Rated Range1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 203 OUT9 051
✓
LcbSimultaneousKagamimochiLiveCodeBench / atcoder abc388_e / hard: Simultaneous Kagamimochi1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 196 OUT1 352
×
LcbSnakeNumbersLiveCodeBench / atcoder abc387_c / medium: Snake Numbers1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SnakeNumbers case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 36:19: Operator '+' cannot be applied to 'int' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 203 OUT5 693
×
LcbSquareOfSumLiveCodeBench / atcoder abc387_a / easy: Happy New Year 20251 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SquareOfSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected '(' to declare a function or '=' to declare a global variable after 'long a', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 135 OUT135
✓
LcbSquaresInCircleLiveCodeBench / atcoder abc389_d / medium: Squares in Circle1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 234 OUT6 381
✓
LcbVariousKagamimochiLiveCodeBench / atcoder abc388_c / medium: Various Kagamimochi1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 226 OUT1 522
Code Generation - LiveCodeBench v6 AtCoder (set 2) 5 passed10 failed
33.3%
IN138 214 OUT89 420
×
LcbDoubleSum3LiveCodeBench / atcoder abc390_f / hard: Double Sum 31 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DoubleSum3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Not all code paths in function 'Solve' return a value. Values: run.Compiled = false
Failed IN9 233 OUT10 944
✓
LcbGeometricSequenceLiveCodeBench / atcoder abc390_b / easy: Geometric Sequence1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 164 OUT664
×
LcbGravityLiveCodeBench / atcoder abc391_d / medium: Gravity1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Gravity case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 35:25: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
Failed IN9 295 OUT5 925
×
LcbKthLargestLiveCodeBench / atcoder abc391_f / hard: K1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: KthLargest case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:8: Expected '(' to declare a function or '=' to declare a global variable after 'sort A', found 'ascending'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 236 OUT12 994
×
LcbMajorityVoteLiveCodeBench / atcoder abc391_e / hard: Hierarchical Majority Vote1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MajorityVote case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 26:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 222 OUT5 239
×
LcbManyLcsLiveCodeBench / atcoder abc391_g / hard: Many LCS1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ManyLcs case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 21:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 100:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 213 OUT2 700
✓
LcbOneSwapSortLiveCodeBench / atcoder abc390_a / easy: 124351 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 197 OUT868
×
LcbOppositeDirectionLiveCodeBench / atcoder abc391_a / easy: Lucky Direction1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: OppositeDirection case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 2:10: Expected a name, found '.'. Values: run.Compiled = false
Failed IN9 174 OUT181
✓
LcbPaintRectangleLiveCodeBench / atcoder abc390_c / medium: Paint to make a rectangle1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 220 OUT1 719
×
LcbPermutationConcatLiveCodeBench / atcoder abc390_g / hard: Permutation Concatenation1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PermutationConcat case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: Entry point 'Solve' was not found. Available functions: AskAi, RunScript, SkipTest, __CreateInMemoryDatabase, __DbExecute, __DbExecuteScript, __DbInsert, __DbQueryFirstJson, __DbQueryJson, __DbScalarJson. Values: run.Compiled = false
Failed IN9 245 OUT17 370
✓
LcbSeekGridLiveCodeBench / atcoder abc391_b / easy: Seek Grid1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 212 OUT598
✓
LcbShuffledEquationLiveCodeBench / atcoder abc392_a / easy: Shuffled Equation1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 189 OUT873
×
LcbSquarePriceLiveCodeBench / atcoder abc389_e / hard: Square Price1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: SquarePrice case0 runtime error: Integer overflow. Values: run.Success = false
Failed IN9 196 OUT18 365
×
LcbStoneXorLiveCodeBench / atcoder abc390_d / medium: Stone XOR1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StoneXor case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 208 OUT3 271
×
LcbVitaminBalanceLiveCodeBench / atcoder abc390_e / hard: Vitamin Balance1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: VitaminBalance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:47: Expected '(' after the List type. Lists are created with 'new List<T>()' or 'new List<T>(items)', found '['. Values: run.Compiled = false
Failed IN9 210 OUT7 709
Code Generation - LiveCodeBench v6 AtCoder (set 3) 6 passed4 failed
60.0%
IN92 287 OUT20 923
✓
LcbABCIntervalsLiveCodeBench / atcoder / abc393_b A..B..C (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 192 OUT1 373
×
LcbBibStaringLiveCodeBench / atcoder / abc392_c Bib (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BibStaring case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:54: Expected ')' to close the argument list, found '='. Values: run.Compiled = false
Failed IN9 235 OUT1 540
×
LcbDoublesProbabilityLiveCodeBench / atcoder / abc392_d Doubles (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DoublesProbability case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 11:15: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 245 OUT2 129
✓
LcbFineTripletsLiveCodeBench / atcoder / abc392_g Fine Triplets (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 215 OUT1 218
×
LcbGcdOfSubsetLiveCodeBench / atcoder / abc393_e GCD of Subset (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: GcdOfSubset case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 32:17: Expected ';' after the for initializer, found ':'. Values: run.Compiled = false
Failed IN9 214 OUT1 030
✓
LcbInsertSequenceLiveCodeBench / atcoder / abc392_f Insert (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 230 OUT1 103
✓
LcbPoisonousOysterLiveCodeBench / atcoder / abc393_a Poisonous Oyster (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 250 OUT416
×
LcbPrefixLisQueryLiveCodeBench / atcoder / abc393_f Prefix LIS Query (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PrefixLisQuery case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 47:36: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 260 OUT7 794
✓
LcbSwapToGatherLiveCodeBench / atcoder / abc393_d Swap to Gather (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 213 OUT3 909
✓
LcbWhoIsMissingLiveCodeBench / atcoder / abc392_b Who is Missing? (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 233 OUT411
Code Generation - LiveCodeBench v6 AtCoder (set 4) 4 passed6 failed
40.0%
IN92 357 OUT67 793
×
LcbAlkaneSubtreeLiveCodeBench / atcoder / abc394_f Alkane (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: AlkaneSubtree case1: expected [-1] got [2]
Failed IN9 248 OUT11 581
×
LcbCatConcatLiveCodeBench / atcoder / abc394_b cat (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CatConcat case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 175 OUT97
✓
LcbColorfulBracketsLiveCodeBench / atcoder / abc394_d Colorful Bracket Sequence (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 188 OUT427
×
LcbDebugWaAcLiveCodeBench / atcoder / abc394_c Debug (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DebugWaAc case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 27:43: Expected ')' to close the argument list, found '='. Values: run.Compiled = false
Failed IN9 159 OUT1 697
×
LcbDenseBuildingsLiveCodeBench / atcoder / abc394_g Dense Buildings (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: DenseBuildings case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:41: Type 'List<string>' has no supported method named 'Select' with 1 argument(s). 12:49: Unknown variable 'int'. 1:8: Not all code paths in function 'Solve' return a value. Values: run.Compiled = false
Failed IN9 380 OUT28 995
✓
LcbFilterTwosLiveCodeBench / atcoder / abc394_a 22222 (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 151 OUT72
×
LcbMakeTargetLiveCodeBench / atcoder / abc395_b Make Target (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 263 OUT2 554
×
LcbPalindromicShortestPathLiveCodeBench / atcoder / abc394_e Palindromic Shortest Path (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PalindromicShortestPath case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:16: Unexpected character '→'. Values: run.Compiled = false
Failed IN9 314 OUT17 409
✓
LcbShortestDuplicateSubarrayLiveCodeBench / atcoder / abc395_c Shortest Duplicate Subarray (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 216 OUT1 508
✓
LcbSmoothOcclusionLiveCodeBench / atcoder / abc395_f Smooth Occlusion (Pattern B, stdin)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 263 OUT3 453
Code Generation - LiveCodeBench v6 AtCoder (set 5) 4 passed11 failed1 skipped
26.7%
IN138 175 OUT93 192
×
LcbBuyBallsLiveCodeBench / atcoder / medium: Buy Balls (abc396_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Success Context: BuyBalls case2 runtime error: List index 3 is out of range. The list has 3 element(s). Values: run.Success = false
Failed IN9 231 OUT3 875
✓
LcbCardPileLiveCodeBench / atcoder / easy: Card Pile (abc396_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 210 OUT476
–
LcbCubesLiveCodeBench / atcoder / hard: Cubes (abc397_d)0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbFlipEdgeLiveCodeBench / atcoder / hard: Flip Edge (abc395_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FlipEdge case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found '.'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 224 OUT5 166
✓
LcbFlipRowOrColLiveCodeBench / atcoder / hard: Flip Row or Col (abc396_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Passed IN9 220 OUT1 402
×
LcbMaximizeDistanceLiveCodeBench / atcoder / hard: Maximize Distance (abc397_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MaximizeDistance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:24: Expected '(' to declare a function or '=' to declare a global variable after 'Initialize edge_weights', found '['. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 204 OUT43 753
×
LcbMinRestrictedSumLiveCodeBench / atcoder / hard: Min of Restricted Sum (abc396_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinRestrictedSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:29: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 245 OUT4 047
×
LcbMinXorPathLiveCodeBench / atcoder / medium: Minimum XOR Path (abc396_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinXorPath case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'long min_xor', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 227 OUT2 127
×
LcbPathDecompositionLiveCodeBench / atcoder / hard: Path Decomposition of a Tree (abc397_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: PathDecomposition case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 142:9: Unterminated block comment. Close it with '*/'. Values: run.Compiled = false
Failed IN9 197 OUT11 352
×
LcbRotatedInversionsLiveCodeBench / atcoder / hard: Rotated Inversions (abc396_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: RotatedInversions case0: expected [3 1 1] got [313]
Failed IN9 233 OUT16 655
×
LcbStrictlyIncreasingLiveCodeBench / atcoder / easy: Strictly Increasing? (abc395_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: StrictlyIncreasing case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 192 OUT136
✓
LcbThermometerLiveCodeBench / atcoder / easy: Thermometer (abc397_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 187 OUT713
×
LcbTicketGateLogLiveCodeBench / atcoder / medium: Ticket Gate Log (abc397_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: TicketGateLog case1: expected [2] got [4]
Failed IN9 190 OUT1 947
✓
LcbTripleFourLiveCodeBench / atcoder / easy: Triple Four (abc396_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 195 OUT572
×
LcbVarietySplitEasyLiveCodeBench / atcoder / medium: Variety Split Easy (abc397_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: VarietySplitEasy case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:13: Expected '(' to declare a function or '=' to declare a global variable after 'using System', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 203 OUT622
×
LcbVarietySplitHardLiveCodeBench / atcoder / hard: Variety Split Hard (abc397_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: VarietySplitHard case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 217 OUT349
Code Generation - LiveCodeBench v6 AtCoder (set 6) 4 passed11 failed
26.7%
IN138 198 OUT70 877
✓
LcbAbc400PartyLiveCodeBench / atcoder / easy: ABC400 Party (abc400_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 180 OUT223
×
LcbAbcbaLiveCodeBench / atcoder / hard: ABCBA (abc398_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Abcba case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:101: Unexpected character '✓'. 22:87: Char literals must contain exactly one character and close with '''. 24:55: Char literals must contain exactly one character and close with '''. 40:15: Unexpected character '→'. 40:33: Unexpected character '≠'. 40:43: Unexpected character '✗'. 41:16: Unexpected character '→'. 41:35: Unexpected character '✗'. 42:17: Unexpected character '→'. 42:37: Unexpected character '✓'. 48:86: Unexpected character '—'. 52:17: Char literals must contain exactly one character and close with '''. 58:32: Unexpected character '#'. Values: run.Compiled = false
Failed IN9 145 OUT981
×
LcbBonfireLiveCodeBench / atcoder / hard: Bonfire (abc398_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Bonfire case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 49:51: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. 64:38: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. 74:29: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. 76:31: Operator '+' cannot be applied to 'long' and 'string'. It supports numbers and string/char concatenation. Values: run.Compiled = false
Failed IN9 329 OUT7 048
✓
LcbDoorsInCenterLiveCodeBench / atcoder / easy: Doors in the Center (abc398_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Passed IN9 160 OUT691
✓
LcbFullHouse3LiveCodeBench / atcoder / medium: Full House 3 (abc398_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 202 OUT1 053
✓
LcbGoodIntegersLiveCodeBench / atcoder / medium: 2^a b^2 good integers (abc400_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 200 OUT3 739
×
LcbHammingDistanceLiveCodeBench / atcoder / easy: Hamming Distance (abc399_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: HammingDistance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 184 OUT93
×
LcbMakeItForestLiveCodeBench / atcoder / medium: Make it Forest (abc399_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MakeItForest case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 3:17: Expected a parameter name, found '['. Values: run.Compiled = false
Failed IN9 182 OUT1 721
×
LcbNotOnlyTreeGameLiveCodeBench / atcoder / hard: Not Only Tree Game (abc398_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: NotOnlyTreeGame case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected '(' to declare a function or '=' to declare a global variable after 'int N', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 243 OUT1 890
×
LcbRangePowerSumLiveCodeBench / atcoder / hard: Range Power Sum (abc399_f)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
The value in FromJson result must be a JSON string (script type 'string'), but it is the number 75.
Failed IN9 217 OUT3 160
×
LcbRankingWithTiesLiveCodeBench / atcoder / easy: Ranking with Ties (abc399_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 211 OUT1 265
×
LcbReplaceLiveCodeBench / atcoder / hard: Replace (abc399_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Replace case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 27:26: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 37:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 213 OUT13 946
×
LcbSwitchSeatsLiveCodeBench / atcoder / medium: Switch Seats (abc399_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SwitchSeats case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 33:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 258 OUT7 645
×
LcbUniquenessLiveCodeBench / atcoder / medium: Uniqueness (abc398_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: Uniqueness case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 23:9: Variable 'bestVal' has type 'int' but its initializer has type 'long'. Values: run.Compiled = false
Failed IN9 186 OUT1 044
×
LcbWallBreakerLiveCodeBench / atcoder / medium: Takahashi the Wall Breaker (abc400_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: WallBreaker case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 49:36: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 288 OUT26 378
Code Generation - LiveCodeBench v6 AtCoder (set 7) 1 passed10 failed2 broken2 skipped
7.7%
IN121 105 OUT326 423
–
LcbAPowNLiveCodeBench / atcoder / hard: A^n (arc191_c) NOTE: special judge - any valid (A,M) pair is accepted; exact-match may unfairly fail a correct model output.0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
✓
LcbArcArcLiveCodeBench / atcoder / medium: ARC Arc (arc192_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 357 OUT28 348
×
LcbBasicGridUpdatesLiveCodeBench / atcoder / hard: Basic Grid Problem with Updates (arc190_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BasicGridUpdates case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:2: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 420 OUT12 994
×
LcbBrokenWheelLiveCodeBench / atcoder / hard: Broken Wheel (arc193_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: BrokenWheel case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:13: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 337 OUT23 891
×
LcbComplementIntervalGraphLiveCodeBench / atcoder / hard: Complement Interval Graph (arc193_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ComplementIntervalGraph case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:11: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 384 OUT49 014
×
LcbFennecVsSnuke2LiveCodeBench / atcoder / hard: Fennec VS. Snuke 2 (arc192_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: FennecVsSnuke2 case0: expected [Fennec] got [Snuke]
Failed IN9 277 OUT6 585
×
LcbFractionLineLiveCodeBench / atcoder / hard: Fraction Line (arc192_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: FractionLine case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:38: Expected a parameter name, found 'long'. Values: run.Compiled = false
Failed IN9 320 OUT52 543
–
LcbInsideOrOutsideLiveCodeBench / atcoder / hard: Inside or Outside (arc190_a) NOTE: special judge - multiple minimum-cost operation sequences are accepted; exact-match may unfairly fail a correct model output.0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
×
LcbMatrixPowSumLiveCodeBench / atcoder / hard: Matrix Pow Sum (arc190_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
External function 'RunScript' threw InvalidOperationException: ScSharp execution failed unexpectedly. This is a bug in the ScSharp library.
Failed IN9 305 OUT12 747
×
LcbMovingPiecesOnGraphLiveCodeBench / atcoder / hard: Moving Pieces on Graph (arc191_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MovingPiecesOnGraph case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 37:33: Expected '{' after the struct name. Structs are created with 'new Name { Field = value }', found '<'. Values: run.Compiled = false
Failed IN9 314 OUT2 104
!
LcbPatisserieAbc3LiveCodeBench / atcoder / hard: Patisserie ABC 3 (abc400_g)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 334 OUT62 144
×
LcbReplaceDigitsLiveCodeBench / atcoder / medium: Replace Digits (arc191_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: ReplaceDigits case1: expected [993] got [999]
Failed IN9 241 OUT4 326
×
LcbRingoFavoriteNumbers3LiveCodeBench / atcoder / hard: Ringo's Favorite Numbers 3 (abc400_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RingoFavoriteNumbers3 case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 8:9: Expected a field name, found '['. Values: run.Compiled = false
Failed IN9 283 OUT9 414
!
LcbSnukeKyotoTripLiveCodeBench / atcoder / hard: Snuke's Kyoto Trip (arc192_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 300 OUT62 144
×
LcbSumOfGeometricSeriesLiveCodeBench / atcoder / easy: Sum of Geometric Series (abc400_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SumOfGeometricSeries case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:7: Expected '(' to declare a function or '=' to declare a global variable after 'long n', found ';'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 233 OUT169
Code Generation - LiveCodeBench v6 AtCoder (set 8) 1 passed11 failed2 broken1 skipped
7.1%
IN130 424 OUT268 545
×
LcbAdjacentDeleteLiveCodeBench / atcoder / hard: Adjacent Delete (arc196_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: AdjacentDelete case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:41: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 205 OUT9 038
×
LcbCostToFlipLiveCodeBench / atcoder / hard: Cost to Flip (arc194_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: CostToFlip case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 29:21: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
Failed IN9 278 OUT5 714
–
LcbHamiltonianPiecesLiveCodeBench / atcoder / hard: Hamiltonian Pieces (arc195_c) NOTE: special judge - any valid placement is accepted; exact-match may unfairly fail a correct model output.0 AI queries 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: skip: non-unique answer -- any valid output is accepted; exact-match oracle would reject a correct-but-different answer
Skipped IN0 OUT0
!
LcbMagnetsLiveCodeBench / atcoder / hard: Magnets (arc193_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 355 OUT62 144
×
LcbMinimumCostSortLiveCodeBench / atcoder / hard: Minimum Cost Sort (arc194_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: MinimumCostSort case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 25:5: Expected an expression, found 'void'. Values: run.Compiled = false
Failed IN9 218 OUT23 746
×
LcbOperationsOnStackLiveCodeBench / atcoder / medium: Operations on a Stack (arc194_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: OperationsOnStack case0: expected [8] got [10]
Failed IN9 237 OUT9 645
×
LcbRandomTreeDistanceLiveCodeBench / atcoder / hard: Random Tree Distance (arc195_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: RandomTreeDistance case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 369 OUT12 902
×
LcbReverseBracketsLiveCodeBench / atcoder / hard: Reverse Brackets (arc194_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: ReverseBrackets case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:5: Expected a name, found '['. Values: run.Compiled = false
Failed IN9 280 OUT4 285
!
LcbRoadwayLiveCodeBench / atcoder / hard: Roadway (arc196_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 426 OUT62 144
×
LcbStronglyConnectedLiveCodeBench / atcoder / hard: Strongly Connected (arc196_c)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: StronglyConnected case0: expected [1] got [0]
Failed IN9 301 OUT14 478
×
LcbSwap0X1YLiveCodeBench / atcoder / hard: Swap 0^X and 1^Y (arc194_e)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<string>(run.ResultJson).Trim() == expected[i].Trim() Context: Swap0X1Y case0: expected [Yes] got [No]
Failed IN9 388 OUT2 174
×
LcbSwapAndEraseLiveCodeBench / atcoder / hard: Swap and Erase (arc195_d)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: SwapAndErase case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 32:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. 80:5: Not all code paths in function 'CompareMeans' return a value. Values: run.Compiled = false
Failed IN9 316 OUT25 620
×
LcbTorusLoopLiveCodeBench / atcoder / hard: Torus Loop (arc196_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: TorusLoop case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 22:20: Unknown function 'SolveCase'. 24:24: Unknown variable 'something'. Values: run.Compiled = false
Failed IN9 493 OUT22 877
✓
LcbTwiceSubsequenceLiveCodeBench / atcoder / medium: Twice Subsequence (arc195_a)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Mediumsource:LiveCodeBench
Passed IN9 258 OUT2 012
×
LcbUniformSumLiveCodeBench / atcoder / hard: Uniform Sum (arc195_b)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@AtCoderlevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: UniformSum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:9: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 300 OUT11 766
Code Generation - LiveCodeBench v6 LeetCode (set 1) 4 passed7 failed
36.4%
IN101 311 OUT50 103
✓
LcbCountEvenDiffPartitionsLiveCodeBench 3704 / leetcode / easy: count partitions with even sum difference (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 175 OUT165
×
LcbCountMentionsPerUserLiveCodeBench 3721 / leetcode / medium: count mentions per user (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countMentionsPerUser case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 4:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 295 OUT2 027
×
LcbCountNonDecreasingSubarraysLiveCodeBench 3674 / leetcode / hard: count non-decreasing subarrays after k operations (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countNonDecreasingSubarrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:6: Expected a name, found '='. Values: run.Compiled = false
Failed IN9 214 OUT16 300
×
LcbMaxFrequencyAfterOpLiveCodeBench 3751 / leetcode / medium: maximum frequency after subarray operation (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxFrequencyAfterOp case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:20: Type 'Dictionary<int, int>' has no supported method named 'Add' with 2 argument(s). 15:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 180 OUT2 882
×
LcbMinimizeMaxEdgeWeightLiveCodeBench 3720 / leetcode / medium: minimize the maximum edge weight of graph (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minimizeMaxEdgeWeight case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 26:39: Expected '(' after the List type. Lists are created with 'new List<T>()' or 'new List<T>(items)', found '{'. Values: run.Compiled = false
Failed IN9 238 OUT5 136
✓
LcbMinMaxSubarraySumsLiveCodeBench 3725 / leetcode / hard: max and min sums of at most size k subarrays (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 124 OUT259
×
LcbMinMaxSubsequenceSumsLiveCodeBench 3714 / leetcode / medium: max and min sums of at most size k subsequences (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minMaxSubsequenceSums case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 10:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 162 OUT7 521
×
LcbPaintHouseIVLiveCodeBench 3737 / leetcode / medium: paint house IV (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: paintHouseIV case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 70:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 265 OUT6 188
×
LcbRobotMaxCoinsLiveCodeBench 3677 / leetcode / medium: maximum amount of money robot can earn (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: robotMaxCoins case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:9: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 264 OUT5 701
✓
LcbVariableLengthSubarraySumLiveCodeBench 3731 / leetcode / easy: sum of variable length subarrays (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 143 OUT2 038
✓
LcbZigzagGridSkipLiveCodeBench 3708 / leetcode / easy: zigzag grid traversal with skip (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 251 OUT1 886
Code Generation - LiveCodeBench v6 LeetCode (set 2) 6 passed3 failed1 broken
60.0%
IN91 925 OUT101 864
✓
LcbAssignElementsToGroupsLiveCodeBench 3760 / leetcode / medium: assign elements to groups with constraints (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 256 OUT172
✓
LcbCountSubstringsDivLastDigitLiveCodeBench 3696 / leetcode / hard: count substrings divisible by last digit (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 125 OUT171
✓
LcbEatPizzasMaxWeightLiveCodeBench 3779 / leetcode / medium: eat pizzas (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 227 OUT3 231
×
LcbMaxEvenOddFreqDiffLiveCodeBench 3753 / leetcode / easy: maximum difference between even and odd frequency I (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxEvenOddFreqDiff case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 19:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 163 OUT263
!
LcbMaximizeMinGameScoreLiveCodeBench 3762 / leetcode / hard: maximize the minimum game score (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 233 OUT62 144
×
LcbMaxManhattanAfterKLiveCodeBench 3754 / leetcode / medium: maximum manhattan distance after k changes (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxManhattanAfterK case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:33: Unknown function 'Simulate'. Values: run.Compiled = false
Failed IN9 233 OUT6 624
✓
LcbMinIncrementsTargetMultiplesLiveCodeBench 3697 / leetcode / hard: minimum increments for target multiples in an array (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 159 OUT6 829
×
LcbSelectKDisjointSpecialLiveCodeBench 3771 / leetcode / medium: select k disjoint special substrings (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: selectKDisjointSpecial case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 17:10: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 178 OUT17 277
✓
LcbSortMatrixDiagonalsLiveCodeBench 3748 / leetcode / medium: sort matrix by diagonals (Pattern A, single-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 184 OUT2 583
✓
LcbSpecialSubstringLengthKLiveCodeBench 3709 / leetcode / easy: find special substring of length k (Pattern A, multi-arg)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 167 OUT2 570
Code Generation - LiveCodeBench v6 LeetCode (set 3) 2 passed8 failed1 broken
18.2%
IN101 405 OUT114 764
×
LcbChooseKMaxSumLiveCodeBench / leetcode / medium / id 3759: for each i, sum of k largest nums2[j] where nums1[j] < nums1[i]1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: findmaxsum case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 13:20: Expected ')' to close the parenthesized expression, found ','. Values: run.Compiled = false
Failed IN9 259 OUT3 770
×
LcbFruitsIntoBasketsLiveCodeBench / leetcode / medium / id 3791: count fruit types that remain unplaced into baskets1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: fruits case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:10: Expected '=' after the variable name. 'var' local variables need an initializer so their type can be inferred, e.g. 'var i = ...;' Values: run.Compiled = false
Failed IN9 233 OUT347
×
LcbLargestAlmostMissingLiveCodeBench / leetcode / easy / id 3705: largest integer appearing in exactly one size-k subarray1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: largestmissing case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 28:25: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 182 OUT2 036
✓
LcbLexSmallestGeneratedLiveCodeBench / leetcode / hard / id 3770: lexicographically smallest string generated from str1 and str21 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 238 OUT14 048
×
LcbLongestPalinSubseqKOpsLiveCodeBench / leetcode / medium / id 3786: longest palindromic subsequence after at most k letter shifts1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: palinsubseq case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:5: Not all code paths in function 'longestPalindromicSubsequence' return a value. Values: run.Compiled = false
Failed IN9 204 OUT7 314
×
LcbLongestVDiagonalLiveCodeBench / leetcode / hard / id 3733: length of longest V-shaped diagonal segment1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: vdiag case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:8: Expected a variable name, found '['. Values: run.Compiled = false
Failed IN9 281 OUT4 411
!
LcbMaxDistanceSquareLiveCodeBench / leetcode / hard / id 3781: maximize the minimum Manhattan distance among k boundary points1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Skipped: AI output broken/partial
Broken IN9 276 OUT62 144
×
LcbMaxSubarraysConflictLiveCodeBench / leetcode / hard / id 3789: max non-empty subarrays after removing one conflicting pair1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxsub case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 5:4: Expected a name, found '<'. Values: run.Compiled = false
Failed IN9 220 OUT18 079
×
LcbMaxSumKSubarraysLiveCodeBench / leetcode / medium / id 3722: max sum of k non-overlapping subarrays each length >= m1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxsumksub case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:2: Char literals must contain exactly one character and close with '''. 6:14: Char literals must contain exactly one character and close with '''. 10:50: Unexpected character '→'. 13:49: Unexpected character '→'. 14:39: Unexpected character '≥'. 18:67: Unexpected character '≥'. 20:83: Unexpected character '≥'. 22:5: Char literals must contain exactly one character and close with '''. Values: run.Compiled = false
Failed IN9 157 OUT964
✓
LcbMaxSumWithLimitsLiveCodeBench / leetcode / medium / id 3764: maximum sum of at most k elements with per-row limits1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 192 OUT217
×
LcbSameDigitsAfterOpsLiveCodeBench / leetcode / easy / id 3768: check if final two digits are equal after repeated pairwise sums1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: samedigits case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 14:9: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 15:16: Unknown variable 'j'. 17:32: Unknown variable 'j'. 17:44: Unknown variable 'j'. 19:13: Unknown variable 'j'. Declare it first, e.g. 'int j = ...;'. 19:13: Unknown variable 'j'. Values: run.Compiled = false
Failed IN9 163 OUT1 434
Code Generation - LiveCodeBench v6 LeetCode (set 4) 7 passed3 failed
70.0%
IN92 022 OUT70 809
✓
LcbClosestEqualQueriesLiveCodeBench / leetcode / medium / id 3750: circular min distance to an equal-valued element per query1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 205 OUT2 664
✓
LcbCountBeautifulNumbersLiveCodeBench / leetcode / hard / id 3801: count numbers in [l,r] whose digit-product is divisible by digit-sum1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 157 OUT1 569
×
LcbLongestPalinConcatLiveCodeBench / leetcode / medium / id 3793: longest palindrome from a substring of s concatenated with one of t1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: palinconcat case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 6:27: Unknown function 'LongestPalSubstr'. 9:27: Unknown function 'LongestPalSubstr'. 57:12: Unknown variable 'n'. 57:30: Unknown variable 'n'. 57:50: Unknown variable 'V'. 57:52: Unknown variable 'n'. 57:66: Unknown variable 'V'. 57:68: Unknown variable 'n'. 95:13: Variable 'r' is already declared in this scope or an enclosing one. 96:38: Unknown variable 'V'. 96:46: Unknown variable 'V'. 98:21: Unknown variable 'n'. 98:30: Unknown variable 'n'. 112:13: Variable 'r' is already declared in this scope or an enclosing one. 113:38: Unknown variable 'V'. 113:46: Unknown variable 'V'. 115:21: Unknown variable 'n'. 115:30: Unknown variable 'n'. Values: run.Compiled = false
Failed IN9 167 OUT34 744
✓
LcbMaxContainersShipLiveCodeBench / leetcode / easy / id 3817: max containers of weight w on an n x n deck within maxWeight1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 173 OUT243
✓
LcbMaxUniqueSubarraySumLiveCodeBench / leetcode / easy / id 3788: max sum of a subarray with all-unique elements after deletions1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 176 OUT6 116
✓
LcbMinCostReachPositionsLiveCodeBench / leetcode / easy / id 3832: min total cost to reach each position via prefix-min swaps1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 227 OUT1 278
×
LcbMinOpsElementsZeroLiveCodeBench / leetcode / hard / id 3744: sum over queries of min pair-divide operations to zero a range1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minops case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 24:31: Unknown function 'Max'. 25:29: Unknown function 'Min'. Values: run.Compiled = false
Failed IN9 180 OUT3 599
×
LcbMinTimeBrewPotionsLiveCodeBench / leetcode / medium / id 3794: min synchronized time for n wizards to brew m potions in order1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: FromJson<long>(run.ResultJson) == FromJson<long>(expected[i]) Context: mintime case0: expected 110 got 88
Failed IN9 249 OUT14 118
✓
LcbPropertiesGraphLiveCodeBench / leetcode / medium / id 3809: connected components where edges need >= k shared distinct values1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 236 OUT2 700
✓
LcbZeroArrayTransformIVLiveCodeBench / leetcode / medium / id 3795: min k queries to reduce nums to a zero array (subset decrements)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 252 OUT3 778
Code Generation - LiveCodeBench v6 LeetCode (set 5) 7 passed4 failed
63.6%
IN101 116 OUT52 324
✓
LcbFindValidDigitPairLiveCodeBench / leetcode / easy: find-valid-pair-of-adjacent-digits-in-string (id 3736)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 163 OUT266
×
LcbLongestSpecialPathLiveCodeBench / leetcode / hard: longest-special-path (id 3687)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: longestSpecialPath case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 7:40: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '('. Values: run.Compiled = false
Failed IN9 283 OUT6 840
✓
LcbManhattanArrangementsLiveCodeBench / leetcode / hard: manhattan-distances-of-all-arrangements-of-pieces (id 3739)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 179 OUT5 496
✓
LcbMaxAdjacentCircularLiveCodeBench / leetcode / easy: maximum-difference-between-adjacent-elements-in-a-circular-array (id 3747)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 106 OUT229
×
LcbMaxFreeTimeLiveCodeBench / leetcode / medium: reschedule-meetings-for-maximum-free-time-i (id 3743)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxFreeTime case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 40:10: Unknown variable 'w'. Declare it first, e.g. 'int w = ...;'. 40:17: Unknown variable 'w'. 40:28: Unknown variable 'w'. Declare it first, e.g. 'int w = ...;'. 40:28: Unknown variable 'w'. 43:20: Unknown variable 'w'. 45:21: Unknown variable 'w'. Values: run.Compiled = false
Failed IN9 285 OUT9 483
×
LcbMaxProductAlternatingSumLiveCodeBench / leetcode / hard: maximum-product-of-subsequences-with-an-alternating-sum-equal-to-k (id 3777)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxProductAlt case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 39:20: Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '1'. Values: run.Compiled = false
Failed IN9 211 OUT8 078
×
LcbMinCostGoodCaptionLiveCodeBench / leetcode / hard: minimum-cost-good-caption (id 3701)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minCostGoodCaption case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:8: Not all code paths in function 'minCostGoodCaption' return a value. Values: run.Compiled = false
Failed IN9 214 OUT14 454
✓
LcbMinOpsKSubarraysEqualLiveCodeBench / leetcode / hard: minimum-operations-to-make-elements-within-k-subarrays-equal (id 3717)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 187 OUT3 555
✓
LcbMinPairRemovalSortLiveCodeBench / leetcode / easy: minimum-pair-removal-to-sort-array-i (id 3773)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 134 OUT1 709
✓
LcbSeparateSquaresLiveCodeBench / leetcode / medium: separate-squares-i (id 3763)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 198 OUT1 994
✓
LcbSumOfGoodNumbersLiveCodeBench / leetcode / easy: sum-of-good-numbers (id 3723)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Passed IN9 156 OUT220
Code Generation - LiveCodeBench v6 LeetCode (set 6) 2 passed8 failed
20.0%
IN91 912 OUT59 546
×
LcbCountCopyArraysLiveCodeBench / leetcode / medium: find-the-number-of-copy-arrays (id 3785)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: countCopyArrays case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:12: Expected '(' to declare a function or '=' to declare a global variable after 'parse error', found ':'. Global variables must have an initializer. Values: run.Compiled = false
Failed IN9 257 OUT1 419
×
LcbLongestCommonPrefixRemovalLiveCodeBench / leetcode / hard: longest-common-prefix-of-k-strings-after-removal (id 3784)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: lcpRemoval case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 39:29: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 199 OUT3 998
×
LcbMaxActiveSectionsTradeLiveCodeBench / leetcode / medium: maximize-active-section-with-trade-i (id 3805)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: maxActiveTrade case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 43:17: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 243 OUT10 658
×
LcbMinCostDivideArrayLiveCodeBench / leetcode / hard: minimum-cost-to-divide-array-into-subarrays (id 3765)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: minCostDivide case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:18: Type 'List<long>' has no supported method named 'Last' with 0 argument(s). 13:18: Type 'List<long>' has no supported method named 'Last' with 0 argument(s). Values: run.Compiled = false
Failed IN9 247 OUT10 007
✓
LcbMinCostRemoveElementsLiveCodeBench / leetcode / medium: find-minimum-cost-to-remove-array-elements (id 3776)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Mediumsource:LiveCodeBench
Passed IN9 175 OUT10 104
×
LcbPermutationsIVLiveCodeBench / leetcode / hard: permutations-iv (id 3783)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: permutationsIV case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 42:14: Expected ';' after the variable declaration, found '('. Values: run.Compiled = false
Failed IN9 164 OUT13 925
×
LcbReverseDegreeLiveCodeBench / leetcode / easy: reverse-degree-of-a-string (id 3811)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: reverseDegree case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 12:2: Unterminated char literal. Chars must contain exactly one character and close with ''' on the same line. Values: run.Compiled = false
Failed IN9 131 OUT670
✓
LcbShortestMatchingSubstringLiveCodeBench / leetcode / hard: shortest-matching-substring (id 3692)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Hardsource:LiveCodeBench
Passed IN9 192 OUT6 308
×
LcbTransformArrayParityLiveCodeBench / leetcode / easy: transform-array-by-parity (id 3778)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: transformArray case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 1:1: 'var' can only be used for local variables and foreach variables, not here. Use an explicit type. Values: run.Compiled = false
Failed IN9 149 OUT565
×
LcbUnique3DigitEvenLiveCodeBench / leetcode / easy: unique-3-digit-even-numbers (id 3799)1 AI query 0 tool callscategory:CodeGenerationcategory:V6@LeetCodelevel:Easysource:LiveCodeBench
Assertion expression evaluated to false: run.Compiled Context: unique3Digit case0 did not compile: SC# compilation failed inside the script runner. Compiler diagnostics: 26:28: foreach cannot iterate over a Dictionary directly. Iterate over dict.Keys() or dict.Values() instead. Values: run.Compiled = false
Failed IN9 155 OUT1 892