Benchmark summary
The model builds a Super Speed-like top-down racing game with laps, wrenches and an upgrade shop in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.
Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.
| Benchmark items | |||
|---|---|---|---|
| Script / test | Status | Tokens | |
Building Games in SC#: Super Speed-like racing
18 failed |
0.0% |
IN305 750 OUT19 487 | |
| × | RacingThe model builds a top-down racing game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.4 AI queries
5 tool calls Assertion expression evaluated to false: app.Built
Context: AI: completed
App: not submitted; the last file version is graded (end: stopped: no tool call in 3 answers in a row)
Work: 4 AI calls (9 model rounds with tool calls), 1 whole-file writes, 1 edits (1 lines), 1 CheckApp calls, 1 refused rewrites, 0 refused repeated edits, 0 rejected submissions, 3 reminders to hand in
Compile errors: (2,5) Expected a type (bool, byte, int, long, decimal, double, char, string, List<...>, Dictionary<...>, HashSet<...> or a struct name), found '2'.
Values:
app.Built = false |
Failed | IN305 750 OUT19 487 |
| × | Hidden_AcceleratesUp adds accel to the speed every frame, up to maxSpeed and never above.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_CarsCollideThe player's car cannot drive into a computer car: it does not move and its speed is halved.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_ComputerCarsThe computer cars stay on road tiles, keep 10 px away from other cars, point in the direction they move, and each completes a lap in time.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_ComputerCarsAvoidThePlayerComputer cars do not drive into the player's car: they keep 10 px away from it.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_GrassOn grass the speed is limited to half of maxSpeed.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_InitialStateAfter AppInit the track is the given map, and the car, the computer cars and the counters have their starting values.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_LapsA lap counts only when the car passes checkpoints 1, 2 and 3 in this order and then the start line.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_MovesInItsDirectionThe car moves by carSpeed in the direction of carAngle.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_NextRaceEnter in the shop starts the next race: the track and the cars start again, wrenches and upgrades stay.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_PositionThe position counts the computer cars that passed more checkpoints than the player, and the screen shows it.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_RaceEndAfter the third lap the race is over: the place counts the computer cars that already have 3 laps, and the prize is added.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_ScreenShowsTheTrackThe screen shows the track tiles, the start line, the wrenches and the cars.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_ShopIn the shop the keys 1, 2 and 3 buy upgrades for 2 * (level + 1) wrenches, the values grow, and level 3 is the last.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_SlowsDownWithout keys the car slows down by accel / 2 per frame, Down brakes by 2 * accel, and the speed never goes below 0.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_SteeringLeft and Right turn a moving car by turnRate per frame and keep the angle between 0 and 360; a car that stands still does not turn.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_WallsA wall stops the car: it does not move and its speed becomes 0.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |
| × | Hidden_WrenchesDriving over a wrench picks it up: the tile becomes road and wrenches grows by 1.0 AI queries
0 tool callsHiddenTest Not run: the app does not compile. |
Failed | IN0 OUT0 |