Benchmark summary
The model builds a Super Speed-like top-down racing game with laps, wrenches and an upgrade shop in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.
Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.
| Benchmark items | |||
|---|---|---|---|
| Script / test | Status | Tokens | |
Building Games in SC#: Super Speed-like racing
17 passed1 failed |
94.4% |
IN2 255 995 OUT106 668 | |
| ✓ | RacingThe model builds a top-down racing game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.1 AI query
45 tool calls |
Passed | IN2 255 995 OUT106 668 |
| ✓ | Hidden_AcceleratesUp adds accel to the speed every frame, up to maxSpeed and never above.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_CarsCollideThe player's car cannot drive into a computer car: it does not move and its speed is halved.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| × | Hidden_ComputerCarsThe computer cars stay on road tiles, keep 10 px away from other cars, point in the direction they move, and each completes a lap in time.0 AI queries
0 tool callsHiddenTest Assertion expression evaluated to false: aiLaps[0] >= 1 && aiLaps[1] >= 1 && aiLaps[2] >= 1
Context: laps after 1000 frames: 0, 0, 0
Values:
aiLaps[0] = 0
aiLaps[1] = 0
aiLaps[2] = 0 (line 1143) |
Failed | IN0 OUT0 |
| ✓ | Hidden_ComputerCarsAvoidThePlayerComputer cars do not drive into the player's car: they keep 10 px away from it.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_GrassOn grass the speed is limited to half of maxSpeed.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_InitialStateAfter AppInit the track is the given map, and the car, the computer cars and the counters have their starting values.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_LapsA lap counts only when the car passes checkpoints 1, 2 and 3 in this order and then the start line.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_MovesInItsDirectionThe car moves by carSpeed in the direction of carAngle.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_NextRaceEnter in the shop starts the next race: the track and the cars start again, wrenches and upgrades stay.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_PositionThe position counts the computer cars that passed more checkpoints than the player, and the screen shows it.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_RaceEndAfter the third lap the race is over: the place counts the computer cars that already have 3 laps, and the prize is added.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_ScreenShowsTheTrackThe screen shows the track tiles, the start line, the wrenches and the cars.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_ShopIn the shop the keys 1, 2 and 3 buy upgrades for 2 * (level + 1) wrenches, the values grow, and level 3 is the last.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_SlowsDownWithout keys the car slows down by accel / 2 per frame, Down brakes by 2 * accel, and the speed never goes below 0.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_SteeringLeft and Right turn a moving car by turnRate per frame and keep the angle between 0 and 360; a car that stands still does not turn.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_WallsA wall stops the car: it does not move and its speed becomes 0.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_WrenchesDriving over a wrench picks it up: the tile becomes road and wrenches grows by 1.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |