Benchmark summary
The model builds the classic Snake game in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.
Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.
| Benchmark items | |||
|---|---|---|---|
| Script / test | Status | Tokens | |
Building Games in SC#: Snake
14 passed1 failed |
93.3% |
IN332 398 OUT31 755 | |
| ✓ | SnakeThe model builds a Snake game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.1 AI query
11 tool calls |
Passed | IN332 398 OUT31 755 |
| ✓ | Hidden_ArrowKeysTurnAn arrow key turns the snake, and the next step goes in the new direction.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_BodyEndsTheGameStepping onto the snake's body ends the game.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_EatingGrowsEating the food makes the snake one cell longer, adds 10 points and places new food on a free cell.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_FoodNeverOnTheSnakeNew food always appears on a board cell that is not part of the snake.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_GameOverAndRestartWhile the game is over nothing moves and arrow keys are ignored; Enter starts a new game.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| × | Hidden_GetsFasterThe snake gets faster: stepFrames never grows, is at most 4 after 10 foods, never below 2, and the snake really steps every stepFrames frames.0 AI queries
0 tool callsHiddenTest Assertion expression evaluated to false: stepFrames <= previous && stepFrames >= 2
Context: after food 10: stepFrames 3 -> 4
Values:
stepFrames = 4
previous = 3 (line 549) |
Failed | IN0 OUT0 |
| ✓ | Hidden_HeadMayFollowTheTailThe head may step onto the tail's cell, because the tail leaves it in the same step.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_InitialStateAfter AppInit, the snake, the direction, the speed, the score and the food have their starting values.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_KeyInTheStepFrameA key pressed in the frame of a step already turns that step.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_MovesEveryStepFramesThe snake takes its first step in the 6th frame and then one step every 6 frames, and the body follows the head.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_ReverseIsIgnoredThe key opposite to the last step is ignored, also after another turn before the next step.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_ScreenAfterEatingAfter eating and after the eating effect ends, the screen shows the longer snake and the new score.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_ScreenShowsTheSceneThe screen shows the background, the food, the body, the head and the score text.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |
| ✓ | Hidden_WallEndsTheGameStepping out of the board ends the game, and the snake stays where it was.0 AI queries
0 tool callsHiddenTest |
Passed | IN0 OUT0 |