Qwen 3.8 27B NVFP4 Think: medium | Benchmark #90

Described in:Arkanoid-like game built by Qwen 3.6 and Qwen 3.8 as agents

Benchmark summary

Arkanoid-like game built in SC# as an agent

ModelQwen 3.8 27B QuantizationNVFP4 ModeThink: medium

The model builds an Arkanoid-like brick breaker game in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.

Score 20/20 100.0% passed
20 passed20 total 1 AI query 3 tool calls TOKENS IN120 452 TOKENS OUT53 459

Results by difficulty

1 group
Level Unknown / other
20 / 20 100.0%
passed
1 AI query 3 tool calls IN120 452 OUT53 459

Results by category

1 group
Category Other
100.0% 20/20 passed
1 AI query 3 tool calls TOKENS IN120 452 TOKENS OUT53 459

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Building Games in SC#: Arkanoid-like brick breaker 20 passed
100.0%
IN120 452 OUT53 459
✓
BreakoutThe model builds a Breakout game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.1 AI query 3 tool calls
Passed IN120 452 OUT53 459
✓
Hidden_BallAtTheBottomEdgeIsStillInPlayA ball is lost only when its top edge is below the screen: with its center below 240 but its top edge still on the screen, it is still in play.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_BonusFallsSteadilyA bonus falls at a constant speed of 1 px to 4 px per frame and disappears below the screen when it misses the paddle.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_BrickBreaksA ball hitting a brick removes it, adds 10 points, bounces back, and the score text shows the new score.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_BrickDropsABonusBreaking brick 20 drops a Wide bonus at the brick's center, and the falling bonus is drawn on the screen.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_GameOverAndRestartLosing the last life shows GAME OVER and stops the game; Enter starts a new game.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_InitialStateAfter AppInit and one frame, the paddle, the ball, the bricks, the score and the lives have their starting values.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_LifeBonusCatching a Life bonus adds one life, and the lives text shows it.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_LosingTheBallA ball that falls below the screen costs one life and then rests on the paddle again.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_NoBonusFromOtherBricksBreaking a brick whose index is not a multiple of 5 drops no bonus.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PaddleAnglesA hit in the middle goes straight up, hits left or right go to that side, farther from the middle goes more to the side, and both sides mirror each other.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PaddleAnglesAcrossThePaddleMoving the hit point from the left end to the right end of the paddle never makes ballVX smaller, and the two ends give different directions.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PaddleBouncesA ball falling onto the paddle bounces up without costing a life.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PaddleMovesAndStopsHolding Left or Right moves the paddle by 5 px per frame and stops it at both edges.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_ScreenAfterABrickBreaksAfter a brick breaks and the break effect ends, the screen shows one brick less.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_ScreenShowsTheSceneThe screen shows the paddle, the ball, all bricks, the background and the score and lives texts.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_SpaceLaunchesSpace launches the ball with ballVX = 2 and ballVY = -3, and the ball then moves up.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_WallsBounceThe ball bounces off the left, the right and the top wall.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_WideBonusCatching a Wide bonus makes the paddle wider (60 px to 96 px) for 5 to 15 seconds, also on the screen and at the right edge.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_WinningStopsTheGameBreaking the last brick shows YOU WIN and stops the ball.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0