Qwen 3.6 27B NVFP4 Thinking | Benchmark #206

Described in:Battle City-like game built by Qwen 3.6 and Qwen 3.8 as agents

Benchmark summary

Battle City-like game built in SC# as an agent

ModelQwen 3.6 27B QuantizationNVFP4 ModeThinking

The model builds a Battle City-like tank battle game in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.

Score 0/17 0.0% passed
0 passed17 failed17 total 1 AI query 0 tool calls TOKENS IN0 TOKENS OUT0

Results by difficulty

1 group
Level Unknown / other
0 / 17 0.0%
passed
1 AI query 0 tool calls IN0 OUT0

Results by category

1 group
Category Other
0.0% 0/17 passed
1 AI query 0 tool calls TOKENS IN0 TOKENS OUT0

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Building Games in SC#: Battle City-like tank battle 17 failed
0.0%
IN0 OUT0
×
BattleCityThe model builds a Battle City tank game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.1 AI query 0 tool calls
Assertion expression evaluated to false: app.Built Context: AI: AiRunner request failed with HTTP 404 (NotFound). App: none handed in (end: AI error: AiRunner request failed with HTTP 404 (NotFound).) Work: 1 AI calls (0 model rounds with tool calls), 0 whole-file writes, 0 edits (0 lines), 0 CheckApp calls, 0 refused rewrites, 0 refused repeated edits, 0 rejected submissions, 0 reminders to hand in Values: app.Built = false
Failed IN0 OUT0
×
Hidden_BaseAndRestartA bullet that reaches the base ends the game; the game stops, and Enter starts a new one.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_BulletsAndWallsA bullet destroys the first brick in its way and stops; steel stops it; water and trees let it pass.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_EnemiesEnemies appear on the spawn cells, at most 4 at once and 20 in all; they step every 8 frames onto passable cells only, and they shoot.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_EnemiesStayOffWaterAn enemy never drives onto water or steel: shut in by them, it stays on its cell.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_EnemyBulletsEnemy bullets destroy bricks and pass through enemy tanks, but do not destroy steel.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_FiringSpace fires one bullet from the center of the tank; it flies 4 px per frame and a second Space does nothing while it flies.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_HittingEnemiesA bullet destroys an enemy tank and gives 100 points.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_InitialStateAfter AppInit the board is the given map, and the player, the counters and the lists have their starting values.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_PlayerHitAn enemy bullet that reaches the player costs a life and sends the tank back to its start with a 90 frame shield; the helmet protects; the last life ends the game.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_PlayerMovesThe tank moves one cell when an arrow key is held, waits 4 frames before the next move, and only turns when the way is blocked.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_PowerUpsThe grenade removes all enemies on the board without score; the helmet gives a 300 frame shield; stars stop at 2.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_PowerUpsAppearAt least one power-up appears for every 7 enemies destroyed by bullets, on an empty cell.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_ScreenThe screen shows the board cells, the tanks, a bullet, a power-up and the texts; trees cover tanks.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_StarsStars make the player's bullets faster, and with 2 stars they destroy steel.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_TimerThe timer freezes the enemies: they neither move nor shoot.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0
×
Hidden_WinningWhen all enemies are destroyed and none are left to come, the game is won.0 AI queries 0 tool callsHiddenTest
Not run: no app was handed in.
Failed IN0 OUT0