Qwen 3.6 27B NVFP4 Instruct | Benchmark #205

Described in:Battle City-like game built by Qwen 3.6 and Qwen 3.8 as agents

Benchmark summary

Battle City-like game built in SC# as an agent

ModelQwen 3.6 27B QuantizationNVFP4 ModeInstruct

The model builds a Battle City-like tank battle game in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.

Score 14/17 82.4% passed
14 passed3 failed17 total 1 AI query 47 tool calls TOKENS IN3 508 073 TOKENS OUT62 923

Results by difficulty

1 group
Level Unknown / other
14 / 17 82.4%
passed
1 AI query 47 tool calls IN3 508 073 OUT62 923

Results by category

1 group
Category Other
82.4% 14/17 passed
1 AI query 47 tool calls TOKENS IN3 508 073 TOKENS OUT62 923

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Building Games in SC#: Battle City-like tank battle 14 passed3 failed
82.4%
IN3 508 073 OUT62 923
✓
BattleCityThe model builds a Battle City tank game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.1 AI query 47 tool calls
Passed IN3 508 073 OUT62 923
✓
Hidden_BaseAndRestartA bullet that reaches the base ends the game; the game stops, and Enter starts a new one.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_BulletsAndWallsA bullet destroys the first brick in its way and stops; steel stops it; water and trees let it pass.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
×
Hidden_EnemiesEnemies appear on the spawn cells, at most 4 at once and 20 in all; they step every 8 frames onto passable cells only, and they shoot.0 AI queries 0 tool callsHiddenTest
Assertion expression evaluated to false: bulletWait < 120 Context: frame 240: no enemy bullet for 120 frames Values: bulletWait = 120 (line 1403)
Failed IN0 OUT0
✓
Hidden_EnemiesStayOffWaterAn enemy never drives onto water or steel: shut in by them, it stays on its cell.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_EnemyBulletsEnemy bullets destroy bricks and pass through enemy tanks, but do not destroy steel.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
×
Hidden_FiringSpace fires one bullet from the center of the tank; it flies 4 px per frame and a second Space does nothing while it flies.0 AI queries 0 tool callsHiddenTest
Assertion expression evaluated to false: shotActive && Hidden_Near(shotX, 88) && Hidden_Near(shotY, 120) && shotDir == 1 Context: the bullet at the tank's center: (92, 120) Values: shotActive = true shotDir = 1 (line 1206)
Failed IN0 OUT0
✓
Hidden_HittingEnemiesA bullet destroys an enemy tank and gives 100 points.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_InitialStateAfter AppInit the board is the given map, and the player, the counters and the lists have their starting values.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PlayerHitAn enemy bullet that reaches the player costs a life and sends the tank back to its start with a 90 frame shield; the helmet protects; the last life ends the game.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PlayerMovesThe tank moves one cell when an arrow key is held, waits 4 frames before the next move, and only turns when the way is blocked.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PowerUpsThe grenade removes all enemies on the board without score; the helmet gives a 300 frame shield; stars stop at 2.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PowerUpsAppearAt least one power-up appears for every 7 enemies destroyed by bullets, on an empty cell.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_ScreenThe screen shows the board cells, the tanks, a bullet, a power-up and the texts; trees cover tanks.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
×
Hidden_StarsStars make the player's bullets faster, and with 2 stars they destroy steel.0 AI queries 0 tool callsHiddenTest
Assertion expression evaluated to false: Hidden_Near(shotX, 96) Context: 8 px per frame with a star: shotX 104 (line 1249)
Failed IN0 OUT0
✓
Hidden_TimerThe timer freezes the enemies: they neither move nor shoot.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_WinningWhen all enemies are destroyed and none are left to come, the game is won.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0