Qwen 3.8 27B NVFP4 Think: medium | Benchmark #160

Described in:Battle City-like game built by Qwen 3.6 and Qwen 3.8 as agents

Benchmark summary

Battle City-like game built in SC# as an agent

ModelQwen 3.8 27B QuantizationNVFP4 ModeThink: medium

The model builds a Battle City-like tank battle game in SC# as an agent: it writes the app, compiles it, runs its own tests and fixes the code. Hidden tests check the rules from the task; each hidden test is its own result.

Score 17/17 100.0% passed
17 passed17 total 1 AI query 20 tool calls TOKENS IN847 727 TOKENS OUT67 352

Results by difficulty

1 group
Level Unknown / other
17 / 17 100.0%
passed
1 AI query 20 tool calls IN847 727 OUT67 352

Results by category

1 group
Category Other
100.0% 17/17 passed
1 AI query 20 tool calls TOKENS IN847 727 TOKENS OUT67 352

Tests with multiple category tags are counted in each matching category, so category totals may exceed the report total.

Benchmark items
Script / test Status Tokens
Building Games in SC#: Battle City-like tank battle 17 passed
100.0%
IN847 727 OUT67 352
✓
BattleCityThe model builds a Battle City tank game from the task as an agent; this item passes when the app compiles and can be exported, and each hidden test is its own item.1 AI query 20 tool calls
Passed IN847 727 OUT67 352
✓
Hidden_BaseAndRestartA bullet that reaches the base ends the game; the game stops, and Enter starts a new one.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_BulletsAndWallsA bullet destroys the first brick in its way and stops; steel stops it; water and trees let it pass.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_EnemiesEnemies appear on the spawn cells, at most 4 at once and 20 in all; they step every 8 frames onto passable cells only, and they shoot.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_EnemiesStayOffWaterAn enemy never drives onto water or steel: shut in by them, it stays on its cell.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_EnemyBulletsEnemy bullets destroy bricks and pass through enemy tanks, but do not destroy steel.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_FiringSpace fires one bullet from the center of the tank; it flies 4 px per frame and a second Space does nothing while it flies.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_HittingEnemiesA bullet destroys an enemy tank and gives 100 points.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_InitialStateAfter AppInit the board is the given map, and the player, the counters and the lists have their starting values.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PlayerHitAn enemy bullet that reaches the player costs a life and sends the tank back to its start with a 90 frame shield; the helmet protects; the last life ends the game.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PlayerMovesThe tank moves one cell when an arrow key is held, waits 4 frames before the next move, and only turns when the way is blocked.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PowerUpsThe grenade removes all enemies on the board without score; the helmet gives a 300 frame shield; stars stop at 2.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_PowerUpsAppearAt least one power-up appears for every 7 enemies destroyed by bullets, on an empty cell.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_ScreenThe screen shows the board cells, the tanks, a bullet, a power-up and the texts; trees cover tanks.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_StarsStars make the player's bullets faster, and with 2 stars they destroy steel.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_TimerThe timer freezes the enemies: they neither move nor shoot.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0
✓
Hidden_WinningWhen all enemies are destroyed and none are left to come, the game is won.0 AI queries 0 tool callsHiddenTest
Passed IN0 OUT0