AI Agent News/stories/qwen-3-8-27b-running-locally-identifies-games-from-raw-neural-network-weights.md

Infrastructure

Qwen 3.8 27B running locally identifies games from raw neural network weights

Simon Willison tested a weight-reading example from a recent paper, Sparks of Weight-Space Programming, and found that Qwen 3.8 27B running on his laptop could guess which game a policy network was trained on. The model was slow and failed one of the four games, so the result is a narrow test rather than proof of reliable weight analysis.

Source: simonwillison.net/2026/Nov/3/qwen-can-interpret-model-weights

The paper by Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab reports that frontier models can interpret and modify the raw weights of a machine learning model, which are presented as text full of floating point numbers. One of its examples asks a model to say which of four simplified grid games a policy network was trained on, with no code execution or other tools allowed.

Willison ran the Pac-Man prompt against Qwen 3.8 27B in LM Studio, using a long context window and a raised timeout because the default setting failed. The run took 46 minutes and 43,506 reasoning tokens, and the model answered with a Pac-Man-style game at 72% confidence. It also identified Pong at 75% and Breakout at 88%, but it did not identify Freeway.

Kimi K3.1 Pro, accessed through OpenRouter, correctly guessed Breakout after 9 minutes and 41 seconds. Willison says he is not ready to accept the wider claims made about the paper, and he treats the no-tools question as separate from work where models write and run code.

Why it matters if you build agents

Developers can run a 27B open-weight model locally for some reasoning over raw parameter data, but expect runs of tens of minutes and set long timeouts and large context windows in agent pipelines. The results come from a few prompts run by one author, so they should not be treated as dependable weight analysis yet.

Get stories like this every weekday

One short email with the day's agent tooling news.

Subscribe