Modern 9-Billion-Parameter AI Model Runs on PS4 Without a PC or Linux

Comment Views: 1

Programmer Leonardo Alegria has run the Qwen3.5-9B language model on a base 2013 PlayStation 4. His open-source Garlic LLM program runs directly on the console, without an external PC or Linux installation.

Alegria achieved this through extensive optimization. He wrote custom graphics kernels in OpenCL C for the older AMD GCN architecture, dispensing with standard system drivers entirely. The program communicates with the GPU through custom PM4 command buffers.

The PS4 has just 8 GB of shared GDDR5 memory, so Alegria had to compress the 9-billion-parameter model significantly. He reduced its size to 4.5 GB.

Qwen3.5-9B currently runs at 4-bit precision, with large MLP matrices compressed to 3 bits. The KV cache also uses a 4-bit format. Garlic LLM supports a context window of 16,000 tokens. With decoding enabled, text generation speed when programming rose from 22 to 43 tokens per second.

The project and instructions for running it are available on Hugging Face.

 

Source: iXBT.games

Related articles

Search games, news and articles…

Enter at least two characters

Enter at least two characters