● Covered by 2 sources · 2 reportsLow impact2 neutral
Jailbroken PS5s can now run local AI models using GPU for improved performance
Key points
- PS5LM fork enables GPU utilization for LLMs on jailbroken PS5s.
- Achieves 20 tokens/second for Qwen3.8-27B model.
- Smaller models run at over 100 tokens/second.
- Increases usable RAM to 11.4 GiB for LLMs.
- PS5LM functions as a private model server, accessible via OpenAI and Anthropic compatible APIs.
- PS5LM now runs Jev-like decision models (d1, Clef, OpenJev) on the GPU.
- PS5LM uses llama.cpp's Vulkan backend on the RDNA 2 GPU.
- PS5LM supports every architecture and quantization llama.cpp knows.
GPU Acceleration for LLMs on PS5
Reddit user u/AdIllustrious7246 released a fork of PS5LM, a llama.cpp port, which allows jailbroken PlayStation 5 consoles to run AI large language models (LLMs) locally. This new version utilizes the PS5's GPU, leading to a substantial improvement in performance and memory access for LLM operations.
Overcoming Previous Limitations
Previously, GitHub user cobanov created an unofficial llama.cpp port for jailbroken PS5s, but it ran as a CPU payload. This limited RAM access to approximately 6 GiB and resulted in slower performance. The CPU bottleneck also caused system freezes when attempting to run larger LLMs.
The new fork by u/AdIllustrious7246 addresses these limitations by running natively and leveraging the GPU.
Utilizing PS5_Vulkan for GPU Access
The developer achieved GPU utilization by integrating PS5_Vulkan, a port of the RADV graphics driver. This driver enables instructions to be sent to the PS5's GPU, which is typically locked down. PS5_Vulkan has facilitated various homebrew projects by opening up GPU capabilities on the console.
Performance and Memory Gains
With native GPU utilization, the PS5 can now run a 27B parameter model at 20 tokens per second. Smaller models, such as Gemma 4 E4B and Llama 3.2 3B, achieve speeds of 61 and 124 tokens per second, respectively. The native execution also increases usable RAM for LLMs to 11.4 GiB, preventing crashes that occurred with larger models on the CPU-only setup.
Enhanced User Interface and Features
The native application includes a dashboard that displays real-time data, including token generation speed, GPU and CPU usage, power consumption, temperatures, and memory allocation for the model and KV cache. Additionally, the fork integrates with llama.cpp's web UI, allowing users to interact with the LLM from other local devices via a web browser.
Updates
- PS5LM functions as a private model server, accessible via OpenAI and Anthropic compatible APIs.
- PS5LM now runs Jev-like decision models (d1, Clef, OpenJev) on the GPU.
- PS5LM uses llama.cpp's Vulkan backend on the RDNA 2 GPU.
- PS5LM supports every architecture and quantization llama.cpp knows.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Primary sources
GitHub cmc_internal/api GitHub github/collect GitHub cobanov/PS5LM GitHub _private/browser GitHub get-started/accessibility GitHub open-source/sponsorsHow outlets covered it
PS5LM allows users with jailbroken PlayStation 5 consoles to run GGUF language models directly on the console's RDNA 2 GPU. This setup functions as a private model server, accessible by other devices on the local network via OpenAI and Anthropic compatible APIs, without needing a PC or cloud services.
A Reddit user has developed a fork of PS5LM, a llama.cpp port, enabling jailbroken PlayStation 5 consoles to run large language models (LLMs) locally by utilizing the console's GPU. This development allows for significantly faster token generation and access to more RAM compared to previous CPU-only implementations. The improvement means PS5s can now run models like Qwen3.8-27B at 20 tokens/second and smaller models at over 100 tokens/second.