R2D2 for webOS: A Local Home Screen, Browser, and Voice Assistant for LG TVs

Project Overview

R2D2 for webOS is an independent project designed to modify webOS TVs. It introduces a local home screen, a private remote browser, and a push-to-talk voice assistant. The system operates by offloading compute-intensive tasks to a Linux machine, which runs Chromium and voice models, while the TV acts as the display and input interface.

Technical Implementation

The project involves a compute host (an aarch64 Linux machine) that renders a sandboxed Chromium session and streams it to the TV over a local area network. This host also manages local speech recognition and intent models. The TV components include a modified Home application and a browser viewer, which sends remote input back to the host. A root capture owner on the TV intercepts voice commands and transmits audio to the host via mutual TLS.

Risks and Disclaimers

The modifications required for R2D2 for webOS involve running components as root and altering vendor system services on specific firmware builds. This process is unsupported by the manufacturer, may void the TV's warranty, and carries a risk of rendering the TV unusable until a reboot or factory reset. The project explicitly warns that mistakes can disable critical TV functions like the remote, Home screen, or voice control. The software targets a specific firmware build, requiring users to re-derive pins, offsets, and symbols for other firmware versions.

Security and Privacy Considerations

Model inference for the voice assistant remains on the local compute host. However, requested websites, searches, streaming applications, and optional weather services still connect to their respective external providers. Content protection rules are loaded into each disposable browser profile to manage data flow.