NixOS-DGX-Spark Project Enables Nix and NixOS on NVIDIA DGX Spark Systems

Nix on DGX Spark Hardware

The NixOS-DGX-Spark project introduces support for Nix and NixOS on NVIDIA DGX Spark systems, as well as the Asus Ascent GX10. This allows developers to utilize Nix's declarative configuration and reproducible build capabilities within the DGX environment. Users have the option to either run Nix playbooks and dev shells on the existing NVIDIA DGX OS (Ubuntu) or perform a full installation of NixOS for a complete Nix experience.

Installation and Configuration

The project provides pre-built USB images for installing NixOS, which include two kernel options: NVIDIA's specialized kernel for full GPU support and working Ethernet, or a standard NixOS 6.17 kernel. A NixOS module is also included to enable configurable hardware support for DGX Spark systems, allowing users to select the preferred kernel. Before installing NixOS, users must update the firmware and disable Secure Boot in the DGX Spark BIOS.

GPU Driver Handling

For non-NixOS systems, the project addresses the challenge of Nix-built CUDA applications finding host GPU drivers through `nix-gl-host`. Playbook dev shells automatically handle this, and Nix-native playbooks wrap commands with `nixglhost`. For other dev shells, `nixglhost` can be used manually to prefix commands, ensuring proper GPU driver access for CUDA applications.

Significance for AI Development

This integration of Nix and NixOS with DGX Spark hardware offers a method for managing development environments for AI workloads. By leveraging Nix's reproducible builds, developers can ensure consistency across different setups and simplify the deployment of complex AI applications on these specialized NVIDIA platforms.