Many new laptops now include a Neural Processing Unit (NPU), a silicon block designed to run AI workloads efficiently. These units operate at approximately 2W, significantly less than the over 100W required by discrete graphics cards for similar tasks. NPUs are becoming standard in mid-range and premium laptop models, though they are not yet universally present.
The widespread inclusion of NPUs in laptops is primarily driven by certification requirements rather than immediate consumer demand. Advisory firm Gartner estimates that AI-capable PCs, including NPU-equipped laptops, constitute over half of global shipments. This trend aligns with Microsoft's 2024 mandate, which requires new machines to achieve 40 TOPS (Tera Operations Per Second) of dedicated NPU performance to access new Windows AI features. This requirement has led to a rapid increase in NPU hardware integration, despite a lag in software development that fully utilizes these capabilities.
NPUs are designed to accelerate AI inference, which is the process of running an AI model rather than training it. They are optimized for matrix multiplication and nonlinear activation functions, core operations in neural networks, offering efficiency at the cost of general-purpose flexibility. For example, an NPU can perform tasks like background blur in video calls with significantly less power consumption than a CPU or GPU, preserving battery life and reducing heat generation.
NPUs are not suitable for training AI models or running large local language models like Llama 70B, which still require discrete GPUs with substantial video memory. They are also not needed for cloud-based AI services such as ChatGPT or Gemini. Currently, their practical applications are limited to low-power, always-on tasks like webcam effects, noise suppression, real-time translation, and local search indexing. The full potential of NPUs is yet to be realized as software development catches up with hardware availability.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's briefNew every morning, and the back catalogue is archived by date.
Laptops are increasingly equipped with Neural Processing Units (NPUs), specialized chips for AI workloads that consume less power than CPUs or GPUs. This adoption is largely due to Microsoft's 2024 requirement for new Windows AI features, mandating 40 TOPS of NPU performance in new machines. While NPU hardware is now common, software utilization for these units is still limited.