The Evolving Impact of AI on EUC Physical Endpoints: A Year in Review
In this blog
In the rapidly evolving world of technology, Artificial Intelligence (AI) has become a buzzword that is so over-used that most of us are tired of hearing it. Nonetheless, it still promises to revolutionize everything. One facet of this that we all need to consider is the AI PC. While the idea of an AI PC sounds like a futuristic dream come true, many businesses are still trying to weigh the potential benefits against the costs of such an investment given the current capabilities of the technologies available today.
The promise of AI PCs
AI PCs are designed to enhance user experience using local AI capabilities to rapidly optimize performance, predict user needs, and automate routine tasks based on what is observed real-time. Imagine a computer that can learn your habits, anticipate your requirements, and adapt to your workflow seamlessly. This level of personalization can significantly boost productivity and efficiency. At the same time, it can potentially optimize power consumption based on usage patterns, ensuring that the system runs efficiently without wasting energy.
Moreover, AI PCs can offer advanced security features. By continuously monitoring for unusual activity because it understands your normal behavior as well as learning from past incidents, these systems can provide robust protection against cyber threats. For businesses, this means safeguarding sensitive data and maintaining operational integrity.
Some of capabilities to leverage the onboard Neural Processing Unit (NPU) exist today. For instance, Trend Micro has launched security solutions specifically designed for AI PCs. Their NPU powered email security allows email scam protection to run locally on the device, enhancing user privacy and security while reducing latency. Similarly, ESET leverages the NPU to improve native device security by offloading tasks like phishing email detection to the NPU, speeding up detection and reducing the load on the CPU. Microsoft Defender also leverages the NPU to enhance security; by using Intel Threat Detection Technology (TDT), Microsoft Defender can offload tasks like accelerated memory scanning and cryptojacking detection to the NPU. This not only improves detection capabilities but also reduces CPU consumption and power usage, which should lead to longer battery life on laptops and tablets.
AI PCs can also enhance creative workflows. For example, content creators can benefit from AI-driven tools that assist in video editing, graphic design, and music production. AI algorithms can analyze footage, suggest edits, and even generate content, allowing creators to focus on their artistic vision rather than the technical aspects of production.
The Utilization Challenge
Despite the exciting potential, there are significant challenges to the widespread adoption of AI PCs today. One of the primary issues is the underutilization of AI capabilities. Many users do not understand how to fully leverage the advanced features of AI PCs, leading to a gap between potential and actual usage. Whether this is simply a lack of awareness, insufficient training, or user interfaces that aren't as intuitive as they need to be - the net result is many non-technical users aren't effectively using the power of AI that is available to them.
We have seen an improvement in the software ecosystem and it's embracing of the AI hardware, but it's still not nearly where it needs to be. For instance, some apps can perform real-time background removal and video upscaling in apps like Adobe Premiere and DaVinci Resolve. Blender has an NPU powered feature that reduces the time it takes to render 3D objects into 2D images. Affinity Photo 2 uses NPUs for object and subject selection, improving performance and making the editing process smoother. Capture One leverages NPUs for AI cropping and AI-assisted color grading. Moises allows musicians to isolate vocals and instruments from music tracks, with NPU optimization improving the app's performance. These applications are fantastic examples of how AI PCs can really help with productivity, but most of them are what I would consider to be niche or in early stages of development.
Another challenge is the cost of AI PCs. Recent entries in the market of AI PCs are using the familiar standard x86 processors, but these need to be high-end processors and also include additional components in the form of the NPU – thus being significantly more expensive than traditional end user devices. The other option is to go with a low powered ARM based processor; but that comes with an Architecture change that may introduce software compatibility issues. This still has the potential of costing more, but in the form of soft costs, like time wasted trying to find compatible software, or time spent on support issues, etc. This higher cost can be a barrier for individual consumers and businesses alike, limiting the market for AI PCs. Fortunately, as the technologies become more widespread and production costs decrease, it is expected that AI PCs will become more affordable and accessible.
All of that contributes to the fact that we are still in that classic software development paradox timeframe. Software developers cannot justify spending too many resources on designing software that require AI PC's because in the grand scheme of things, their adoption is still fairly low; and large-scale adoption of AI PC's has not really begun because a vast majority of the software cannot utilize the new AI-enabled hardware.
The Investment Angle
From an investment perspective though, AI PCs represent a promising opportunity. As AI technologies continue to advance, the demand for AI PC's is expected to grow. Early adopters of AI PCs could potentially benefit from the competitive edge that these advanced systems provide. Particularly in specific areas – Creative and design workflows, Remote and Hybrid work scenarios, software development, and more can use some of the features available today. And the list is growing.
Investing in AI PCs also aligns with the broader trend of digital transformation. Companies that embrace AI and integrate it into their operations are likely to stay ahead of the curve, attracting tech-savvy customers and partners. This forward-thinking approach can enhance a company's reputation and drive long-term growth.
Additionally, AI PCs can potentially contribute to sustainability efforts. By optimizing power consumption and reducing the need for frequent hardware upgrades, AI PCs should help reduce electronic waste and lower the carbon footprint of technology use.
Reflecting on Last Year's Insights
Last year, we discussed the potential of AI PCs and the challenges they faced. At that time, the hardware was impressive, but the software ecosystem was still catching up. Many applications were niche or in early stages of development, and there were significant compatibility issues with ARM-based PCs. Security products leveraging NPUs were also in the development phase, with widespread adoption still on the horizon.
Fast forward to today, and while there have been notable advancements, many of the same challenges remain. The software ecosystem has improved, with more applications optimized for NPUs, but there is still a gap between potential and actual usage. The cost of AI PCs continues to be a barrier for many, and justifying the ROI is not a simple math calculation.
AI PCs are the future, the only question that remains is when does that future arrive for you and your business. Developer tools and support are rapidly improving, and broader app compatibility is likely with upcoming updates. The continuous improvement of local AI use cases, such as real-time AI assistants, enhanced security, and smart automation, remains strong.
Conclusion
AI PCs continue to have great potential as a transformative technology that can enhance productivity, security, and overall user experience. However, the current landscape still presents challenges that may hinder their full utilization. As these technologies mature and the software ecosystem catches up, AI PCs are likely to become a more valuable investment. For now, it's essential to weigh the potential benefits against the practical limitations and make informed decisions about adopting the AI PC's