Developments in the field of artificial intelligence accelerated with the COMPUTEX event. NVIDIA and AMD are preparing to launch gaming laptops that include the artificial intelligence-supported Copilot Plus features announced by Microsoft for laptops with Qualcomm processors.
NVIDIA and AMD bring Microsoft’s Copilot Plus feature!
NVIDIA announced at the COMPUTEX event that RTX AI PC laptops, which will be released by Asus and MSI and include Copilot Plus PC features, are on the way. So what advantages will these computers have?
NVIDIA said in a blog post, “ASUS and MSI’s newly announced RTX AI PC laptops feature GeForce RTX 4070 GPUs and Windows 11 AI PC features, power-saving systems-on-chip” he said. He then confirmed that these laptops will come with AMD’s latest Strix CPUs.
AMD announces CPU, NPU and GPU strategy for AI data centers!
At Computex 2024, AMD introduced its new chip architecture strategy for AI data centers and AI PCs under its leadership. Here is AMD’s road map
However, NVIDIA said that the first Copilot Plus PCs with AMD processors may not include Microsoft’s AI features when they launch. He also said that Windows 11 AI PCs will receive a free update to Copilot+ PC experiences when it becomes available.
This suggests that Microsoft may not be ready to release Recall and other AI-powered Windows features on AMD chips, or that Windows on ARM, which will be released on June 18, may be exclusive for a while for hardware with Qualcomm processors.
NVIDIA is also in something of a fight for AI-assisted tasks on laptops. While Microsoft continues to bring its AI models to NPUs, NVIDIA has also rolled up its sleeves to make its GPUs useful in this AI battlefield on PC. With the slogan RTX AI laptops, he emphasized that their GPUs are capable of running heavier AI workloads than an NPU.
It’s even launching an RTX AI Toolkit in June, which includes tools and SDKs for model customization, optimization, and deployment. These tools will take something like Meta’s Llama 2 model and optimize it to run with much less VRAM requirements and higher performance.
Additionally, NVIDIA is collaborating with Microsoft on key AI models integrated into Windows 11. On the subject, “Our collaboration will provide application developers with easy application programming interface (API) access to GPU-accelerated small language models (SLMs) that enable rollback augmented rendering (RAG) capabilities running on device powered by Windows Copilot Runtime” said.
Microsoft announced Windows Copilot Runtime at Build last month, and NVIDIA said work on accelerating AI models using RTX GPUs would be released as a developer preview later this year.
Microsoft’s Windows Copilot Runtime was designed to make it easier for developers to add artificial intelligence-supported features to their applications. All of this relies on NPU hardware and NVIDIA’s GPUs to accelerate these features.
There are some big differences in performance for developers to consider here, as NPUs are currently around 40 TOPS and NVIDIA’s PC GPUs can handle more than 1000 TOPS for AI.
Because NPUs are designed for higher power efficiency in smaller models and laptops. But GPUs can do a good job of handling larger models with higher performance on PC desktops where battery life isn’t a concern.