AI

[IvanNemtsov]

Hello, I am a fan of your products and would like to get some information. The Ryzen AI 9 HX 370 processor has an NPU with 50 TOPS. If a text generation neural network is deployed locally, will it utilize this NPU? Will this neural network be stored in RAM, and are there any speed tests for text generation using this method? Could you please answer this question? I want to buy a new laptop with your processor to use it in this way.

[mcgroup00]

The Ry zen 9 HX370 processor with a 50 Tops NU (Neural Processing Unit) is designed for advanced AI tasks like real-time data processing, machine learning, and AI-enhanced applications. To utilise its capabilities, ensure your software or applications are optimised for AI acceleration, such as AI-enhanced video editing or gaming. You can also explore frameworks like TensorFlow or PyTorch, which can leverage the NU for faster AI computations.

[IvanNemtsov]

Is there any data, you didn’t answer the question, I want to understand at what speed the local neural network will work. How many tokens will your NPU drop per second?