cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

AI

IvanNemtsov
Adept I
‎08-08-2024 03:11 AM

Ryzen ai 9 hx 370/ NPU 50top, how use?

Hello, I am a fan of your products and would like to get some information. The Ryzen AI 9 HX 370 processor has an NPU with 50 TOPS. If a text generation neural network is deployed locally, will it utilize this NPU? Will this neural network be stored in RAM, and are there any speed tests for text generation using this method? Could you please answer this question? I want to buy a new laptop with your processor to use it in this way.

0 Likes
2 Replies
mcgroup00
Adept I
‎08-08-2024 04:42 AM

The Ry zen 9 HX370 processor with a 50 Tops NU (Neural Processing Unit) is designed for advanced AI tasks like real-time data processing, machine learning, and AI-enhanced applications. To utilise its capabilities, ensure your software or applications are optimised for AI acceleration, such as AI-enhanced video editing or gaming. You can also explore frameworks like TensorFlow or PyTorch, which can leverage the NU for faster AI computations.

IvanNemtsov
In response to mcgroup00
Adept I
‎08-08-2024 06:32 AM

Is there any data, you didn’t answer the question, I want to understand at what speed the local neural network will work. How many tokens will your NPU drop per second?