cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

AI Discussions

rbg
Journeyman III
a month ago

Gemma 3n on Ryzen AI 365

I want to install the new Gemma 3n 4B language model with AMD Ryzen™ AI Software 1.4 on my laptop with AMD Ryzen AI 365. This model is not currently on the list of pre-optimized models for OnnxRuntime GenAI (OGA) Flow.
Is there a way to install it now?
Or is it expected to be available as a pre-optimized model soon?
By the way, will AMD Ryzen™ AI Software 1.4 even run on my laptop with AMD AI 365 and Windows 11?

Labels
0 Likes
1 Solution
raohenry
Adept I
4 weeks ago

Hi @rbg ,

The Gemma 3n 4B model isn't currently listed among the pre-optimized models for ONNX Runtime GenAI Flow. However, you can still deploy it on your AMD Ryzen AI 365 laptop by converting the model to the ONNX format and optimizing it using ONNX Runtime's Model Builder. This tool supports Gemma models and can help tailor them for your specific hardware.

Regarding compatibility, AMD Ryzen AI Software 1.4 supports the Ryzen AI 365 processor on Windows 11, provided your system meets the necessary prerequisites, including Visual Studio 2022, CMake 3.26 or higher, and Anaconda or Miniconda. Ensure your Windows build is 22621.3527 or newer. 

While Gemma 3n 4B isn't officially pre-optimized for this setup, with the right tools and configurations, you can achieve efficient deployment on your system.

Best regards.

View solution in original post

0 Likes
1 Reply
raohenry
Adept I
4 weeks ago

Hi @rbg ,

The Gemma 3n 4B model isn't currently listed among the pre-optimized models for ONNX Runtime GenAI Flow. However, you can still deploy it on your AMD Ryzen AI 365 laptop by converting the model to the ONNX format and optimizing it using ONNX Runtime's Model Builder. This tool supports Gemma models and can help tailor them for your specific hardware.

Regarding compatibility, AMD Ryzen AI Software 1.4 supports the Ryzen AI 365 processor on Windows 11, provided your system meets the necessary prerequisites, including Visual Studio 2022, CMake 3.26 or higher, and Anaconda or Miniconda. Ensure your Windows build is 22621.3527 or newer. 

While Gemma 3n 4B isn't officially pre-optimized for this setup, with the right tools and configurations, you can achieve efficient deployment on your system.

Best regards.

0 Likes