cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

AI Discussions

nim_amd
Journeyman III
‎06-18-2024 02:28 AM

Import issue with qlinear library while running Llama2 with AMD

Hello Team,

 

I am currently implementing Llama2 7B model with my Ryzen AMD laptop. I have followed the steps which were there in documentation provided by AMD. However, when I was trying to execute the script I was facing issue with one library called "qlinear" (imported in script). I have tried to install with PIP, CONDA but it said that package is not available. Can you please tell me how can I install or is there any alternatives of qlinear? It is an only bottleneck at this point of time I am facing, please suggest or help for the same.

 

Refer github link: https://github.com/amd/RyzenAI-SW/tree/main/example/transformers

 

I am attaching screenshot for your reference:

 

 

img_2.pngimg_1.png

 

Glad to get any response will be appreciate.

 

Thanks,

Nimesh

Labels
0 Likes
1 Reply
Uday_Das
Staff
Staff
‎06-26-2024 10:40 AM

If you follow this  README  starting from the step1, the Step 3 here installs qlinear, this should work, also do use Windows Cmd Prompt. 

 

Thanks

Uday

 

0 Likes