cancel
Showing results for 
Search instead for 
Did you mean: 

AI Discussions

Takano
Adept I

About ryzen_ai_oga_llm_1.2_release.zip

I downloaded the ryzen_ai_oga_llm_1.2_release.zip from the Ryzen AI SW Early Access Secure Site and attempted to use it, but I encountered issues.
The following error was displayed:
```
shell
%ryzen_ai_oga_llm_1.2_release\amd_oga\llama2-7b-int4>llama2.bat
Model Generate using OGA ...
- Model Path: .
- Prompt File: prompts.txt
- Max new tokens.: 20
- Use chat template: 1
---------------------------------------
Creating model...
[Vitis AI EP] No. of Operators : CPU 107 MATMULNBITS 195 MLP 640
[Vitis AI EP] No. of Subgraphs :MATMULNBITS 65 MLP 32
2024-12-06 21:40:14.8800411 [E:onnxruntime:onnxruntime-genai, inference_session.cc:2104 onnxruntime::InferenceSession::Initialize::<lambda_3f75f9ad8042b816d305a4439775c17f>::operator ()] Exception during initialization: invalid unordered_map<K, T> key
Error: Exception during initialization: invalid unordered_map<K, T> key
```
I am using a Copilot+ PC equipped with AMD RYZEN AI HX 370.
I followed all the instructions provided in the document (readme.pdf) included with the zip file.
Does anyone know the cause of this issue or how to resolve it?

0 Likes
1 Solution
Uday_Das
Staff

Please make sure environment variables are set properly. 

set DEVICE=stx

set DD_ROOT=./bins

 

View solution in original post

0 Likes
2 Replies
Uday_Das
Staff

Please make sure environment variables are set properly. 

set DEVICE=stx

set DD_ROOT=./bins

 

0 Likes

Thank you for your reply. This comment has resolved my issue.

0 Likes