AI Discussions

[mayowa_osibodu]

Hello,

We're currently trying to run LLMS on the RyzenAI PC NPU.

We've successfully installed the RyzenAI software and NPU drivers as outlined here: https://ryzenai.docs.amd.com/en/latest/inst.html

We're currently following this tutorial to run LLMs on the NPU (https://github.com/amd/RyzenAI-SW/tree/main/example/transformers/models/llm)

However when running build_dependencies.bat, we get this error: 

CMake Error at CMakeLists.txt:6 
(find_package): 
Could not find a configuration file for package "xaiengine" that is compatible with requested version "". 

The following configuration files were considered but not accepted: 

C:/Users/hello/anaconda3/envs/ryzenai-transformers/lib/cmake/xaiengine/xaiengine-config.cmake, version: 3.5 (32bit) 

-- Configuring incomplete, errors occurred! Error: cmake configuration failed.

Any help is appreciated, thanks.

[Uday_Das]

With latest 1.3 driver and Ryzen AI SW repo, build to do the build_dependencies.bat step, please follow the instruction as per the last post of this issue
https://github.com/amd/RyzenAI-SW/issues/143 

1. Clone the repository and initialize the environment as per the instructions:

git lfs install
git clone https://github.com/amd/RyzenAI-SW.git
git lfs pull

cd <transformers>
set TRANSFORMERS_ROOT=%CD%
conda env create --file=env.yaml
conda activate ryzenai-transformers

2. Before running build_dependencies.bat, install the following dependencies in the activated environment:

pip install zstandard==0.23.0
conda install zlib

3. After this, proceed to run build_dependencies.bat, and the issue should be resolved.