Hi,
I know from tutorials NPUs like in the 8700 processor support the int8 data type. Do they also support int4 or other ints with fewer bits?
Kind regards,Andreas
Solved! Go to Solution.
Yes, for LLM flow it supports 4-bit.
https://github.com/amd/RyzenAI-SW/blob/main/example/transformers/models/llm/docs/README.md
View solution in original post
