AI Discussions

[axramd]

Hello.

What Deepseek R1 distills can be installed compatibly on a device running AMD Ryzen 7 Pro 8840HS w/ Radeon 780M Graphics with 2x32GB RAM 1TB SSD?

Thank you.

[axramd]

Hello. To follow up for DeepSeek R1 installation, do you have any knowledge on which one would have a good performance (or would be at minimum recommendation, or would smoothly run) for a PC w/ Ryzen 7 Pro 8840HS w/ 780M Graphics 2x32GB RAM 1TB DDR5 SSD? I'm looking at these options (if can be recommended):

32b-qwen-distill-q4_K_M - 20GB
32b-qwen-distill-fp16 - 66GB
32b-qwen-distill-q8_0 - 35GB

Thanks.

[helixo56]

The AMD Guide Recommend DeepSeek-R1-Distill-Llama-14B

[pekinga1]

14B-qwen-q4-k-m 在lm studio上使用vulkan api，约6tokens/s，780m最多可以分配一半的内存作为共享显存，只要不超出限制一般是可以工作的，但是速度会降低。32b可能低于3tokens/s，可读性较差