AI Discussions

[Abdulrahman392011]

Is it too much to ask AMD to put RAM slots on their GPUs. I need to be able to extend the RAM to something like a terabyte to run deepseek r1 model. I know that it will be slow but not as slow as cpu processing. On cpu it goes to 4 tokens a second. I am hoping that if it were run on a gpu it can go to 20 tokens a second.

Please consider this. Adding the slots on the back of the gpu will not take up space if it were not used and will not intervene with the cooling on the other side of the gpu. But for people like myself this will make it very valuable as i can have very large models running locally at an acceptable price and token speed for my personal use.

[elstaci]

Adding more vRAM to a GPU card isn't going to do much if the actual GPU processor isn't very fast. It might help in some games playing in Ultra mode, as an example.

Plus adding more vRAM you might need to modify your GPU vBIOS to be able to access and recognize the extra added vRAM.

Also adding RAM sticks might interfere with other hardware in a tight PC case or with the CPU Cooler. Best way, in my opinion, is to have a GPU card where the vRAM chips are removable and upgrade-able like a CPU processor.

Also you need to consider if the GPU processor can handle more added vRAM.

I did read once where a User upgraded his GPU Card vRAM by desoldering the current vRAM chips and soldering higher density vRAM chips.  But don't remember how that turn out if the GPU card work afterwards and if there was any improvement.

[FunkZ]

---

@Abdulrahman392011 wrote:

Is it too much to ask AMD to put RAM slots on their GPUs. I need to be able to extend the RAM to something like a terabyte to run deepseek r1 model. But for people like myself this will make it very valuable as i can have very large models running locally at an acceptable price and token speed for my personal use.

---

Commercially available GDDR uses a BGA (ball grid array) interface, which is a JEDEC standard specification for soldered memory chips. There is absolutely NO standard for socketable GDDR memory, never has been.

You're asking AMD to manufacture their own unique memory chip design and make up some arbitrary socket interface to use on their graphics cards, not to mention the GPU core memory bus bit width required to address a terrabyte of GDDR, all so you can run a LLM on your "personal, acceptably-priced" desktop GPU. ROFL