AI Discussions

[chew1976]

Dear AMD,

Please take the lead over the N-team by coming out with higher VRAM consumer GPUs for AI purposes. (e.g 48gb/96gb)

Many of us are desperate for more VRAM.
We want to be able to load, run and play with 70b/130b LLM, and not be limited to merely toying with 7b/13b.
We want to run long, complicated, exhaustive Comfyui workflows without running out of allocation halfway.

We don't need the latest, badest power-sucking GPU chip as we are not running high FPS games at ultra-high resolution, we just need way more VRAM on any of your existing GPUs.

Thank you.

Best regards,

Chew

[farshadg]

AMD already has Radeon Pro GPUs available with 48GBs of VRAM, although I wouldn't exactly call them consumer since the cost of them makes them out of reach for many people. If you do have the money for one though I highly recommend the Radeon Pro W7900DS Dual Slot for AI workloads although it isn't exactly cheap at $3,499 USD. It's 48GBs of VRAM and Dual-slot form factor makes them ideal for stacking multiple of these GPUs into a workstation. If you have any questions about using them for AI I personally own the bigger Radeon Pro W7900 (3-slot variant) and can help answer them.

[Y_C]

@amd: why don't you make graphics cards that have memory slots instead of soldered-on memory chips (like the memory slots on a laptop or PC motherboard, but for GDDR chips instead) so that graphics cards become upgradable.

Add a couple of memory module connectors on the graphics card PCB (use the current DIMM, SODIMM or CAMM connector slot if they can be reused for GDDR, or create a NON-PROPRIETARY OPEN-SOURCE GDDR slot/module specification) and offer graphics cards without installed memory so that users can decide how much VRAM they want/need.

And while we're on the subject of eco-friendly user-upgradable graphics cards designs, maybe you can also have the GPU chip user-replaceable as  well by putting it on a daughterboard so that users can choose to buy a more powerful or newer generation GPU to put on the graphics card ?