A couple a years ago in 2022 amidst the AI hype samsung released CXL memory expander.
Basically a ram stick on steroids
https://semiconductor.samsung.com/news-events/tech-blog/expanding-the-limits-of-memory-bandwidth-and...
If support for this memory is added to amd graphics cards it will mean running 1.3 terabyte models locally with 20 tokens average speed for one user with a setup that cost less than 5 grands.
Anyone working at AMD please look into the possibility and do the math and make sure it is not possible before overlooking it.
People like me please like the topic as to give some incentive to those working at AMD that we actually are intrested in something like this.
