PC Processors

[ttajti]

I have 96GB RAM, so I could use e.g. 32GB VRAM with my 780m iGPU.

Unfortunately BIOS allows only 16GB as UMA frame buffer size.

Is this a hard limit somewhere or only a constraint in the BIOS because they don't think I would like more VRAM?

Is there any way to override this?

[swolfe100]

This is a Generative AI / LLM question and concern. I do not see an answer to why someone does not ship a BIOS fix.  I would want it.  I see MANY comment about why one might not want to provide this fix.
1. RAM is expensive - and you do not need more for gaming.
2. That many users are stupid and might call support if  can't figure out that if they only have 24 Gb of RAM in the system and they allocate 16 Gb for VRAM. 
3. One probably should not use AMD for AI anyway ..
And these rules have changed.
1. Users are not stupid .. or if they are have a support page.
2. RAM is now lower in price.  It was surprisingly easy and not too expensive to have 64 Gb to 128 Gb in a Mini PC with a Ryzen CPU and the 780m iGPU.  
3. For what it is worth.. you can  do some AI on AMD processors.  
The new LLMs use LOTS of GPU RAM.  A popular model for programming 
     the 14b model is not bad.. and fits in VRAM .. and on an AMD gets 7 tokens/s
   $ ollama ps
    NAME                         ID                        SIZE    PROCESSOR 
    qwen2.5-coder:14b 3028237cc8c5 11 GB 100% GPU 
  the 32b model just barely does NOT fit 
  (base) test@b1:~$ ollama run qwen2.5-coder:32b --verbose

  $ollama ps
  qwen2.5-coder:32b 4bd6cbf2d094 21 GB     22%/78% CPU/GPU 

[elstaci]

The Manufacturer decides on the maximum  IGPU vRAM you can allocate from your System RAM Memory.

The only way to increase/decrease your IGPU vRAM is through BIOS Settings  only.

So if in BIOS Settings it has a drop-down menu showing a maximum IGPU vRAM allocation of 16GB that is the maximum amount allowed by the manufacturer for your IGPU.  Possibly in the future with BIOS Updates that maximum might be extended to a higher IGPU maximum.

BIOS will also determine how much you can allocate safely from your System RAM Memory for your IGPU vRAM depending on how much System RAM you have installed.

NOTE: IF if you have the minimum amount of IGPU vRAM installed it won't affect your PC Graphics performance. Windows will temporarily allocate whatever amount of System RAM the APP or Graphics will needs to run and then afterwards return it back to System RAM again.

Adding more IGPU vRAM will help the IGPU to be more efficient though and many Apps requires a minimum of 2GB of vRAM to run.