yano2mch
Professional Geeky Perv
Yeah, I have Virtual Memory enabled. But that doesn't help much, in fact it kinda slows it even down bcz Drives are slower than RAMs.
Agreed. VM is fine for what it was loading programs or large blocks of data you may or may not be using. Especially under 32Mb, or with Windows 95 you had 8Mb of ram in many cases, and even Windows 3.xx the max memory you could access in 16bit was 16Mb from some 286 limitations while 1Mb was the 'real mode' memory access from the convoluted paging system.
You could set your Virtual Memory to something small like 8Gb, then you have some swapping but it won't be trying to swap a huge amount, rather only is used/touched the least. Or turn it off altogether if you can get away with it.
I will update my gig to 128GB sometime later, but for now I have to squeeze my workload in 64GB. I am also thinking to use my old RTX 3060 Ti 8gb which is just sitting in a box untouched. If I can connect it using a raiser cable, then I get additional 7gb VRAM to load some models into that during execution. Don't know the process right now, but I have read it someplace that ComfyUI supports MultiGPU.
Minimal experience with ComfyUI. But as long as the layers can be separated out or you are doing multiple models in a process that they can fit in each GPU, i don't see why not.
I think the troubles we are having will be resolved in the next 5 years as they will just start making the amount of Video Ram and Ram on the motherboard much larger. No longer are we in the time where 1Gb memory RAM or Video Ram will suffice, at least if you want the 'latest and greatest'. Games used to run on one core, then they were pushing for 2 cores. Now i don't know how many cores they want. 4Gb Video Ram used to be enough, but now they want you to have far higher. (though if they lowered the resolution they were targeting, texture and model sizes i'm sure you could still get everything needed within 4Gb, but for some reason companies are pushing hyper realistic and 4K/8K. No clue).
A note, i saw supposedly ComfyUI supports GGUF models, quanitized ones. So you might push for 2bit or 4bit models to squeeze more in the same space. I do similarly for LLM's mostly for speed since 70B models are so damn big.
But shared memory space models with a really large RAM i think is the way to go for these systems in the near future. That or they offer GPU's with 64Gb of Video Ram.

































