VRAMfarm logo VRAMfarm
EN
Sign up

11 November 2026 · VRAMfarm team

Best GPU for Flux, SDXL and ComfyUI: 16 GB vs RTX 3090, 4090, 5090 and 48 GB cards

Four graphics cards lined up by memory, 16, 24, 32 and 48 GB, next to a ComfyUI node graph: choosing the best GPU for Flux and SDXL

If you mainly run SDXL, a 12–16 GB card is enough. For Flux.1 dev, 16 GB works and 24 GB is comfortable. Qwen-Image and HiDream want 24 GB, and Wan 2.2 14B video wants 32 GB at the very least and 48 GB to work without fighting the memory limit. Within one memory size, the faster card is often no more expensive per image, because it finishes sooner.

Memory first: what each model needs in ComfyUI

ComfyUI is good at squeezing models into less memory. It loads the text encoder, runs it, moves it out, then loads the diffusion model. So the number that matters is mostly the largest single model in the workflow, plus room for the image itself.

Model Usual precision VRAM in ComfyUI Download at launch Our app asks for
SDXL fp16 ~10 GB ~7 GB 12 GB
Flux.1 (schnell in our app, dev similar) fp8 ~16 GB ~17 GB 16 GB
Qwen-Image fp8 ~24 GB ~32 GB 24 GB
Qwen Image Edit fp8 ~24 GB ~33 GB 24 GB
HiDream-O1 fp8 ~24 GB ~18 GB 24 GB
Wan 2.2 5B video bf16 ~22 GB at 720p ~17 GB 24 GB
Wan 2.2 14B video fp8 ~30 GB at 720p ~70 GB 48 GB

The VRAM figures are estimates for a plain workflow at 1024 × 1024 or 720p; LoRAs, ControlNet, resolution and clip length push them up. The “download” column matters for your bill. The ready-made apps fetch their models after the server starts, and that traffic is billed at the rate the machine shows before launch.

A note on FLUX.2 [dev], the 32B successor to Flux.1: its fp8 weights alone are around 32 GB, and its text encoder is a large language model in its own right. It runs on 24–32 GB cards only with heavy offloading to system RAM. Treat 48 GB as the comfortable size.

Formats matter too. A full bf16 Flux.1 dev checkpoint is about 24 GB, which only just fits on a 24 GB card. The fp8 version halves that with results that are hard to tell apart. GGUF quantisations (Q4, Q5, Q8) shrink it further and let Flux run on 8–12 GB, at the cost of slower steps and slightly softer detail.

When 16 GB is enough

A 16 GB card (RTX 4060 Ti 16 GB, RTX 4080, RTX 5070 Ti, RTX 5080, RTX A4000) covers more than people expect:

  • SDXL with LoRAs, ControlNet and an upscaler, at 1024 × 1024, in batches of 2–4.
  • Flux.1 dev in fp8 at 1024 × 1024, one image at a time, with a LoRA or two.
  • Wan 2.2 5B at 480p, or at 720p with offloading (slower).
  • Qwen-Image in GGUF Q4, if you accept some loss of detail.

16 GB starts to hurt when you stack things: Flux plus two ControlNets plus a LoRA at 1536 × 1536, Qwen-Image in fp8, any training, or any serious video. You will see out-of-memory errors or, worse, ComfyUI silently offloading to system RAM and each step taking several times longer.

If your work is SDXL or a few Flux images a day, the cheapest card that holds the model is the right choice. On a 16 GB card you pay from €0.16 an hour for the 4060 Ti or €0.31 for the 4080. Between the two, the 4080 has more than twice the memory bandwidth (717 vs 288 GB/s), and image generation feels it.

24 GB: RTX 3090 vs RTX 4090

The two cards hold the same 24 GB, so they run exactly the same models. The difference is speed.

RTX 3090 RTX 4090
Architecture Ampere (2020) Ada Lovelace (2022)
Memory 24 GB GDDR6X, 936 GB/s 24 GB GDDR6X, 1,008 GB/s
FP16 tensor compute ~71 TFLOPS ~165 TFLOPS
Native fp8 No Yes
Price per hour from €0.30 from €0.59

In diffusion models, which are mostly compute-bound, the RTX 4090 usually finishes an image about 1.6–2.5 times faster than the 3090. The top of that range applies to fp8 models when the software uses the 4090’s native fp8 maths (in ComfyUI, the --fast start option); the 3090 always converts fp8 weights to 16-bit to compute with them. Exact times depend on steps, resolution, sampler and how many nodes your workflow has, so treat the ratio as a guide, not a benchmark.

To decide, compare the price ratio with the speed ratio. Cost per image is the price per hour × seconds per image ÷ 3,600. If the RTX 4090 costs less than about twice as much per hour as the RTX 3090, it is usually also cheaper per image. If it costs more than twice as much, the 3090 usually wins on money and the 4090 wins on your time. Check both prices on the pricing page at the moment you rent, because the catalogue changes during the day.

The rule of thumb that falls out of this: for an interactive session where you tweak prompts and wait for each result, take the 4090. For a long overnight batch where nobody waits, the 3090 is often the better buy per image.

RTX 5090 and 48 GB cards

The RTX 5090 adds two things: 32 GB instead of 24, and 1,792 GB/s of memory bandwidth on top of more compute. For image models that means roughly 1.3–1.5 times the speed of a 4090, more where software uses Blackwell’s fp4 support, and room to keep Qwen-Image or HiDream fully loaded with LoRAs instead of shuffling models in and out. It is also the smallest card that runs Wan 2.2 14B in fp8 at 720p.

48 GB cards are a different bet: more memory, not more speed.

Card Memory Bandwidth Compute (FP16 tensor) Good for
RTX A6000 48 GB 768 GB/s ~155 TFLOPS Large models at 4090-class speed or below; no fp8
L40 48 GB 864 GB/s ~181 TFLOPS Same memory, native fp8
L40S 48 GB 864 GB/s ~362 TFLOPS The fastest 48 GB option; native fp8
RTX PRO 6000 96 GB 1,792 GB/s ~500 TFLOPS FLUX.2, bf16 models, long video, big batches

Take a 48 GB card when the model does not fit in 32 GB: Wan 2.2 14B at 720p with longer clips, Qwen-Image in bf16, FLUX.2 without offloading, or LoRA training with large batches. For plain Flux.1 or SDXL, a 48 GB card mostly costs more per hour for memory you don’t use. An RTX 4090 is usually faster than an RTX A6000 on the same Flux image.

Video: Wan 2.2 5B and 14B

Video is where memory decides everything, because a 5-second clip is 80–120 frames processed together.

  • Wan 2.2 5B generates 720p video on a 24 GB card. It is fast enough to try many prompts, and it is the right model for drafts. Rent an RTX 4090 or RTX 5090.
  • Wan 2.2 14B gives noticeably better motion and prompt-following. In fp8 it needs about 30 GB at 720p for a 5-second clip. A 32 GB RTX 5090 can do it; a 48 GB L40S or RTX A6000 does it with room to spare. Our ready-made Wan 2.2 14B app only offers 48 GB cards or larger, because short clips at 720p are the minimum people want from it.

A clip takes minutes, not seconds. Speed LoRAs that cut the number of steps (4–8 instead of 20–40) reduce that a lot, with some loss of detail. Plan for 10–15 minutes after the server is ready before you can start, because the 14B app downloads about 70 GB of models. More on the full pipeline is on the video generation page.

Batch size, speed and what to rent

More VRAM lets you raise the batch size, but don’t expect it to multiply your output. A big diffusion model at 1024 × 1024 already keeps the GPU busy with a batch of one, so a batch of four takes almost four times as long and often gains you only 10–30% in throughput. Batching helps more with small models like SDXL, where one image does not fill the card. Its real value is convenience: you queue four variants and look at them together.

A short decision list:

What you do Card to rent
SDXL, occasional Flux images 16 GB: RTX 4060 Ti, RTX 4080, RTX 5070 Ti
Flux.1 every day, LoRAs, ControlNet 24 GB: RTX 4090, or RTX 3090 for long batches
Qwen-Image, Qwen Image Edit, HiDream 24 GB minimum, RTX 5090 for comfort
Flux or SDXL LoRA training 24 GB: RTX 4090 or RTX 3090
Wan 2.2 5B video 24–32 GB: RTX 4090, RTX 5090
Wan 2.2 14B video, FLUX.2, bf16 models 48 GB: L40S, RTX A6000; 96 GB: RTX PRO 6000

If you are not sure your workflow fits, start one size up for the first session and watch the memory in nvidia-smi or the ComfyUI console. You pay per minute, so a test run costs little. The VRAM guide has the numbers for LLMs, speech and training, and our ComfyUI guide covers adding your own models, LoRAs and nodes.

Questions on this topic

Are the ready-made ComfyUI apps paid?

No. Flux, SDXL, Qwen-Image, Qwen Image Edit, HiDream and Wan 2.2 come preinstalled for free; you pay only for the GPU time and the traffic to download the models.

Why does Wan 2.2 5B look worse than 14B?

The 5B model is a compact all-in-one model built to run on a single 24 GB card. The 14B version uses two 14B expert models, one for the rough layout of each frame and one for detail, so it follows prompts better and moves more naturally. Use 5B to test ideas and 14B for the final clip.

Can I use two GPUs to speed up one Flux image?

Not in a standard ComfyUI setup: one workflow runs on one card. Two cards help if you run two ComfyUI instances in parallel, for example to render two batches at once.

Find the GPU your model fits on

Pick a model and see the cheapest card with enough VRAM, billed by the minute in euros.