VRAMfarm logo VRAMfarm
EN
Sign up
Run AI models · Ollama

Ollama on a rented GPU

Models up to 14B run in Ollama on a 12 GB card, 32B fits in 24 GB, and 70B needs about 50 GB. One command downloads a model, which then answers in the terminal or through the API on port 11434. The ready-made Private ChatGPT app installs Ollama together with the Open WebUI chat window.

App
PyTorch
GPU
RTX 3060, 12 GB
Price
from €0.12/h

To launch, your balance must cover one hour of the machine. You are billed by the minute for actual use.

Just need a chat? The ready-made Private ChatGPT app

Glass jars with glowing models on a shelf; one jar pours its model into a graphics card
from 6 GBof video memory
2–5 minutesuntil the server is up
By the minutebilled from your balance
SSH and Jupyterserver access

How much memory you need and which GPU to pick

Up to 8B takes about 6 GB of video memory in 4-bit; the cheapest suitable card is RTX 3060. Prices update from available catalogue machines when you open the page.

VersionFP164-bitSuitable GPUGPUPrice per hourPer hour
Up to 8B 18 GB6 GB RTX 3060 €0.12
Ollama 14B 31 GB10 GB RTX 3060 €0.12
Ollama 32B 71 GB22 GB 2× RTX 3060 €0.24
Ollama 70B 154 GB47 GB 4× RTX 4060 Ti €0.64

Estimate: FP16 ≈ 2 GB per billion parameters, 4-bit ≈ 0.6 GB, plus 10% for context. Pick: the cheapest configuration with enough memory; for large models that means several identical cards. All GPUs and prices

How to run Ollama in 3 steps

  1. Sign up and top up. Create an account and top up from €10. To launch, your balance must cover at least one hour of the chosen machine; after that you pay by the minute.
  2. Choose a GPU. Memory for each version is in the table above, and the lightest one runs from 6 GB. The button on this page selects the cheapest option with the PyTorch template.
  3. Run the model. The server is ready in 2–5 minutes. Open Jupyter in your browser or connect over SSH and run the commands below.

Finished? Stop the server in the dashboard and billing stops. Save and stop keeps /workspace for €0.03 per GB per month, and it comes back on your next server automatically.

Install and run

curl -fsSL https://ollama.com/install.sh | sh OLLAMA_HOST=0.0.0.0 ollama serve & ollama run qwen2.5:14b

What people run Ollama for

01

Try several models

ollama run downloads a model by name: compare Qwen, Llama and DeepSeek on your own questions in one evening.

02

A personal assistant

Ollama with Open WebUI gives you a chat window in the browser with your conversation history.

03

A backend for a small bot

The API on port 11434 plugs into a chat bot or a script without extra setup.

Tips before you launch

  • Ollama installs 4-bit versions by default, so read memory from the 4-bit column.
  • For load from dozens of users, vLLM is the better choice.

Just need a chat? A ready-made app with no setup

If you need the model for conversations and don’t want to write code, launch Private ChatGPT: the server comes with Ollama, a Qwen3 model and the Open WebUI chat window in your browser.

Frequently asked questions

What can I run on a 24 GB card?

Qwen 2.5 32B, DeepSeek R1 Distill 32B or Gemma 2 27B: all of them fit in 4-bit.

How do I get a chat window instead of a terminal?

Launch the ready-made Private ChatGPT app: the server comes with Ollama, a Qwen3 model and Open WebUI, which opens in your browser.

How long does a launch take?

The server is usually ready in 2–5 minutes, then SSH and Jupyter are available. Downloading the model depends on its size and is billed as normal server time.

What happens to my models and results after I stop?

When you stop, click Save and stop: the /workspace folder with your models, LoRAs and results goes to storage for €0.03 per GB per month and comes back on your next server automatically. If you stop without saving, the disk is deleted.

How is it billed?

By the minute from your balance in euros. Top up from €10; to launch, your balance must cover at least one hour of the chosen machine. Stop the server and billing stops.

A server is usually ready in 2–5 minutes

Sign up in a minute, top up from €10, pay by the minute. Stop the server and billing stops.