How much does it cost to rent an RTX A4000?
On 2026-10-13, the cheapest on-demand RTX A4000 costs $0.092 per GPU-hour on Vast.ai; across 2 providers prices range from $0.092 to $0.250. An 8-GPU server costs about $0.736 per hour, and one GPU running all month about $67.16.
Which LLMs can run on a single RTX A4000?
With 4-bit weights and an 8K-token context: LFM2.5 24B-A2B, LFM2 24B-A2B, gpt-oss 20B, DeepSeek R1 Distill Qwen 14B, Qwen2.5-Coder 14B, Qwen2.5 14B, Qwen3 14B, Mistral Nemo, Mellum2.1 12B-A2.5B, Gemma 4 12B, Humanizer, Ornith 1.5 9B, Qwen3.5 9B, Clef Flash, LFM2.5 8B-A1B, DeepSeek R1 Qwen3 8B, Qwen3 8B, DeepSeek R1 Distill Llama 8B, Llama 3.1 8B, Ministral 8B, Gemma 4 E4B, DeepSeek R1 Distill Qwen 7B, Qwen2.5 7B, Qwen2.5-Coder 7B, Mistral 7B v0.3, Youtu-Parsing-Omni, Gemma 4 E2B, Qwen3.5 4B, LightOnOCR-3 4B, Spark-X2.5 4B, Qwen3 4B, Nemotron 3 Nano 4B, D1 3B, Qwen2.5 3B, Qwen2.5-Coder 3B. Larger models need several GPUs; the LLM VRAM calculator sizes them.