LLM inference
Serve models that fit in 32 GB, often quantized, with vLLM, SGLang or Ollama.
RTX 5090 servers with 32 GB of GDDR7 memory on the Blackwell architecture, for LLM inference, image generation and CUDA development. Check current configurations and prices, then create your server from the console.
ONIE rents NVIDIA RTX 5090 GPU servers with 32 GB of GDDR7 VRAM from a live inventory. Pick a template built for CUDA 12.8 or newer, such as PyTorch, vLLM or ComfyUI, choose a disk size and pay hourly or by billing cycle; then connect over SSH or the browser terminal.
Live inventory: availability and prices change with the market. The console confirms the final price before you order.
Serve models that fit in 32 GB, often quantized, with vLLM, SGLang or Ollama.
ComfyUI workflows with Flux, SDXL and video models.
LoRA-style fine-tuning of smaller models with Unsloth Studio.
Ubuntu 24.04 with CUDA 13.0 for building and testing GPU code.
Check the minimum VRAM of a template before ordering; models larger than 32 GB need quantization or a multi-GPU configuration.
32 GB of GDDR7 per GPU. In a multi-GPU configuration, each GPU has its own 32 GB.
The RTX 5090 uses the Blackwell architecture and needs CUDA 12.8 or newer. The RTX 5090 templates use CUDA 12.8 or 13.0, and only compatible servers are offered.
Hourly while it runs, or by monthly, quarterly, semi-annual or yearly cycle. Disk is charged per GB, and a stopped hourly server is only billed for its disk.
Yes, models that fit in 32 GB of VRAM, often with quantization, or larger models across several GPUs when a multi-GPU configuration is available.
Availability follows the live inventory. Check back later, or choose another GPU with enough VRAM on the GPU Cloud page.