Rent NVIDIA A100 PCIE GPU by the hour
The NVIDIA A100 PCIE is a datacenter GPU built on the Ampere architecture, equipped with 40 GB of VRAM and a 250 W power envelope. It delivers about 15.6 TFLOPS of standard floating-point compute and about 1313 GB/s of memory bandwidth, supporting CUDA compute capability 8.0. On ONIE, you can rent this hardware with per-hour billing, SSH access, and ready templates for PyTorch/CUDA, vLLM, Ollama, and ComfyUI.
Specifications
VRAM per GPU
Architecture
Compute capability
FP32 compute
Memory bandwidth
Power limit
Values reported by the infrastructure provider for machines currently listed; real performance varies by machine.
Available configurations
Live stock and prices, updated continuously. The final price is confirmed before you order.
Loading live prices…
What the A100 PCIE is good for
Large Language Model Inference
Serve language models using vLLM or Ollama, taking advantage of the 40 GB VRAM capacity and about 1313 GB/s memory bandwidth for token generation.
Deep Learning Fine-Tuning
Run training and fine-tuning jobs in PyTorch/CUDA on an Ampere datacenter architecture with compute capability 8.0.
High-Resolution Image Generation
Execute complex diffusion workflows in ComfyUI that require more memory than consumer cards provide.
Scientific and Data Computing
Process memory-intensive simulations and data analytics tasks utilizing about 15.6 TFLOPS of compute performance.
Is it the right GPU for you?
Choose the A100 PCIE 40 GB when your workloads exceed the memory limits of consumer GPUs and require high-bandwidth datacenter hardware. Opt for a smaller consumer GPU for lightweight inference, or step up to a higher-VRAM datacenter model if your unquantized models or batch sizes exceed 40 GB.
Compare with similar GPUs
Frequently asked questions
Is the A100 PCIE suitable for LLM inference and fine-tuning?
Yes, its 40 GB of VRAM and about 1313 GB/s of memory bandwidth make it well-suited for hosting and fine-tuning medium-to-large models that do not fit on consumer cards. You can deploy workloads quickly using pre-configured vLLM, Ollama, or PyTorch/CUDA templates.
How does the 40 GB A100 PCIE compare to other GPU tiers?
As a datacenter Ampere card, it offers substantially higher memory bandwidth and VRAM than standard workstation or consumer GPUs. If your training or inference pipeline requires even more memory capacity, you should consider a larger datacenter GPU variant.
How do I connect to and configure my instance on ONIE?
Every rental includes full SSH access for direct command-line management. You can also launch your instance with ready templates for PyTorch/CUDA, vLLM, Ollama, or ComfyUI to start working immediately.
How does billing work for the A100 PCIE?
Instances on ONIE use per-hour billing, allowing you to pay only for the duration your datacenter GPU is active.
Rent the A100 PCIE by the hour
Create an account, choose a configuration and connect over SSH. Billing stops when you delete the GPU.
Rent A100 PCIE