Flavors - GPU/CPU Configurations (API Integration - In Development)
Hyperstack provides a range of GPU/CPU configurations for your virtual machines (VMs), comprising combinations of GPU, CPUs, RAM, and system disk. These virtual machine configurations are referred to as flavors. Our pre-configured flavors are designed to cater to a diverse range of workloads.
To get up-to-date information on the current GPU availability and stock levels of your preferred flavor, you can check the Hyperstack VM Deployment page or use the GPU stock reporting API.
In this article
- About Hyperstack flavors specifications
- Flavor regional availability
- Flavor features
- Virtual Network Interface Cards (vNICs)
- Hyperstack flavor configurations by GPU model
- Spot flavors
- N3 - 2024 series improvements
About Hyperstack flavors specifications
Below are the specific details of the various hardware specifications that make up Hyperstack flavors. These specifications will help you determine the best configuration for your workload needs:
- Flavor Name: Specifies the flavor generation (e.g., n1, n2, n3), GPU model (e.g., A100), and number of GPUs (e.g., 2x).
- GPU Count: Number of GPUs.
- CPU Cores: Number of CPU cores.
- CPU Sockets: Number of CPU sockets.
- RAM (GB): Amount of RAM in GB.
- Root Disk (GB): Root disk storage capacity in GB, used for storing the operating system and essential system files required for the VM to boot and operate. To learn more, click here.
- Ephemeral Disk (GB): Ephemeral storage capacity in GB, temporarily attached to a VM during its runtime for storing the active workload. To learn more, click here.
- Region: The physical location housing the data center where the flavor is available.
Flavor regional availability
Flavor availability depends on the region. The table below shows the GPU flavors available in each region.
| Flavor | CANADA-1 | NORWAY-1 | US-1 |
|---|---|---|---|
| H200-141G-SXM5 | ✅ | ❌ | ❌ |
| H100 80GB PCIe | ✅ | ❌ | ❌ |
| H100 80G PCIe w/ NVLink | ✅ | ❌ | ❌ |
| H100 80G SXM5 | ✅ | ❌ | ✅ |
| A100 80G PCIe | ✅ | ❌ | ❌ |
| A100 80G PCIe Spot | ✅ | ❌ | ❌ |
| A100 80G PCIe w/ NVLink | ✅ | ❌ | ❌ |
| L40 | ✅ | ❌ | ❌ |
| L40 Spot | ✅ | ❌ | ❌ |
| RTX A6000 | ✅ | ❌ | ❌ |
| RTX A4000 | ❌ | ✅ | ❌ |
| CPU Only | ✅ | ✅ | ❌ |
VM features like snapshots, hibernation, and booting from volume depend on the selected flavor. To learn more about supported features and restrictions, click here.
Flavor features
The capabilities, limitations, and suitability of flavors for different use cases depend on the GPU type. The table below outlines the features and limitations of each available GPU.
| Flavor | Network Optimized | Hibernation | Snapshots | Bootable from volume |
|---|---|---|---|---|
| H200-141G-SXM5 | ✅ | ✅ | ✅ | ✅ |
| H100 80GB PCIe | ✅ | ✅ | ✅ | ✅ |
| H100 80G PCIe w/ NVLink | ✅ | ✅ | ✅ | ✅ |
| H100 80G SXM5 - CANADA-1 | ✅ | ✅ | ✅ | ✅ |
| H100 80G SXM5 - US-1 | ✅ | ❌ | ❌ | ❌ |
| A100 80G PCIe | ❌ | ✅ | ✅ | ✅ |
| A100 80G PCIe Spot | ❌ | ❌ | ❌ | ❌ |
| A100 80G PCIe w/ NVLink | ✅ | ✅ | ✅ | ✅ |
| L40 | ❌ | ✅ | ✅ | ✅ |
| L40 Spot | ❌ | ❌ | ❌ | ❌ |
| RTX A6000 | ❌ | ✅ | ✅ | ✅ |
| RTX A4000 | ❌ | ❌ | ❌ | ❌ |
| CPU Only - NORWAY-1 | ❌ | ❌ | ❌ | ❌ |
| CPU Only - CANADA-1 | ❌ | ❌ | ❌ | ✅ |
| CPU Only xlarge & xxlarge - CANADA-1 | ✅ | ❌ | ❌ | ✅ |
To learn more about flavor features and restrictions, click here.
Virtual Network Interface Cards (vNICs)
All Hyperstack flavors come with virtual Network Interface Cards (vNICs) offering up to 16 Gbps inter-VM bandwidth, enabling efficient network communication within virtualized environments.
Virtual machines deployed in network-optimized environments featuring the H200-141G-SXM5, H100 PCIe, H100 PCIe with NVLink, and A100 PCIe with NVLink flavors support high-speed networking with inter-VM bandwidth up to 350 Gbps. High-speed networking utilizes Single Root I/O Virtualization (SR-IOV) technology to increase network throughput and reduce latency. To learn more about high-speed networking and how to create network-optimized VMs, click here.
Hyperstack flavor configurations by GPU model
Learn about the hardware configurations of Hyperstack flavors, categorized by GPU model, to choose the flavor with specifications that best meet the demands of your workload.
GPU Flavor Selector
Loading flavor configurations...
H200-141G-SXM5
Loading flavor configurations...
The H200-141G-SXM5 flavor supports high-speed networking with SR-IOV technology. Learn more here.
H100
The NVIDIA H100 PCIe excels in AI, data analytics, and HPC applications, offering unmatched computational speed and data throughput.
- For more information, click here.
- For pricing details, click here.
The H100 PCIe flavors support high-speed networking with SR-IOV technology. Learn more here.
H100-80GB-PCIe
Loading flavor configurations...
H100-80G-PCIe-NVLink
Loading flavor configurations...
H100-80G-SXM5
To learn about the NVIDIA H100 SXM GPU, click here.
Loading flavor configurations...
A100
The NVIDIA 80 GB A100 Tensor Core GPU delivers unprecedented acceleration for the most demanding AI, data analytics, and HPC workloads.
- For more information, click here.
- For pricing details, click here.
A100-80G-PCIe
To learn about the performance improvements offered by Hyperstack's N3 generation flavors, click here.
Loading flavor configurations...
A100-80-PCIe Spot
Loading flavor configurations...
Spot variants of flavors (e.g., n3-A100x1-spot) have the same hardware configurations as their standard versions (e.g., n3-A100x1). To learn more about spot flavors, click here.
A100-80G-PCIe w/ NVLink
Loading flavor configurations...
The A100-80G-PCIe w/ NVLink flavor supports high-speed networking with SR-IOV technology. Learn more here.
L40
The NVIDIA L40 GPU is optimized for tasks such as neural graphics, virtualization, computing, and AI capabilities.
- For more information, click here.
- For pricing details, click here.
Loading flavor configurations...
L40 Spot
Loading flavor configurations...
Spot variants of flavors (e.g., n3-L40x1-spot) have the same hardware configurations as their standard versions (e.g., n3-L40x1). To learn more about spot flavors, click here.
RTX A6000
The NVIDIA RTX A6000 GPU is ideal for professional workloads like AI, data science, rendering, and complex simulations.
- For more information, click here.
- For pricing details, click here.
Loading flavor configurations...
RTX-A4000
The NVIDIA RTX A4000 GPU is a cost-efficient choice for tasks like deep learning, real-time ray tracing, and AI-powered computing.
- For pricing details, click here.
Loading flavor configurations...
CPU-only
Flavors featuring CPU-only configurations, without GPUs, are well-suited for applications such as web hosting, network services, and database servers.
🔄 Loading CPU-only flavor configurations...
Spot flavors
Spot flavors allow you to run virtual machines using Hyperstack’s surplus GPU capacity at significantly reduced prices. These flavors are labeled with spot in the name (e.g., A100-80G-PCIe-spot) and are ideal for flexible or fault-tolerant workloads.
Unlike standard flavors, spot VMs can be deleted at any time without notice and do not support hibernation, snapshots, or booting from volume. Spot flavors are best suited for short-term tasks, batch jobs, and machine learning experiments where interruptions are acceptable.
To learn more, visit the Spot VMs documentation.
N3 - 2024 series improvements
Our latest 2024 generation N3 flavors bring substantial improvements over our prior N1 and N2 offerings, including:
- Substantially shortened deployment times for new virtual machines, particularly evident for flavors with sizeable root disks such as those tailored for Kubernetes.
- Significantly decreased the time needed for deleting N3 flavor VMs.
- Boosted CPU and memory performance by 10-15%.
- Networking speeds between virtual machines have been enhanced for select GPUs, reaching bandwidths of up to 350Gbps. To learn more about high-performance networking options offered by Hyperstack, click here.