Capacity overview

AI Hypercomputer supports several consumption options to help you get and use compute resources. This document provides an overview of how you can obtain capacity for each consumption option.

How to obtain capacity

The following table describes how you can obtain capacity for each consumption option.

Consumption option Process for obtaining capacity Pricing implications
Future reservations in AI Hypercomputer

To get future reservation resources, the process is as follows:

  1. Reserve capacity by contacting your account team.
  2. Quota is automatically increased before capacity is delivered. No action is required from you.
  3. When you create a Compute Engine instance or cluster, specify the reservation-bound provisioning model. Compute instances and clusters are provisioned from your reserved capacity.
You're charged for the entire reservation period, whether or not you use the reserved resources for the entire period. For more information, see the Reservation billing section of the Compute Engine reservations documentation.
Future reservations for less than 90 days (in calendar mode)

To get future reservation resources, the process is as follows:

  1. Search for available capacity and reserve resources.
  2. No quota is charged and no action is required from you.
  3. When you create a compute instance or cluster, you must specify the reservation-bound provisioning model. Compute instances and clusters are provisioned from your reserved capacity.
You're charged for the entire reservation period, whether or not you use the reserved resources for the entire period. For more information, see Dynamic Workload Scheduler pricing.
Flex-start

For this consumption option, no reservation is required. To get Flex-start resources, the process is as follows:

  1. You must request preemptible quota for the GPU machine type that you want to use.
  2. When you create compute instances or clusters by using one of the following options, specify the flex-start provisioning model:

    When your requested resources become available, Compute Engine provisions your VMs. Your VMs run for up to seven days.

You're charged when the resources are in use. Resources provisioned by using Flex-start automatically get discounts through Dynamic Workload Scheduler pricing.
On-demand

For this consumption option, reserving capacity is optional. On-demand resources are only available for general GPUs (such as N1, G2, G4, A2, or A3 Edge). To get these on-demand resources, the process is as follows:

  1. Request standard GPU quota for the machine type that you want to use. For more information, see Request a quota increase.
  2. Verify availability by checking the preferred regions for your hardware in the Compute Engine GPU availability by region and zone list.
  3. Create a compute instance or cluster and specify the standard provisioning model. Resources are provisioned immediately based on available capacity.
Standard on-demand rates apply while the resources are in use.
On-demand reservations

On-demand reservations (sometimes referred to as reservations) are only available for general GPUs (such as G2, G4, A2, or A3 Edge). To reserve capacity, the process is as follows:

  1. Request standard GPU quota for your machine type. For details, see Request a quota increase.
  2. Create an on-demand reservation for your specific VM and GPU type by using the Google Cloud console, the gcloud CLI, or other methods. For details about all methods to create reservations, see Create a reservation for a single project.
  3. Provision your resources by creating an instance or cluster and targeting your specific reservation.
Standard rates apply for the entire reservation period. Apply CUDs for significant savings.
Standard future reservations

For this consumption option, you reserve capacity for a future date. Standard future reservations use the standard provisioning model and are only available for general GPUs.

  1. Request standard GPU quota for your machine type. For details, see Request a quota increase.
  2. Create a future reservation request for your specific VM and GPU type.
  3. When the reservation reaches its start time, create compute instances by using your reserved capacity.
Standard rates apply for the entire reservation period. Apply CUDs for significant savings.
Spot

For this consumption option, no reservation is required. To get Spot resources, the process is as follows:

  1. You must request preemptible quota for the GPU machine type that you want to use.
  2. View resource availability in the region or zone where you want to create compute instances.
  3. When you create a compute instance or cluster, specify the spot provisioning model. Resources are provisioned for you as capacity becomes available, but can be preempted at any time.
You're charged when the resources are in use. Spot VMs automatically get discounts through Spot VMs pricing.

What's next