In addition to Anaconda Notebook’s default runtimes, Anaconda provides access to remote GPU runtimes powered by NVIDIA’s A10 GPUs. These runtimes are ideal for complex, compute-intensive workloads that would otherwise be too time consuming to run in a default environment. You can choose to run the entire notebook on GPU or apply GPU acceleration to specific cells.

At this time, Anaconda is offering free credits to select paid subscribers only. Free tier subscribers who would like to use GPU runtimes can upgrade to gain access.

​
Assigning GPU runtimes

There are a few methods you can use to assign a GPU runtime to either an entire notebook or an individual cell:

  1. Open the Launcher.

  2. Under Notebook, click Launch a Remote Runtime.

  3. In the Launch a Runtime dialog, open the Environment dropdown and select a runtime.

  4. Use the slider or type a number in the text box to reserve time for the runtime session (in minutes).

  5. Assign a name for your runtime or use the default runtime name.

  6. Click Launch a Runtime.

​
Using GPU runtimes

Once you assign a GPU runtime to a notebook or cell, you can run your code as you normally would. You should notice a considerable increase in processing speed, especially for more complex tasks.

Anaconda’s default GPU runtime, “anaconda-01 - nvidia-a10”, is tied to a read-only, GPU-enabled environment that includes the latest Anaconda, AI, and NVIDIA packages.

​
Transferring variables in GPU runtime cells

Because cells assigned a GPU runtime run in a separate environment from the rest of the notebook, variables must be transferred between the cell and the notebook to ensure they are accessible in both runtimes.

Follow these steps to transfer variables:

  1. Click Variable transfer beside a cell with a GPU runtime assigned.

  2. Enter the inputs and/or outputs to be transferred between the notebook and cell runtimes.

  3. Click Set variables.

The inputs and/or outputs can now be used in the GPU runtime cell and notebook.

​
Managing usage

When you assign a GPU runtime to a notebook, you are asked to reserve a defined number of minutes to use toward the notebook’s GPU execution time. Reserved time is calculated in credits, with one credit equaling 100 real-world seconds.

Once the notebook launches, the reserved time starts to count down. The reserved time continues to count down both when running code and when the notebook is idle.

Track how much reserved time is left by hovering over the top-right countdown bar:

When your reserved time drops below five minutes (300 seconds), the countdown bar turns red. Once the reserved time hits zero, the GPU runtime session automatically terminates.

Anaconda recommends conserving your GPU usage by either assigning a GPU runtime to individual cells that require higher compute power rather than the entire notebook, or waiting to assign the GPU runtime until you’re ready to run your code, and then stopping the GPU runtime session as soon as the code has executed.

There are multiple ways you can stop a GPU runtime session:

  1. Select Kernels from the top menu bar.
  2. Select Shut Down All to shut down all runtimes.
  3. In the confirmation dialog, click Shut Down All.

​
Usage history

View your GPU usage stats and remaining credits on the Runtime home page. Select More on Usage to view additional details:

  • The Overview page shows your running GPU runtimes, remaining credits, and historical credit consumption.
  • The History page shows your usage history, including GPU session runtime names, types, start date, end date, credits used, and session duration.
  • The Reservations page shows any currently running GPU runtimes, the credits assigned to the reservation session, and the reservation start and end times.

​
Using credits

Anaconda offers credits to access GPU compute time. One credit equals 100 real-world seconds. Note that this is different from how high-compute seconds are calculated for CPU use.

Credits are automatically deducted as reserved time is used. For example, if you use 10 minutes of reserved time, 6.00 credits will be deducted from your account.

View your remaining credits on the Usage Overview page.

At this time, Anaconda is offering 500 free credits to select paid subscribers only. See note for details on upgrading your subscription to gain access.

​
Troubleshooting

​
I ran out of credits

To request additional GPU credits, file a support ticket.

​
The GPU runtime does not start up

Reload the Anaconda Notebooks page and then click “Launch a Remote Runtime” from the Launcher. If you’re still unable to run a GPU runtime, file a support ticket.

​
My code isn’t running

Check for missing import statements and verify that variables were correctly transferred to the GPU runtime.