Frequently asked questions
Our GA release was August 31, 2017 (version 5.0.3).
Our most recent version was released February 28, 2023 (version 5.6.1).
Our most recent version was released February 28, 2023 (version 5.6.1).
Workbench supports the use of Jupyter Notebooks and JupyterLab, which are the most popular integrated data science environments for working with Python and R notebooks. You can also install and utilize both RStudio and VSCode for use in building your Workbench projects.
Yes, you can deploy multiple data science applications and languages across a Workbench cluster. Each data science application runs in a secure and isolated environment with all of the dependencies from Anaconda that it requires.A single node can run multiple applications based on the amount of compute resources (CPU and RAM) available on a given node. Workbench handles all of the resource allocation and application scheduling for you.
Partially. Some of the Workbench services and user-deployed apps will be automatically configured when installed to three or more nodes. Workbench provides several automatic mechanisms for fault tolerance and service continuity, including automatic restarts, health checks, and service migration.For more information, see Fault tolerance in Workbench.
Workbench comes with out-of-the-box support for the following:
- LDAP / AD
- SAML
- Kerberos
Yes, Workbench supports single sign-on (SSO) and two-factor authentication (2FA) using FreeOTP, Google Authenticator, or Google Authenticator compatible 2FA.You can configure one-time password policies in Workbench by navigating to the authentication center and clicking on Authentication and then OTP Policy.
System requirements
Please see operating system requirements.
Linux distributions other than those listed in the documentation can be supported on request.
Please see system requirements.
Please see browser requirements.
Yes, Workbench includes an internal Git server, which allows users to save and commit versions of their projects.
Yes, as described in Connecting to an external version control repository.
Installation
The Workbench installer is a single tarball that includes Docker, Kubernetes, system dependencies, and all of the components and images necessary to run Workbench. The system administrator runs one command on each node.
Yes, including air-gapped environments.
Yes, including Amazon AWS, Microsoft Azure, and Google Cloud Platform.
Yes, the Workbench installer includes Docker, Kubernetes, system dependencies, and all of the components and images necessary to run Workbench on-premises or on a private cloud, with or without internet connectivity. We can deliver the installer to you on a USB drive.
No. The installation of Workbench is supported only by using the single-file installer. The Workbench installer includes Docker, Kubernetes, system dependencies, and all of the components and images necessary for Workbench.
Yes, please refer to our BYOK8s environment preparation guide.
No. The installation of Workbench is supported only by using the single-file installer.
Please see network requirements.
Yes. Workbench supports connectivity from notebooks to local or remote Spark clusters by using the Sparkmagic client and a Livy REST API server. Workbench provides Sparkmagic, which includes Spark, PySpark, and SparkR notebook kernels for deployment.
An administrator can generate custom Anaconda parcels for Cloudera CDH or custom Anaconda management packs for Hortonworks HDP using Workbench. A data scientist can use these Anaconda libraries from a notebook as part of a Spark job.
You can install Workbench in the following configurations during the initial installation:
- One node (one master node)
- Two nodes (one master node, one worker node)
- Three nodes (one master node, two worker nodes)
- Four nodes (one master node, three worker nodes)
Yes, if automatic TLS/SSL certificate generation fails for any reason, you can generate the certificates manually. Follow these steps:
-
Generate self-signed temporary certificates. On the master node, run:
Replace
DESIRED_FQDNwith the fully-qualified domain of the cluster to which you are installing Workbench. Saving this file as/var/lib/gravity/planet/share/secrets.yamlon the Workbench master node makes it accessible as/ext/share/secrets.yamlwithin the Workbench environment, which can be accessed with the commandsudo gravity enter. -
Update the
certssecret: Replace the built-incertssecret with the contents ofsecrets.yaml. Enter the Workbench environment and run these commands:
GPU Support
If your data science team plans to use version 5.2 of the Workbench AI enablement platform, here are a few approaches to consider when planning your GPU cluster:
- Build a dedicated GPU-only cluster.
If GPUs will be used by specific teams only, creating a separate cluster allows you to more carefully control GPU access. - Build a heterogeneous cluster.
Not all projects require GPUs, so a cluster containing a mix of worker nodes—with and without GPUs—can serve a variety of use cases in a cost-effective way. - Add GPU nodes to an existing cluster.
If your team’s resource requirements aren’t clearly defined, you can start with a CPU-only cluster, and add GPU nodes to create a heterogeneous cluster when the need arises.
Anaconda provides a number of GPU-accelerated packages for data science. For deep learning, these include:
- Keras (
keras-gpu) - TensorFlow (
tensorflow-gpu) - Caffe (
caffe-gpu) - PyTorch (
pytorch) - MXNet (
mxnet-gpu)
- XGBoost (
py-xgboost-gpu)
- CuPy (
cupy) - Numba (
numba)
Unless a package has been specifically optimized for GPUs (by the authors) and built by Anaconda with GPU support, it will not be GPU-accelerated, even if the hardware is present.
Anaconda recommends installing Workbench in a cluster configuration. Each installation should have an odd number of master nodes, and Anaconda recommends at least one worker node. The master node runs all Workbench core services and does not need a GPU.Using EC2 instances, a minimal configuration is one master node running on a
m4.4xlarge instance and one GPU worker node running on a p3.2xlarge instance. More users will require more worker nodes—and possibly a mix of CPU and GPU worker nodes.See Hardware requirements for the baseline requirements for Workbench.A best practice for machine learning is for each user to have exclusive use of their GPU(s) while their project is running. This ensures they have sufficient GPU memory available for training, and provides more consistent performance.When a Workbench user launches a notebook session or deployment that requires GPUs, those resources are reserved for as long as the project is running. When the notebook session or deployment is stopped, the GPUs are returned to the available pool for another user to claim.The number of GPUs required in the cluster can therefore be determined by the number of concurrently running notebook sessions and deployments that are expected. Adding nodes to a Workbench cluster is straightforward, so organizations can start with a conservative number of GPUs and grow as demand increases.To get more out of your GPU resources, Workbench supports scheduling and running unattended jobs. This enables you to execute periodic retraining tasks—or other resource-intensive tasks—after regular business hours, or at times GPUs would otherwise be idle.
Although the Anaconda Distribution supports a wide range of NVIDIA GPUs, Workbench deployments for data science teams developing models should use one of the following GPUs:
- Tesla V100 (recommended)
- Tesla P100 (adequate)
Kubernetes cannot currently distinguish between different GPU models in the same cluster node, so Workbench requires all GPU-enabled nodes within a given cluster to have the same GPU model (for example, all Tesla V100). Different clusters (for example, “production” and “development”) can use different GPU models, of course.
Yes, Workbench 5.2 can be installed on cloud VMs with GPU support. Amazon Web Services (AWS), Google Cloud Platform, and Microsoft Azure all offer Tesla GPU options.
Anaconda Project
Anaconda Project supports Windows, macOS, and Linux, and tracks the latest Anaconda releases with Python 2.7, 3.5, 3.6, and 3.7.
A workspace or project in an IDE is a directory of files on your desktop. Anaconda Project encapsulates those files, but also includes additional parameters to describe how to run a project with its dependencies. Anaconda Project is portable and allows users to run, share, and deploy applications across different operating systems.
Anaconda Project is very flexible and can deploy many types of projects with conda or pip dependencies. Deployable projects include:
- Notebooks (Python and R)
- Bokeh applications and dashboards
- REST APIs in Python and R (including machine learning scoring and predictions)
- Python and R scripts
- Third-party apps, web frameworks, and visualization tools such as Tensorboard, Flask, Falcon, deck.gl, plot.ly Dash, and more.
Workbench includes data science application images for the editor and deployments. You can install additional packages in either environment using Anaconda Project. Anaconda Project includes the information required to reproduce the project environment with Anaconda, including Python, R, or any other conda package or pip dependencies.
If you’ve upgraded to Workbench 5.4 and are getting package install errors, you may need to re-write your
anaconda-project.yml file.If you were using modified template anaconda-project.yml files for Python 2.7, 3.5, or 3.6, it is best to leave the package list empty in the env_specs section. Then you should add your required packages and their versions to the global package list.Here’s an example using the Python 3.6 template anaconda-project.yml file from Workbench version 5.3.1 where the package list has been removed from the env_specs and the required packages added to the global list:Notebooks
Yes, the deployed versions of self-service notebooks are read-only, but they can be executed by collaborators or viewers. Owners of the project that contains the notebooks can edit the notebook and deploy (or re-deploy) them.
A deployed, self-service notebook is read-only but can be executed by other collaborators or viewers. If multiple users are running a notebook that writes to a file, the file will be overwritten unless the notebook is configured to write data based on a username or other environment variable.
Yes, Anaconda Project supports environment variables that can be defined when deploying a data science application. Only project collaborators can view or edit environment variables, and they cannot be accessed by viewers.
Anaconda Project is free and open-source. Workbench is a commercial product.
Sample projects are included as part of the Workbench installation, which include sample workflows and notebooks for Python and R such as financial modeling, natural language processing, machine learning models with REST APIs, interactive Bokeh applications and dashboards, image classification, and more.The sample projects include examples with visualization tools (Bokeh, deck.gl), pandas, scipy, Shiny, Tensorflow, Tensorboard, xgboost, and many other libraries. Users can save the sample projects to their Workbench account or download the sample projects to their local machine.
Yes, Workbench can be used to deploy machine learning models with REST APIs (including Python and R) that can be queried for batch scoring workflows. The REST APIs can be made available to other users and accessed with an API token.
Yes, a data scientist can create a model without much work for the API development. Workbench includes an API wrapper for Python frameworks that builds on top of existing web frameworks in Anaconda, making it easy to expose your existing data science models with minimal code. You can also deploy REST APIs using existing API frameworks for Python and R.
Help and training
Yes! You can submit support tickets to your Technical Account Manager (TAM) if you need assistance.
Yes, we offer product training for collaborative, end-to-end data science workflows with Workbench.
Please contact us for more information.