domino logo
4.4
  • Tech Ecosystem
  • Get Started
  • Domino Cloud
  • Collaborate
  • Projects
  • Work with Data
  • Workspaces
  • Environments
  • Executions
  • Deploy Models and Apps
  • Organizations
  • Security and Credentials
  • Notifications
  • Search Your Domino Deployment
  • Domino CLI
  • Troubleshooting
  • Get Help
domino logo
About Domino
Domino Data LabKnowledge BaseData Science BlogTraining
User Guide
>
Workspaces
>
Clusters
>
Spark on Domino
>
On-Demand Spark
>
Configure Prerequisites

Configure Prerequisites

Before you can start using on-demand Spark clusters on Domino you must enable and configure the functionality on your deployment.

Your Domino administrator must set ShortLived.SparkClustersEnabled to true to enable on-demand Spark functionality.

Create a base Spark cluster environment

By default, Domino does not come with a Spark compatible compute environment that can be used for the components of the cluster. Without at least one such environment available, you cannot create a cluster.

When using on-demand Spark in Domino you will one environment for the Spark cluster (base or worker environment) and one environment for the workspace/job execution (compute environment).

Create a new base Spark cluster environment
  1. Follow the instructions to create an environment

  2. In the Base image section, select Custom Image and specify an image URI that points to a deployable Spark image.

Domino Data LabKnowledge BaseData Science BlogTraining
Copyright © 2022 Domino Data Lab. All rights reserved.