About Domino
Domino Data LabKnowledge BaseData Science BlogTraining

Develop and train models

With Domino, you have the freedom to develop models and analytics solutions using the tools and libraries of your choice. As a result, there are many paths to development in Domino. In this overview, you learn about a model development workflow that uses interactive workspaces.

A typical data science workflow for model training iterates through these steps:

  1. Import, visualize, and prepare data.

  2. Explore model training approaches.

  3. Review and evaluate results with collaborators.

  4. Formalize your model through deployment, automation, or training on larger datasets.

Data science workflow

Domino closely aligns with this workflow. Use interactive workspaces to prepare data and explore modeling approaches. Use experiment tracking to review results, then use automated jobs to automate the entire workflow.

Launch a Workspace

Workspaces are interactive code environments used to write and iterate on code directly in your browser. By default, Domino provides Jupyter Notebooks, JupyterLab, RStudio, and VSCode workspaces. However, you can configure workspaces to use custom IDEs too.

When you launch a workspace, the configuration wizard guides you through the setup process.

Launch New Workspace window

Select the following settings for your workspace:

Develop your model or solution

After you launch a Workspace, write the code to develop your solution. For examples, see the Jupyter notebooks in the Domino Reference Projects.

Each Project is different, and one of Domino’s greatest strengths is its flexibility to accommodate the tools that you want to use while also providing platform tools like data source connectors and Dataset management to save you time and ensure consistency.

Domino Jupyter notebook

Tip
 Commit your code to Git frequently while you work so that you can easily revert to a previous version or share specific versions of your code with collaborators. See Import Git repositories for details.

Git controls in a workspace

Schedule a training Job

While you develop your model in an interactive workspace, you can train it on a small dataset. To train it on a larger dataset, schedule a training job. Training jobs run outside of your development workspace, on a single machine or a distributed computing cluster, depending on the size of your data and the complexity of your model.

Jobs are also useful for re-training your model on a regular basis to ensure ongoing accuracy. For example, you can schedule a daily job that trains your model on the latest data from the previous 24 hours.

See Schedule jobs for the steps to schedule a one-time or recurring job.

List of Jobs with stats

Manage experiments and collaborate

Use built-in MLflow tracking to track experiment runs. Use Domino’s collaboration tools to evaluate results and approve models for production.

Run details view

Best practices for model reproducibility

Versioning is the key to reproducibility. Follow these best practices to save time and ensure consistency across similar projects and jobs:

  • Create custom environments to manage dependencies, instead of installing dependencies at the command line.

  • Before modifying a dataset, create a snapshot so that you can always point to a previous version of the data. See Create a snapshot of a dataset for instructions.

  • Commit your code to Git before running any executions (even in your workspace), so that each execution is associated with a specific commit.

  • For complex analysis or operations on big data, use jobs instead of workspaces.

Next steps

After you’ve developed a model or analytics solution, Domino can help you operationalize your work for deployment or sharing.

If you’re training a model, you may want to learn how to:

If you’re performing data analytics or data engineering, you may want to learn how to: