domino logo
5.0
  • Tech Ecosystem
  • Get Started
  • Domino Cloud
  • Collaborate
  • Projects
  • Work with Data
  • Workspaces
  • Environments
  • Executions
  • Deploy Models and Apps
  • Model Monitoring
  • Organizations
  • Security and Credentials
  • Notifications
  • Search Your Domino Deployment
  • Domino CLI
  • Troubleshooting
  • Get Help
domino logo
About Domino
Domino Data LabKnowledge BaseData Science BlogTraining
User Guide
>
Model Monitoring
>
Remediation
>
Cohort Analysis
>
Review the Cohort Analysis

Review the Cohort Analysis

You can access the job or report for the Cohort Analysis from the Model Monitor.

  • The job gives you access to the JSON files that contain the code used to perform the analysis, as well as the cohort statistics. You can copy the code and statistics to create custom reports or to use when remediating your model.

  • The report shows a detailed cohort analysis. Use this to drill down into each cohort to understand the primary features that impact the model’s performance.

Review the Cohort Analysis
  1. From the navigation pane, click Model Monitor.

  2. Select the model for which you generated the Cohort Analysis.

  3. Click Model Quality.

  4. In the Cohort Analysis Report area, click one of the following:

    • Go to Job to see the job. Click the Results tab to see the JSON data that was used to generate the report. In the navigation pane, you can click Files to see the related files.

      cohort analy job

    • View Report to open a Files page that has the .pdf. Click <filename>.pdf to view the report. The report has the following sections:

      1. Section 1 shows a visual representation and summary statistics about the model quality for the worst-performing cohorts. You can investigate these cohorts.

      2. Section 2 shows information about the most distinctive features (quantified by a contrast score) for the top worst-performing cohorts. You can investigate a feature or a combination of features for remediation.

      3. Section 3 shows summary statistics for all cohorts listed in the order of model performance. It also lists the features for a cohort that contribute to the cohort’s distinctiveness.

        The cohort summary shows the top 50 worst performing cohorts.

        The detailed cohort analysis shows the top 50 worst performing cohorts.

        The cohort summary statistics shows a table of the model quality statistics..width=500

Domino Data LabKnowledge BaseData Science BlogTraining
Copyright © 2022 Domino Data Lab. All rights reserved.