Send governed bundles for review

As a practitioner, you can request stakeholder reviews for your governed bundles at any stage. These reviews will often generate findings from stakeholders like the cybersecurity or compliance teams, which you’ll need to address before the bundle can pass the final stages. As an approver, you are granted project access and can review all project details. You will receive a notification when approval is required, and an approval task has been assigned.

The Governance Admin determines the approval stages for each policy. Additionally, there may be different approval stages based on the type of policy required for your governed bundles.

A simple approval flow might look something like this:

Example of a review flow

During a bundle review, approvers can document key findings. Findings are necessary for capturing and addressing issues that prevent full compliance, ensuring a path to production readiness. They include severity, ownership, descriptions, recommended actions, and deadlines for fixing compliance gaps.

Findings are linked to approval stages and may include supporting evidence, helping manage their lifecycle throughout the review process. Findings can be used to:

  • Identify Risks: Identify potential risks associated with AI models, including biases, a lack of transparency, security vulnerabilities, and non-compliance with regulations.

  • Evaluate Compliance: Assess the alignment of AI systems with governance standards, regulatory requirements, and ethical guidelines.

  • Suggest Improvements: Explore ways to improve AI systems' performance, fairness, and accountability.

After all findings (if any) are addressed, the approver marks the governed bundle stage as Stages Complete to indicate final approval.

Step 1: Submit a governed bundle for review

After you have added a file or created a new governed bundle, you can submit it for review from internal stakeholders. The easiest way to do this is immediately after creating a new governed bundle. When you request a review, the approver will be notified that a review task has been created for them.

  1. From your Project, go to Governance > Bundles.

  2. Select the bundle that you want to send for review.

  3. On Stage 1, fill in the required information to progress.

  4. Proceed to the next stage and fill in that required information until you reach a stage with the Approval required flag.

Start an evidence review

Step 2: Request review for governed bundle

A practitioner can answer all the questions relating to the governed bundle, attach all the required evidence, and then submit a request for approval. Once all stages have been satisfied, an approver will mark a bundle as completed. As a practitioner, you’ll need to request a review at any point that requires it:

  1. Fill in each required field for this stage of your review process.

  2. When complete, click Request Review.

  3. Verify that a task was created for this review request by navigating to the Domino Welcome page.

Request a review

Step 3: Review a governed bundle

Any project contributor can add findings to a governed bundle. If you are an approver, you can add findings to a bundle at any stage you haven’t approved yet. You can also leave multiple findings in a single bundle. Here are two categories to keep in mind when reviewing a bundle:

  • Approved: Approve the request if it meets all acceptance criteria.

  • Rejected: This portion of the review is denied.

Add findings to a governed bundle

Access the governed bundle directly to add or view findings:

  1. Navigate to Projects and open the project with the bundle where you want to add or view findings.

  2. Go to Govern > Bundles and select the bundle where you want to add your findings.

  3. There are a couple of tabs you can use to add findings to a bundle:

    1. From the Evidence tab, scroll down and click Add Finding.

    2. From the Findings tab, choose a finding from the list to view, or click Add Finding to add a new finding.

  4. Enter the following information in the window and then click Add Finding:

    1. Finding Name: Add a short name for the finding.

    2. Description (optional): Enter a description for the finding.

    3. Approval: Select the approval level from the menu.

    4. Severity: Choose a severity level.

    5. Due Date (optional): Select a due date to address the finding.

    6. Assignee: Select an assignee from the menu.

    7. Approver: Select an approver from the menu.

You can repeat this process as many times as needed for each governed bundle.

Address findings through tasks

If you have been assigned a task to address a finding:

  1. Navigate to Projects and open the project with the bundle where you want to answer or view findings.

  2. Go to Govern > Tasks and click to select the task from the list.

  3. From the task description, click the finding’s link to view.

  4. In the Findings tab, the Status menu will indicate the stage of the finding.

  5. Address the finding by leaving a comment to provide more information to the approver. You can use Markdown and MathJax in your comment, or @mention people.

  6. Click Send when finished.

Step 4: Transition bundle to Stages Complete

After all findings have been answered and the governed bundle has passed all stages of reviews, you’ll need to transition it to Stages Complete:

  1. Open your Evidence notebook that was awaiting approval.

  2. Click to select Transition Stage.

  3. Choose Stages Complete from the menu.

  4. Click Transition.

Transition stages to publish your bundle

Your bundle is complete. No additional files can be added or changes made to the evidence.

Next steps