Short Summary

You will learn how Watson OpenScale on the IBM Cloud lets business analysts, data scientists, and developers build monitors for artificial intelligence (AI) models to manage risks.

Details

Course Code: W7069G

Brand: DS&BA – Watson Analytics

Category: Analytics

Skill Level: Intermediate

Duration: 6.50H

Modality: WBT

Audience

Analysts, Developers, Data Scientists and others who need to monitor machine learning jobs

Prerequisites

• Basic knowledge of cloud platforms, for example IBM Cloud
• Basic understanding of machine learning models, and how they are used

Overview

You will learn how Watson OpenScale lets business analysts, data scientists, and developers build monitors for artificial intelligence (AI) models to manage risks. You will understand how to use Watson OpenScale to build monitors for quality, fairness, and drift, and how monitors impact business KPIs. You will also learn how monitoring for unwanted biases and viewing explanations of predictions helps provide business stakeholders confidence in the AI being launched into production. Note: This course contains the same topics as 6X240G IBM Watson OpenScale on IBM Cloud Pak for Data WBT.

Topic

Introduction to IBM Watson OpenScale
• Describe the problem that Watson OpenScale solves
• Describe models, monitors, workflow
• Describe AIF and AIE 360 toolkits
• Describe workflow

Watson OpenScale architecture
• Describe Watson OpenScale architecture on IBM Cloud and on IBM Cloud Pak for Data
• Describe how Watson OpenScale works with other cloud services

Get started with Watson OpenScale
• Provision from catalog
• Start working with Watson OpenScale

Overview of Watson OpenScale monitors
• Identify the different Watson OpenScale monitors
• Define how the different monitors are used

Explore a use case
• Prepare the model for monitoring

Build and configure the fairness monitor
• Features to monitor
• Values that represent a favorable outcome of the model
• Reference and monitored groups
• Fairness thresholds
• Sample size
• Insights and explainability

Configure the quality monitor
• Quality alert threshold
• Sample size
• Insights and explainability

Detect drift and configure the drift monitor
• Alert threshold
• Sample size
• Insights and explainability

Configure application monitors
• Configure application monitors
• Configure KPI metrics in Watson OpenScale
• Configure event details
• Access and visualize custom metrics

Objectives

• Introduction to IBM Watson OpenScale
• Watson OpenScale architecture
• Get started with Watson OpenScale
• Overview of Watson OpenScale monitors
• Explore a use case
• Build and configure the fairness monitor
• Configure the quality monitor
• Detect drift and configure the drift monitor
• Configure application monitors