Data Governance, Privacy, & AI Ethics

Chapter 15
Integrated Governance Case and Future Directions

Graduate Program in Business Analytics
Data Governance, Privacy, & AI Ethics   •   Graduate

Integrated Governance Case and Future Directions

Introduction

Enterprise data, privacy, and artificial intelligence governance are often treated as separate compliance activities. That separation is increasingly untenable. A customer-data platform may support marketing analytics, credit decisions, fraud detection, and generative-AI applications simultaneously. Each use creates interconnected questions: who owns the data, what purposes are legitimate, which controls are required, how risks should be prioritized, and how the organization can demonstrate responsible conduct to regulators, customers, employees, and investors.

This chapter integrates those questions into an enterprise governance roadmap. It focuses on the practical work of moving from principles to decisions: negotiating among stakeholders, designing controls, prioritizing investment, measuring effectiveness, and preparing for regulatory and technological change. The chapter uses an illustrative case rather than presenting a single universal solution. Governance must be adapted to organizational strategy, risk appetite, legal obligations, technical architecture, and institutional culture.

Learning Objectives

By the end of this chapter, readers should be able to:

  1. Diagnose enterprise data, privacy, and AI-governance weaknesses across people, processes, technology, and oversight.
  2. Develop and defend a phased governance roadmap aligned with business strategy and risk appetite.
  3. Conduct stakeholder negotiation when commercial objectives conflict with privacy, fairness, security, or accountability requirements.
  4. Design preventive, detective, and corrective controls for data and AI systems.
  5. Prioritize governance investments using risk, value, feasibility, and regulatory urgency.
  6. Select metrics that measure control performance and organizational outcomes rather than merely activity.
  7. Use scenario planning to prepare for regulatory change, new technologies, and changing public expectations.

1. Governance as an Integrated Enterprise Capability

Data governance defines decision rights and accountabilities for data assets. Privacy governance determines how personal information may be collected, used, shared, retained, and deleted. AI governance extends these concerns to systems that infer, predict, recommend, generate, or make decisions. The three domains overlap but are not interchangeable.

A useful distinction is:

  • Data governance asks whether data is accurate, available, secure, well-defined, and managed throughout its life cycle.
  • Privacy governance asks whether information practices are lawful, fair, transparent, proportionate, and consistent with individual rights and reasonable expectations.
  • AI governance asks whether an AI system is appropriate for its purpose, valid, robust, explainable to the relevant audience, monitored, and subject to human accountability.

Integrated governance connects these domains through a common decision architecture. That architecture normally includes a governing body, accountable executives, risk classification, documented policies, technical controls, assurance activities, incident processes, and performance reporting.

Governance is not identical to management. Governance establishes direction, authority, risk appetite, and accountability; management implements decisions and operates controls. A board may approve a policy prohibiting fully automated employment termination, while management designs workflows, access rules, model thresholds, and review procedures to implement it.

1.1 The three lines of responsibility

An effective arrangement commonly follows a modified three-lines model:

LinePrimary responsibilityTypical activities
First lineBusiness and technology ownersOperate systems, identify risks, perform controls, remediate defects
Second lineRisk, privacy, compliance, and data officesSet standards, advise, challenge, monitor, aggregate reporting
Third lineInternal audit or independent assuranceEvaluate governance and control effectiveness independently

The model does not imply that the privacy office or compliance function owns every privacy risk. Accountability remains with the executive who controls the relevant business process. Nor does independence require isolation: assurance is strongest when auditors understand operational realities without becoming system operators.

1.2 Governance maturity

Maturity models should be used diagnostically, not as substitutes for judgment. A practical five-stage model is:

  1. Ad hoc: decisions depend on individual expertise; inventories and ownership are incomplete.
  2. Repeatable: basic policies, registers, and approval processes exist but vary across units.
  3. Defined: enterprise standards, classifications, control requirements, and training are established.
  4. Measured: control performance, risk trends, model outcomes, and remediation are measured consistently.
  5. Adaptive: governance uses evidence, scenario planning, automated monitoring, and continuous improvement.

A mature organization need not maximize every capability. It should be more mature where potential harm, legal exposure, or strategic dependence is greatest. A low-risk internal dashboard and an AI system influencing insurance eligibility should not receive identical governance treatment.

2. From Principles to a Governance Operating Model

Principles such as fairness, accountability, transparency, privacy by design, security, and human oversight are valuable only when translated into decisions and controls. A governance operating model answers five questions:

  1. What is governed? Data sets, processing activities, models, prompts, vendors, decisions, and outcomes must be inventoried.
  2. Who decides? Roles must be assigned for business ownership, data stewardship, privacy review, model validation, security, procurement, and escalation.
  3. When is review required? Risk-tiered gates should apply at collection, design, procurement, deployment, material change, and retirement.
  4. What evidence is retained? The organization should be able to reconstruct purpose, assumptions, approvals, testing, incidents, and decisions.
  5. How is performance challenged? Monitoring, complaints, audits, red-team exercises, and independent review should test whether controls work in practice.

2.1 Risk classification

Risk classification is the bridge between abstract principles and proportional action. A classification scheme may consider:

  • sensitivity and volume of data;
  • vulnerability of affected people;
  • impact of the decision or recommendation;
  • degree of automation;
  • reversibility of harm;
  • scale and geographic reach;
  • model uncertainty and performance variation;
  • dependence on external vendors; and
  • applicable legal or contractual obligations.

A high-risk designation should trigger stronger requirements, such as documented purpose limitation, data-protection impact assessment, independent validation, enhanced human review, bias testing, security testing, monitoring, incident escalation, and executive approval.

Risk scoring can support prioritization but should not create false precision. For a simple risk register, an organization may estimate inherent risk as:

Ri = Pi × Ii

where Pi is the estimated probability of an adverse event for risk i, and Ii is its estimated impact. Both values must use a defined scale, such as 1–5; the result is an ordinal prioritization score, not a probability of loss in monetary units. The formula assumes that probability and impact are assessed consistently and that multiplication is appropriate for the organization’s screening purpose. It should not replace scenario analysis for correlated or catastrophic risks.

After controls are applied, residual risk can be represented as:

Rresidual = Rinherent × (1 − E)

where E is estimated control effectiveness between 0 and 1. This is a simplified planning model. It assumes that control effectiveness reduces exposure proportionally and independently; real controls may be dependent, bypassed, or effective only against particular threat pathways. Therefore, residual-risk ratings require professional judgment and evidence from testing.

3. Stakeholder Negotiation and Decision Rights

Governance decisions frequently involve legitimate but competing interests. A product executive may seek rapid experimentation; a privacy officer may identify purpose-limitation concerns; an engineer may warn about data leakage; a customer advocate may question fairness; and a finance leader may resist investment without measurable returns.

Negotiation should not be reduced to “business versus compliance.” A stronger process reframes the issue as a portfolio of choices with different value, risk, speed, and control implications.

3.1 A structured negotiation process

First, define the decision. “Can we use customer data for AI?” is too broad. A useful question specifies the data, purpose, population, model, decision, deployment context, and retention period.

Second, identify non-negotiable constraints. These may include legal prohibitions, contractual restrictions, safety requirements, security baselines, or board-approved risk appetite.

Third, distinguish interests from positions. The product team’s position may be “launch this month,” while its interest is learning quickly and demonstrating market value. A controlled pilot, synthetic data, or a limited population may satisfy that interest without accepting unrestricted exposure.

Fourth, develop alternatives. Options may include changing the purpose, reducing data fields, using de-identified data, adding human review, limiting geography, imposing a sunset date, or delaying deployment until validation is complete.

Fifth, record the decision and dissent. A decision log should identify assumptions, evidence, approvals, unresolved concerns, conditions, review dates, and accountable owners.

3.2 Decision rights and escalation

A decision-rights matrix should distinguish the roles of accountable, responsible, consulted, and informed parties. For example, the business owner may be accountable for an AI use case; the data steward responsible for data quality; the privacy office consulted on lawful and fair processing; security consulted on threats; and internal audit informed of the control design. High-risk uses may require approval by an AI or data-governance committee and notification to an executive risk committee.

Escalation thresholds should be explicit. Examples include a material change in purpose, a significant model-performance decline, a serious privacy incident, unexplained outcome disparities, inability to provide required information to affected individuals, or a vendor refusing audit evidence.

4. Control Design Across the Life Cycle

Controls should be designed around risks and failure modes, not merely around organizational departments. A control is a mechanism that prevents, detects, or corrects an undesirable condition.

Control typeExampleEvidence
PreventivePurpose approval before data collection; role-based accessApproval record, access configuration
DetectiveDrift monitoring; unusual-download alerts; fairness testingMonitoring report, alert ticket
CorrectiveData deletion, model rollback, incident notificationDeletion log, rollback record
CompensatingHuman review when automated confidence is lowReview queue, reviewer decision

4.1 Data life-cycle controls

At collection, controls should establish notice, purpose, lawful basis where applicable, minimization, consent or another authorized basis, and source reliability. During use, controls should enforce classification, access, quality rules, lineage, retention, and approved secondary uses. During sharing, contracts and technical safeguards should specify permitted purposes, security requirements, sub-processors, audit rights, breach duties, and deletion or return. At disposal, deletion should cover active systems, copies, caches, and backups according to documented retention architecture.

Data quality should be tied to business consequences. Common dimensions include accuracy, completeness, timeliness, consistency, validity, and uniqueness. A data-quality dashboard that reports only percentages without identifying affected decisions is weak governance. A better report links defects to financial, operational, privacy, or customer outcomes.

4.2 AI life-cycle controls

AI governance begins before model development. Use-case registration should document purpose, affected groups, decision authority, data sources, model type, vendor dependencies, expected benefits, foreseeable harms, and prohibited uses.

During development, teams should apply data documentation, reproducibility, security testing, validation, subgroup performance analysis, robustness testing, and appropriate explainability. Explainability is contextual: a technical feature-importance report may help a model validator but not a customer requesting a comprehensible reason for a decision.

Before deployment, approval should verify that the system meets defined performance and risk thresholds, that human oversight is meaningful rather than nominal, that users understand limitations, and that fallback procedures exist. After deployment, monitoring should cover technical performance, data drift, concept drift, harmful outputs, complaints, overrides, incidents, access, and changes in the surrounding social or regulatory environment.

Generative AI requires additional controls for prompt injection, confidential-data disclosure, fabricated content, copyright or licensing issues, unsafe instructions, overreliance, and third-party model changes. Approved-use registers, retrieval-source controls, output review, logging, redaction, and restrictions on entering sensitive information are practical safeguards.

5. Investment Prioritization and the Governance Business Case

Governance investment competes with product development, cybersecurity, infrastructure, and other priorities. Leaders need a defensible basis for sequencing work.

A useful prioritization score can combine normalized dimensions:

Sj = wrRj + wlLj + whHj + wsSj − wcCj

where for initiative j, Rj is risk reduction, Lj is legal or regulatory urgency, Hj is potential harm reduction, Sj is strategic value, and Cj is implementation cost or complexity. The w terms are weights that sum to 1 within the selected scoring design. Each input must be normalized to a common scale, such as 0–100. This is a multi-criteria decision tool, not an objective truth; sensitivity analysis should test whether rankings change when weights or estimates change.

Where credible estimates exist, expected annual loss can support financial comparison:

EAL = ∑k=1n pk × Lk

where pk is the probability of scenario k within a defined period and Lk is the monetary loss if that scenario occurs. The units of EAL are monetary units per period. Scenarios should be mutually exclusive or adjusted to avoid double counting. Low-frequency catastrophic outcomes are difficult to estimate, so qualitative stress testing remains necessary.

The business case should include benefits beyond avoided fines: improved data reuse, faster approvals, reduced rework, customer trust, lower incident response costs, improved model performance, and access to regulated markets. It should also identify opportunity costs. A control that delays a high-value use case may be justified, but the delay should be visible and compared with safer alternatives.

6. Metrics, Assurance, and Organizational Learning

Metrics should answer three questions: Are controls designed appropriately? Are they operating? Are outcomes improving?

Metric categoryIllustrative measureInterpretation
CoveragePercentage of high-risk systems inventoriedScope visibility
TimelinessMedian time to complete high-risk reviewProcess efficiency
Control operationPercentage of access reviews completed on timeExecution reliability
QualityPercentage of critical data elements meeting thresholdsData fitness
AI performanceError, drift, calibration, and subgroup resultsTechnical and fairness risk
Harm and responseComplaints, incidents, time to containmentReal-world impact
CultureReported concerns and training quality indicatorsSpeaking-up capacity

Metrics require definitions, owners, data sources, thresholds, and escalation actions. A high number of reported concerns may indicate worsening conduct—or a healthier reporting culture. Metrics should therefore be interpreted in context and triangulated with audits, interviews, complaints, and outcome data.

Assurance should test both design and operating effectiveness. Design effectiveness asks whether a control, if performed, could address the risk. Operating effectiveness asks whether it was performed consistently and produced the intended result. Independent testing should sample evidence, reproduce calculations where possible, examine exceptions, and follow risks through to outcomes.

7. Illustrative Integrated Case: Meridian Health and Finance Group

Background

Meridian Health and Finance Group (MHFG) is a fictional regional organization offering employee benefits, health financing, and wellness services. It operates in several jurisdictions and has 18,000 employees. Its strategy depends on a unified analytics platform combining claims, customer-service, demographic, web, and provider data. The company also plans to deploy a generative-AI assistant for customer-service agents and a predictive model to identify accounts likely to require intervention.

Problem

An internal review found that data inventories were incomplete, business units used inconsistent definitions, vendor contracts lacked uniform AI provisions, and the proposed intervention model had been trained on historical service data containing proxy variables for geography and socioeconomic status. The model appeared accurate overall, but error rates differed materially across customer groups. The product division wanted a rapid launch, arguing that delay would reduce savings and competitive advantage. Privacy and compliance leaders warned that the purpose of collected information was not sufficiently documented and that customers might not reasonably expect some proposed uses.

Analysis

The governance committee classified the intervention model as high risk because it could influence access to support, involved sensitive information, affected potentially vulnerable people, and relied on automated recommendations. The generative-AI assistant was classified as medium-to-high risk because it could expose confidential information or generate inaccurate guidance, although agents would remain responsible for final communications.

A stakeholder map identified the chief operating officer as business sponsor; the chief information officer as platform owner; the chief privacy officer as privacy adviser and challenge function; the chief information security officer as security authority; data stewards in claims and service operations; legal counsel; employee representatives; customer advocates; model-risk specialists; and internal audit. The committee required customer-impact analysis rather than relying on aggregate accuracy alone.

The team assessed four strategic alternatives:

AlternativeBenefitPrincipal riskGovernance response
Immediate full launchFastest savingsUnresolved fairness, privacy, and reliability risksRejected
Abandon both usesLowest immediate exposureLost learning and strategic valueRejected as disproportionate
Controlled pilotEvidence with limited exposureSlower scale; residual pilot riskSelected
External vendor black boxReduced internal build effortLimited transparency and dependencyAllowed only with strict conditions

Approach and solution

MHFG approved a staged roadmap.

Phase 1: establish visibility and constraints. The organization created a system and processing register, assigned data owners, standardized definitions for critical data elements, and documented purposes and retention. Procurement introduced mandatory clauses on confidentiality, sub-processors, incident notification, model changes, audit evidence, deletion, and use of customer data for vendor training.

Phase 2: reduce exposure. The model team removed unnecessary variables, restricted access to sensitive attributes, retained protected characteristics in a controlled testing environment for fairness evaluation, and created a human-review process. The model could prioritize outreach but could not deny service, change eligibility, or make an irreversible decision. The pilot excluded the most vulnerable customer segment until additional evidence was available.

Phase 3: validate and monitor. Independent validation tested performance, calibration, subgroup error rates, robustness, and data leakage. The generative-AI assistant used approved knowledge sources, masked sensitive fields, logged prompts and outputs, and displayed limitations to agents. Agents were required to verify consequential statements. Monitoring included drift, escalation rates, customer complaints, override patterns, and harmful-output incidents.

Phase 4: govern at scale. The board risk committee received quarterly reports. A model-change threshold triggered reapproval when data sources, intended use, model family, decision authority, or performance changed materially. Internal audit reviewed the register, evidence, and operation of controls after six months.

Outcome

After six months, the pilot reduced avoidable intervention workload by 11% rather than the projected 18%, but customer complaints declined in the pilot population and subgroup error differences narrowed substantially after feature removal and threshold changes. The generative-AI assistant improved average handling time by 7%, but monitoring identified a recurring tendency to produce unsupported explanations when source documents were incomplete. The assistant was therefore restricted to draft generation and retrieval of approved information rather than autonomous responses.

The board approved gradual expansion subject to continued monitoring. The result demonstrates an important governance principle: responsible controls may change the business case, but they also produce information that improves deployment decisions. A lower initial benefit is not necessarily failure if it prevents severe harm and creates reliable evidence for scaling.

Learning points

  1. Risk classification should influence deployment design, not merely documentation.
  2. Aggregate model accuracy can conceal unequal error and unequal harm.
  3. Human oversight requires authority, time, competence, and escalation options.
  4. Vendor governance must address changing models and data practices, not only contract execution.
  5. A controlled pilot can reconcile innovation with uncertainty more effectively than either unrestricted launch or blanket prohibition.

8. Building the Enterprise Roadmap

A roadmap should be expressed as a sequence of capabilities and dependencies, not a list of disconnected projects.

First 90 days: establish control of the problem

The organization should identify high-risk systems and processing activities, appoint accountable executives, create an interim approval gate, freeze unapproved high-risk deployments, inventory vendors, document critical data flows, and establish incident escalation. The objective is visibility and containment.

Three to twelve months: standardize and evidence

The next stage should implement common classifications, data-quality rules, retention schedules, privacy and AI impact assessments, model registers, procurement requirements, training, access reviews, testing standards, and executive dashboards. The objective is repeatable operation.

Twelve to twenty-four months: integrate and automate

The organization can then connect governance workflows to development and procurement platforms, automate lineage and policy checks where reliable, expand continuous monitoring, conduct scenario exercises, and integrate governance metrics with enterprise risk management. The objective is scale and reduced manual dependency.

Beyond twenty-four months: adapt and institutionalize

Longer-term work includes advanced assurance, independent evaluation of high-impact systems, cross-border operating models, machine-readable policy controls, stronger stakeholder participation, and research partnerships. The objective is resilience as law, technology, and social expectations evolve.

Dependencies matter. Automated monitoring is unlikely to work if system inventories are incomplete. Fairness analysis is weak if critical data is poorly defined. Vendor oversight is weak if contracts lack audit rights. Roadmaps should therefore identify prerequisite capabilities and assign owners for each dependency.

9. Scenario Planning for Future Directions

Scenario planning is not prediction. It is a disciplined method for testing whether a strategy remains robust under different plausible conditions. Governance leaders should monitor external signals and define trigger points rather than waiting for certainty.

ScenarioStrategic implicationPreparatory action
More prescriptive AI regulationDocumentation and conformity evidence become essentialMaintain inventories, risk classifications, testing records, and accountability logs
Rapid adoption of autonomous agentsDecision boundaries become harder to defineLimit authority, require transaction approvals, log actions, and create rollback mechanisms
Major privacy or security incidentTrust and operational continuity become immediate prioritiesExercise response plans, segment systems, and test notification and recovery
Public backlash against automated decisionsSocial license becomes a constraint on deploymentUse participatory review, transparent explanations, and meaningful appeal processes
Open and inexpensive advanced modelsExperimentation expands faster than controlEstablish secure sandboxes, approved models, and rapid risk review

A scenario workshop should specify assumptions, affected assets and stakeholders, early-warning indicators, strategic options, no-regret actions, and decisions that should be deferred until more information is available. It should include representatives from technology, legal, privacy, security, operations, finance, communications, affected user groups, and assurance.

10. Challenges and Limitations

Integrated governance faces persistent difficulties. First, legal requirements differ across jurisdictions and may change faster than internal policies. Organizations should avoid treating a single compliance checklist as globally sufficient. Second, many harms are difficult to quantify, especially dignity, autonomy, discrimination, chilling effects, and loss of trust. Financial models should therefore supplement, not replace, ethical and rights-based analysis.

Third, control effectiveness is often overstated. A policy does not prove compliance; a completed assessment does not prove safe operation; and human review does not guarantee independence or attentiveness. Fourth, governance can become bureaucratic and slow innovation if every use case receives identical scrutiny. Risk-tiering, reusable evidence, sandboxes, and clear service levels can reduce this danger.

Fifth, technical explainability has limits. A mathematically interpretable model may still produce an unfair policy, while a complex model may be operationally acceptable when used only for low-impact recommendations with strong safeguards. The relevant question is whether affected decision makers and individuals receive information sufficient for oversight, contestability, and remedy.

Finally, governance cannot eliminate uncertainty. Its purpose is to make uncertainty visible, constrain unacceptable exposure, allocate accountability, and create mechanisms for learning and correction.

11. Best Practices for Defending a Governance Roadmap

A governance leader presenting a roadmap should:

  • connect every initiative to a documented risk, obligation, strategic objective, or measurable capability;
  • distinguish mandatory controls from risk-based enhancements;
  • show dependencies, cost ranges, delivery capacity, and opportunity costs;
  • provide alternatives and explain why the recommended option is proportionate;
  • identify residual risks explicitly rather than implying that controls create zero risk;
  • include outcome metrics and review dates;
  • demonstrate how affected individuals and operational teams were consulted;
  • define escalation and stop-deployment conditions; and
  • commit to revising the roadmap when evidence, law, technology, or stakeholder expectations change.

The strongest defense is not rhetorical confidence. It is a traceable chain from purpose to risk, risk to control, control to evidence, evidence to decision, and decision to monitored outcome.

Chapter Summary

Integrated data, privacy, and AI governance is an enterprise capability that combines decision rights, risk classification, life-cycle controls, stakeholder negotiation, assurance, measurement, and adaptation. Data governance provides trustworthy and accountable data management; privacy governance protects lawful, fair, and proportionate information practices; and AI governance addresses the additional risks of inference, automation, generation, and model change.

A defensible roadmap begins with visibility, ownership, and containment; progresses through standardized controls and evidence; and develops toward integrated monitoring, automation, and scenario-based adaptation. Risk scoring and expected-loss calculations can support prioritization, but their assumptions and limitations must be explicit. High-risk systems require stronger controls, meaningful human oversight, independent validation, monitoring, and remediation.

The Meridian case illustrates how a controlled pilot can preserve innovation while reducing exposure. Effective governance does not promise perfect prediction or zero risk. It creates accountable choices, proportionate safeguards, evidence for oversight, and the capacity to learn as regulation, technology, and social expectations evolve.

Key Terms

Data governance: The allocation of authority, accountability, and processes for managing data assets.

Privacy governance: The organizational system for managing personal-information practices, rights, duties, and privacy risk.

AI governance: Policies, roles, controls, and assurance mechanisms for responsible AI development and use.

Risk appetite: The amount and type of risk an organization is willing to accept in pursuing objectives.

Risk classification: Categorization of a data or AI use according to potential impact, vulnerability, scale, and legal significance.

Residual risk: Risk remaining after controls are applied.

Data steward: A person accountable for the operational quality, definition, and appropriate use of specified data.

Processing activity: An identifiable operation or set of operations performed on personal or other data.

Purpose limitation: The principle that data should be collected and used for specified, legitimate purposes.

Data minimization: Limiting data collection and use to what is necessary for an approved purpose.

Model validation: Independent or suitably objective assessment of whether a model is fit for its intended purpose.

Model drift: Change over time in data, relationships, or model performance that can reduce reliability.

Human oversight: The capacity of qualified people to understand, supervise, intervene in, and override an AI system.

Preventive control: A control intended to stop an undesirable event before it occurs.

Detective control: A control intended to identify an undesirable condition or event.

Corrective control: A control intended to contain, repair, or learn from an undesirable event.

Expected annual loss: The probability-weighted estimated loss from specified scenarios over a defined period.

Scenario planning: Exploration of plausible futures to test strategy and identify robust actions.

Control effectiveness: The extent to which a control reduces the risk it was designed to address.

Residual risk acceptance: A formally accountable decision to tolerate remaining risk under stated conditions.

Review Questions

Short Answer Questions

  1. Distinguish data governance, privacy governance, and AI governance.
  2. What are the primary responsibilities of the three lines of responsibility?
  3. Why should high-risk AI systems receive more than aggregate-accuracy testing?
  4. Explain the difference between preventive, detective, and corrective controls.
  5. Why is scenario planning different from prediction?

Long Answer Questions

  1. Explain how an organization can translate principles such as fairness, accountability, and privacy by design into an operating model.
  2. Discuss the role of stakeholder negotiation in resolving conflicts between rapid innovation and responsible governance.
  3. Evaluate the benefits and limitations of using risk scores and expected annual loss to prioritize governance investments.
  4. Design a life-cycle control framework for a generative-AI customer-service assistant.
  5. Propose a two-year governance roadmap for an organization with incomplete inventories, inconsistent data definitions, and weak vendor oversight.

Analytical / Application Questions

  1. A predictive model has high overall accuracy but substantially higher false-negative rates for a vulnerable subgroup. What governance decisions, additional evidence, and controls should be required before deployment?
  2. An external AI vendor refuses to disclose model details but offers strong performance claims and low cost. Analyze the negotiation options, residual risks, contractual requirements, and possible go/no-go conditions.
  3. Using the formula Ri = Pi × Ii, compare a risk with probability 4 and impact 5 with a risk having probability 5 and impact 4 on a 1–5 ordinal scale. Explain why the equal scores should not automatically lead to identical treatment.

Multiple Choice Questions with Answers

Question 1

Which statement best describes the relationship between governance and management?

A. Governance sets direction, authority, and accountability, while management implements and operates decisions.

B. Governance is limited to technical security, while management handles legal obligations.

C. Governance and management are identical terms with no meaningful distinction.

D. Governance is performed only by internal audit, while management is performed by the board.

Correct Answer: A. Governance sets direction, authority, and accountability, while management implements and operates decisions.

Question 2

A risk has an estimated probability score of 4 and an impact score of 5. Using Ri = Pi × Ii, what is its screening score?

A. 1

B. 9

C. 20

D. 25

Correct Answer: C. 20

Question 3

Which is the strongest example of a preventive control for an AI use case?

A. Reviewing complaints after deployment

B. Approving the intended purpose before data is collected

C. Rolling back a model after an incident

D. Investigating an unusual download after an alert

Correct Answer: B. Approving the intended purpose before data is collected

Question 4

Why can aggregate model accuracy be insufficient for governance approval?

A. Accuracy is never relevant to AI governance.

B. Aggregate accuracy always exaggerates model performance mathematically.

C. It may conceal unequal error rates or unequal harm across groups.

D. Accuracy can only be measured for manual decisions.

Correct Answer: C. It may conceal unequal error rates or unequal harm across groups.

Question 5

Which item is most appropriate for a high-risk AI deployment gate?

A. A marketing slogan describing the model

B. Independent validation and a documented human-oversight process

C. An assumption that the vendor is responsible for all outcomes

D. Removal of all monitoring after deployment

Correct Answer: B. Independent validation and a documented human-oversight process

Question 6

In the expected annual loss formula EAL = ∑ pk × Lk, what does Lk represent?

A. The loss if scenario k occurs

B. The number of controls for scenario k

C. The legal department’s annual budget

D. The model’s accuracy for scenario k

Correct Answer: A. The loss if scenario k occurs

Question 7

What is the principal purpose of a controlled pilot in the Meridian case?

A. To eliminate the need for governance approval

B. To obtain evidence while limiting exposure and preserving learning

C. To guarantee that the system will produce projected savings

D. To transfer accountability to customers

Correct Answer: B. To obtain evidence while limiting exposure and preserving learning

Question 8

Which metric most directly measures a control’s operating performance?

A. Percentage of scheduled access reviews completed on time

B. Number of employees in the organization

C. Age of the company’s brand

D. Total number of products advertised

Correct Answer: A. Percentage of scheduled access reviews completed on time

Question 9

What should happen when a material change occurs to a high-risk model’s purpose or decision authority?

A. The change should automatically be ignored if accuracy is unchanged.

B. The model should be reapproved or reassessed under the change threshold.

C. All documentation should be deleted and recreated without review.

D. Only the marketing team should decide whether the change matters.

Correct Answer: B. The model should be reapproved or reassessed under the change threshold.

Question 10

Which statement best characterizes scenario planning?

A. It is a guaranteed forecast of the most likely future.

B. It is a method for exploring plausible futures and identifying robust actions.

C. It is a replacement for incident response.

D. It applies only to financial market predictions.

Correct Answer: B. It is a method for exploring plausible futures and identifying robust actions.

Data Governance, Privacy, & AI Ethics
Chapter 15 of 15