Compliance Auditing, Assurance and AnalyticsIntroduction and ContextCompliance auditing is the systematic examination of whether an organisation’s activities, information systems, controls and records conform to applicable laws, regulations, contractual commitments, standards and internal policies. In information technology, compliance auditing extends beyond checking documents. It evaluates whether technology-enabled processes protect information, preserve reliable records, support operational resilience and produce evidence that can withstand regulatory, legal and professional scrutiny. Assurance is broader than auditing. An audit normally results in an opinion, conclusion or findings against defined criteria. Assurance provides confidence to stakeholders that a subject matter has been evaluated using suitable criteria and reliable evidence. Analytics supports both activities by transforming operational and audit data into patterns, exceptions, risk indicators and predictive signals. Modern compliance functions operate in an environment of cloud computing, outsourced services, artificial intelligence, remote work, cross-border data transfers and increasingly complex regulation. A compliance audit must therefore connect legal requirements with business processes, technical controls, human behaviour and evidence quality. The central professional question is not merely “Do policies exist?” but rather: Can the organisation demonstrate, through reliable and reproducible evidence, that required controls are suitably designed, consistently operated and effective over time? This chapter develops a practical and analytical approach to planning compliance audits, testing controls, collecting defensible evidence, analysing incidents and exceptions, developing key risk indicators (KRIs) and key compliance indicators (KCIs), and implementing dashboards and continuous monitoring. Learning ObjectivesAfter completing this chapter, a learner should be able to: - Distinguish compliance auditing, assurance, monitoring and assessment.
- Translate legal, regulatory and contractual requirements into auditable criteria and control objectives.
- Plan a risk-based IT compliance audit and define its scope, authority and materiality.
- Evaluate the design and operating effectiveness of controls.
- Select appropriate evidence and preserve its integrity, relevance and reproducibility.
- Analyse incidents, exceptions, root causes and remediation commitments.
- Design KRIs, KCIs and dashboards that support managerial decisions.
- Explain the benefits and limitations of continuous control monitoring and audit analytics.
- Address independence, privacy, fairness, confidentiality and governance concerns in compliance work.
1. The Assurance and Compliance Landscape1.1 Compliance, audit, assurance and monitoringThese terms are related but not interchangeable. | Concept | Primary purpose | Typical output |
|---|
| Compliance | Meet mandatory or self-imposed requirements | Conformity, remediation or escalation | | Audit | Independently evaluate evidence against criteria | Audit opinion, findings and recommendations | | Assurance | Increase stakeholder confidence in a subject matter | Assurance report or conclusion | | Control assessment | Determine whether a control is suitably designed and operating | Control rating and test results | | Monitoring | Observe performance continuously or periodically | Alerts, trends and management information | | Investigation | Establish facts concerning suspected misconduct or failure | Findings, root-cause analysis and action |
Compliance requirements may originate from legislation, sector regulators, privacy authorities, contracts, recognised standards, board-approved policies or risk decisions. A requirement becomes auditable when it is translated into a clear criterion. For example, a general requirement to protect personal data may be decomposed into criteria for access authorisation, retention, encryption, breach notification and supplier oversight. 1.2 Three lines of responsibilityA widely used governance model assigns responsibilities across three organisational lines. The first line owns processes and controls. Application owners, system administrators, service managers and business managers are accountable for performing controls and correcting failures. The second line provides risk management, compliance, privacy, security and policy oversight. The third line, usually internal audit, provides independent and objective assurance to the governing body. External auditors, regulators and certification bodies are not normally a fourth operational line. They provide independent external scrutiny, statutory oversight or certification against specified criteria. Clear role separation prevents self-review and helps ensure that control owners do not determine their own assurance conclusions. 1.3 Criteria, subject matter and intended usersEvery assurance engagement should identify: - Subject matter: what is being examined, such as identity management or a cloud service.
- Criteria: the requirements used for evaluation, such as a statute, contract, standard or policy.
- Practitioner: the person or team performing the work.
- Evidence: information supporting the conclusion.
- Intended users: people relying on the report, such as the board, regulator, customer or management.
- Level of assurance: reasonable assurance provides a high, but not absolute, level of confidence; limited assurance uses less extensive procedures and provides a lower level of confidence.
The criteria must be suitable: relevant, complete, reliable, neutral, understandable and capable of consistent application. Vague criteria produce vague findings and make remediation difficult to verify. 2. From Requirements to an Auditable Control Framework2.1 Requirement decompositionA statute or regulation usually states an obligation at a high level. The auditor or compliance analyst should translate it through a traceable chain: Authority → obligation → risk → control objective → control activity → evidence → test procedure → conclusion For example: - Authority: a privacy law requiring appropriate protection of personal data.
- Obligation: prevent unauthorised access.
- Risk: excessive privileges enable disclosure or alteration.
- Control objective: access is granted only to authorised users with a legitimate need.
- Control activity: approval, role assignment, periodic review and timely removal.
- Evidence: access requests, approval records, role tables, review sign-offs and termination logs.
- Test: inspect a sample, reper- form approvals, compare user status and analyse privileged access.
- Conclusion: determine whether design and operation meet the criterion.
A requirements-to-controls matrix, sometimes called a compliance matrix, maintains traceability. It should identify the requirement source, jurisdiction, applicability, control owner, frequency, evidence source, test method, responsible auditor and remediation status. 2.2 Control objectives and control typesA control objective describes the condition that should exist. A control activity is the specific action intended to achieve it. Controls may be classified in several ways: - Preventive controls: stop an undesirable event, such as segregation of duties or a firewall rule.
- Detective controls: identify an event after or while it occurs, such as log monitoring.
- Corrective controls: restore the desired condition, such as account suspension and recovery.
- Manual controls: depend substantially on human performance.
- Automated controls: operate through programmed logic.
- IT-dependent manual controls: rely on system-generated information but require human judgement.
- General IT controls: support the reliable operation of systems, including change management, access administration, backup and operations.
- Application controls: operate within an application, such as input validation, workflow approval and automated reconciliation.
A control should be assessed for its precision, frequency, timeliness, ownership, evidence generation and ability to address the relevant risk. A monthly review that merely confirms “everything looks correct” may be less precise than a review that identifies each privileged account, compares it with an approved role and records the reviewer’s decision. 2.3 Inherent risk, residual risk and control riskInherent risk is exposure before considering controls. Residual risk is exposure after controls and other responses. In audit practice, control risk is the possibility that a control will fail to prevent or detect a material non-compliance. These concepts must not be treated as exact numerical truths unless the organisation has a defined and validated risk model. A simple qualitative risk matrix may classify risk using likelihood and impact. If a quantitative model is adopted, one common approximation is: Expected Loss = P(Event) × Impact Here, P(Event) is the probability of the event during a defined period and Impact is the monetary or otherwise measured consequence. The calculation assumes that probability and impact are defined consistently and that the impact measure is meaningful. It is an approximation, not a complete representation of uncertainty, dependence between events or non-financial harm such as loss of trust. 3. Planning a Risk-Based Compliance Audit3.1 Engagement initiationAn audit charter or engagement letter should establish authority, objectives, scope, criteria, period, locations, systems, exclusions, reporting lines, confidentiality requirements, access rights and expected deliverables. The engagement team should identify stakeholders, including control owners, legal advisers, privacy officers, information security personnel, suppliers and business users. Scope should be sufficient to support the intended conclusion. An audit of “cloud compliance” is too broad unless it specifies the provider, services, data, regions, interfaces, contractual obligations and controls under examination. Scope limitations must be documented rather than hidden in the final report. 3.2 Preliminary risk assessmentPlanning ordinarily includes review of prior findings, incidents, regulatory correspondence, organisational change, system architecture, outsourcing arrangements, data classifications, control self-assessments and threat intelligence. Interviews and walkthroughs help establish how processes actually operate, rather than how policy documents suggest they operate. Audit effort should be directed toward areas with high potential impact, high likelihood, rapid change, weak evidence or significant reliance by external stakeholders. Professional judgement remains important: a low-frequency event with severe regulatory consequences may deserve more attention than a frequent but minor exception. 3.3 Audit proceduresA well-designed audit program links each objective to procedures and expected evidence. Common procedures include: - Inquiry: asking responsible personnel how a process operates.
- Observation: watching a control being performed.
- Inspection: examining records, configurations or documents.
- Reperformance: independently executing the control or recalculating its result.
- Confirmation: obtaining evidence from an independent external party.
- Analytical procedures: evaluating relationships, trends, outliers and unusual activity.
Inquiry alone is generally weak evidence because it describes an assertion rather than demonstrating performance. Reperformance and inspection of system-generated evidence often provide stronger support, but even automated evidence requires evaluation of system configuration, data completeness and change controls. 3.4 SamplingSampling is appropriate when examining every item is impractical and the population can be defined reliably. The auditor must identify the population, sampling unit, period, selection method, sample size rationale and treatment of exceptions. Random or systematic selection can reduce selection bias; judgemental selection may be useful for high-risk items but cannot automatically support a statistical projection to the whole population. For a simple attribute test, the observed exception rate is: Exception Rate = Number of Exceptions ÷ Number of Items Tested × 100% The formula assumes that the items tested and exceptions are counted consistently. A 10% observed exception rate in a small judgemental sample should not be presented as proof that exactly 10% of the entire population is non-compliant. Statistical confidence and precision require an appropriate sampling design. 4. Testing Control Design and Operating Effectiveness4.1 Design effectivenessA control is design-effective when, if performed as intended, it is capable of preventing, detecting or correcting the relevant risk. Design testing asks: - Is the risk clearly understood?
- Does the control address the cause or consequence of the risk?
- Is the control assigned to a competent and authorised owner?
- Is the frequency appropriate?
- Is the control sufficiently precise?
- Is segregation of duties preserved?
- Does the control produce reliable evidence?
- Are exceptions escalated and corrected?
A policy statement is not necessarily a control. “Access shall be reviewed regularly” lacks a defined frequency, population, reviewer, criteria, evidence and escalation route. 4.2 Operating effectivenessOperating effectiveness asks whether the control functioned consistently during the specified period. Testing should consider both the occurrence of the control and the quality of its performance. A monthly access review may have occurred twelve times, yet still be ineffective if reviewers did not investigate inappropriate access or if the report excluded privileged accounts. A control can therefore be: - well designed and operating effectively;
- well designed but not operating effectively;
- poorly designed but operating consistently; or
- both poorly designed and inconsistently operated.
The third category is especially important. Repeated performance of an inadequate control does not establish compliance. 4.3 Automated and IT-dependent controlsAutomated controls can provide consistency, but reliance requires testing the application logic, configuration, interfaces, underlying data and change management. For an automated rule that blocks payments above an approval threshold, the auditor may need to inspect the configured threshold, test boundary values, examine bypass permissions, review changes and verify that the transaction population is complete. IT-dependent manual controls require attention to the reliability of reports used by reviewers. The auditor should establish report parameters, source tables, extraction date, completeness checks and access to the report-generation logic. A signed review form is weak evidence if the underlying report was incomplete or manipulated. 4.4 Deficiency evaluationFindings should distinguish condition, criterion, cause, effect and recommendation. A useful finding structure is: - Condition: what was observed.
- Criterion: what should have occurred.
- Cause: why the deviation occurred.
- Effect or risk: actual or potential consequence.
- Recommendation: corrective action addressing the cause.
- Management response: owner, action, due date and acceptance of risk.
Severity should reflect impact, likelihood, scope, duration, regulatory significance, repeat occurrence and strength of compensating controls. A finding should not be rated solely because it is technically interesting or easy to explain. 5. Evidence: Reliability, Integrity and Defensibility5.1 Evidence characteristicsDefensible evidence is relevant to the criterion, sufficient in quantity, appropriate in quality, authentic, complete for the intended purpose and reproducible by a competent reviewer. Evidence may include policies, tickets, configurations, database extracts, logs, approvals, contracts, screenshots, interview records and third-party reports. Evidence quality is affected by its source and the way it is obtained. Independent external confirmation often has greater persuasive value than an unsupported internal assertion. System logs may be reliable for event recording but not necessarily for proving that a control owner interpreted the event correctly. 5.2 Chain of custody and preservationDigital evidence should be acquired under documented procedures. Records should identify who collected the evidence, when, from which system, using what method, under whose authority, and where it was stored. Access should be restricted, and alterations should be detectable. Hash values can help demonstrate that a file has not changed after acquisition. A cryptographic hash is not proof that the original file was truthful; it supports integrity of the preserved copy. Evidence retention must comply with legal holds, privacy obligations, records-management rules and contractual restrictions. Collecting more personal data than necessary creates a separate compliance risk. Redaction, pseudonymisation or controlled analysis environments may be appropriate. 5.3 Evidence sufficiency and triangulationImportant conclusions should normally be supported by more than one evidence type. For example, an access review conclusion may combine the approved procedure, system-generated user population, reviewer sign-off, sampled investigation of exceptions and termination records. Triangulation reduces the risk that one defective source determines the conclusion. Auditors should preserve working papers that allow an experienced reviewer to understand the work performed, evidence examined, sampling rationale, exceptions, judgement and final conclusion. Working papers are not merely administrative records; they support quality review, regulatory inspection and potential litigation. 6. Incident and Exception Analytics6.1 Incidents, exceptions and deviationsAn incident is an event that may compromise confidentiality, integrity, availability, compliance or other objectives. An exception is a departure from a defined rule, control or requirement. Not every exception is an incident, and not every incident is caused by a control failure. Classification should be consistent and should distinguish false positives, accepted risks, temporary waivers, control failures and confirmed breaches. 6.2 Analytical techniquesUseful techniques include: - frequency and trend analysis;
- ageing analysis of unresolved issues;
- Pareto analysis of causes or systems;
- duplicate and conflict detection;
- time-series analysis of access, changes or alerts;
- correlation of incidents with releases, suppliers or business units;
- clustering of similar events;
- process mining to compare actual workflows with approved workflows;
- text analysis of tickets and investigation notes.
Analytics should begin with data understanding. Analysts must verify definitions, timestamps, time zones, missing values, duplicate records, population completeness and changes in data collection. A sophisticated model applied to unreliable data may produce precise-looking but misleading results. 6.3 Root-cause analysisRoot-cause analysis should move beyond individual error. Techniques such as the “five whys,” fault trees and causal diagrams can examine policy ambiguity, inadequate training, system design, workload, incentives, supplier dependency and governance failures. The aim is not to assign blame prematurely but to identify changes that reduce recurrence. A useful remediation action is specific, owned, time-bound, testable and proportionate. “Improve security awareness” is weaker than “implement role-based training for privileged administrators, record completion, test comprehension and review non-completion monthly.” 7. Key Risk and Compliance Indicators7.1 Designing meaningful indicatorsA KRI signals changing exposure to risk. A KCI measures performance or conformity against a compliance expectation. Indicators should have a defined numerator, denominator where relevant, population, period, owner, source, threshold, frequency and action. They should be resistant to gaming and connected to a decision. Examples include: - percentage of privileged accounts reviewed by the due date;
- number of terminated users remaining active after the required period;
- percentage of critical vulnerabilities exceeding the remediation deadline;
- number of unresolved high-severity audit findings;
- percentage of suppliers with current security assessments;
- number of privacy incidents by data classification;
- percentage of emergency changes receiving retrospective approval.
A rate is often more informative than a raw count because it provides context. However, a declining rate can be misleading if the denominator has changed or reporting has weakened. For a compliance completion rate: Completion Rate = Completed Required Items ÷ Total Required Items × 100% Both quantities must refer to the same population and reporting period. Items marked complete without valid evidence should not be counted as completed merely because a workflow status says “closed.” 7.2 Thresholds and escalationThresholds should distinguish normal variation from meaningful deterioration. A traffic-light dashboard may use green, amber and red categories, but colours must be accompanied by definitions and actions. Thresholds should be reviewed when regulation, system architecture, risk appetite or business volume changes. Indicators can create perverse incentives. If managers are rewarded only for low incident counts, they may suppress reporting. Balanced measures should include reporting quality, repeat incidents, overdue remediation and independent validation. 8. Dashboards and Continuous MonitoringA compliance dashboard is a decision-support interface, not a collection of attractive charts. It should present the current state, trend, threshold, responsible owner, affected scope, data freshness and required action. Executives may need a small number of aggregated indicators, while control owners need drill-down capability to individual records. Continuous monitoring uses automated or frequent procedures to evaluate controls and identify exceptions. Continuous auditing applies audit procedures or assurance analysis on a continuing or recurring basis. Neither eliminates the need for professional judgement, periodic risk assessment or independent review. A basic monitoring architecture contains: - data sources such as identity systems, ticketing platforms, cloud logs and configuration databases;
- ingestion and validation processes;
- rules, analytics or machine-learning models;
- an exception repository and workflow;
- dashboards and alerts;
- human investigation, remediation and independent assurance.
Automated monitoring rules should be version-controlled, tested, approved and periodically recalibrated. Alert fatigue occurs when excessive low-value alerts cause analysts to ignore important signals. Precision, timeliness and actionability are more valuable than volume. Machine learning may assist anomaly detection, but it introduces model risk, bias, explainability and privacy concerns. A model-generated alert is not itself a finding. It requires validation, investigation and documented reasoning. Training data may reflect historical under-reporting or discriminatory practices, causing the model to reproduce those weaknesses. 9. Applied Case: Illustrative Cloud Identity Compliance AuditBackgroundThe following is a fictional illustrative case. Orion Health Services moved critical applications to a cloud platform. Its privacy obligations and customer contracts required least-privilege access, timely removal of access after employment termination and periodic review of privileged accounts. ProblemThe compliance team reported that 98% of quarterly access reviews were completed on time. Internal audit questioned whether this indicator demonstrated effective control operation. The organisation had experienced rapid staff turnover, multiple contractors and several emergency access grants. AnalysisThe audit team defined the population as all active and privileged identities in production accounts during the quarter. It reconciled the identity provider, human-resources termination file, cloud-native accounts and service accounts. The team found that the review report excluded two legacy cloud accounts and did not distinguish ordinary from privileged access. Several reviews were completed through a bulk approval function without evidence that exceptions had been investigated. The reported completion rate was therefore mathematically correct for the narrow workflow population but misleading for the compliance objective. The issue was not simply a failure by reviewers; the control design lacked population completeness checks and precise review criteria. Approach and solutionThe revised control required: - an automated reconciliation of all identity sources;
- separate review of privileged, ordinary, service and emergency accounts;
- documented approval or removal decision for each account;
- automatic escalation of terminated users still active after the required period;
- independent monthly review of exceptions;
- a KCI for review completion and a KRI for overdue termination removal;
- quarterly reperformance by compliance or internal audit.
The dashboard displayed population completeness, overdue removals, emergency access ageing and repeat exceptions rather than a single completion percentage. OutcomeThe revised process initially showed a lower completion rate, because previously excluded accounts were included. It also identified several stale service accounts and two contractor accounts that had not been removed promptly. Management remediated the accounts, assigned service-account owners and amended the contract-offboarding process. Subsequent reporting was more conservative but more useful for decision-making. Learning points- A good percentage can measure the wrong population.
- Data completeness is a control objective in analytics-based compliance.
- Workflow closure does not prove substantive compliance.
- Control design must reflect different identity types and risk levels.
- Indicators should trigger decisions, not merely produce favourable reports.
10. Governance, Ethics and Regulatory ConsiderationsCompliance auditing involves power over employees, suppliers and business units. Auditors must maintain independence, confidentiality, professional competence and due care. They should avoid conflicts of interest and disclose limitations that could affect the conclusion. Privacy principles such as purpose limitation, data minimisation, transparency, access control and retention limitation apply to audit data. Monitoring employee communications or behaviour may require a lawful basis, notice, proportionality assessment and restrictions on secondary use. Cross-border transfer rules may affect where logs and evidence can be stored. Legal privilege should not be assumed merely because lawyers are involved. Organisations should obtain appropriate legal advice concerning privilege, litigation holds, regulatory reporting and breach notification. Auditors should also understand that destroying, altering or selectively withholding evidence can create serious legal and professional consequences. Automated decision systems require governance over data quality, explainability, human review, discriminatory impact and accountability. An organisation should not treat a dashboard or artificial-intelligence output as a substitute for responsible management judgement. 11. Challenges and LimitationsCompliance audits have unavoidable limitations. Auditors often work with incomplete records, changing systems, sampling uncertainty, management estimates and imperfect criteria. A clean audit report does not guarantee that no violation exists; it means that, within the engagement’s scope and procedures, no reportable issue was identified or the stated conclusion was supported. Common challenges include: - fragmented evidence across systems and suppliers;
- inconsistent definitions of users, incidents and closure;
- rapid cloud configuration changes;
- insufficient audit rights in contracts;
- overreliance on self-attestation;
- alert fatigue and dashboard overload;
- inadequate retention or weak chain of custody;
- pressure to reduce reported exceptions;
- difficulty separating control failure from unavoidable residual risk;
- false confidence in automated analytics.
Effective responses include data dictionaries, control ownership, evidence standards, configuration baselines, contractual audit clauses, independent validation, model governance and periodic reassessment of scope and criteria. Best-Practice Audit and Analytics ChecklistBefore concluding an engagement, the team should confirm that: - the authority, scope, period and criteria are documented;
- requirements are traceable to risks, controls and tests;
- control design and operating effectiveness were assessed separately;
- populations and data sources were validated;
- sampling and exceptions were documented;
- evidence integrity, confidentiality and retention were addressed;
- findings identify condition, criterion, cause, effect and action;
- severity is supported by risk analysis;
- indicators have definitions, owners, thresholds and actions;
- automated rules and models are governed and tested;
- management responses are specific and verifiable;
- follow-up procedures confirm remediation rather than merely closure.
Chapter SummaryCompliance auditing evaluates technology-enabled activities against suitable legal, regulatory, contractual or organisational criteria. Assurance provides confidence to intended users, while monitoring and analytics identify performance changes and exceptions. Effective work begins by translating requirements into risks, control objectives, activities, evidence and test procedures. A risk-based audit defines authority, scope, criteria, populations and procedures. Control design asks whether a control is capable of addressing the relevant risk; operating-effectiveness testing asks whether it worked consistently during the period. Defensible evidence is relevant, sufficient, authentic, complete, protected and reproducible. Sampling, inspection, reperformance, confirmation and analytical procedures must be selected according to the conclusion required. Incident and exception analytics can reveal trends, recurrence, ageing, concentration and root causes, but only when data definitions and completeness are reliable. KRIs signal exposure, whereas KCIs measure conformity or control performance. Dashboards should support decisions through clear definitions, trends, thresholds, ownership and action. Continuous monitoring can improve timeliness but does not eliminate judgement, independent assurance or governance. Finally, compliance professionals must consider independence, privacy, confidentiality, legal holds, fairness, model risk and the limitations of audit conclusions. The strongest compliance programme is not the one that reports the highest completion rate; it is the one that produces trustworthy information and enables timely reduction of material risk. Key TermsAssurance: An engagement that increases intended users’ confidence in a subject matter evaluated against suitable criteria. Audit criterion: The requirement, rule, standard or policy used to evaluate evidence. Audit evidence: Information supporting an audit conclusion or finding. Compliance audit: A systematic evaluation of conformity with applicable requirements. Control activity: A specific action designed to prevent, detect or correct a risk. Control deficiency: A weakness in control design or operation that may permit non-compliance or risk exposure. Control objective: The desired condition that a control is intended to achieve. Continuous monitoring: Frequent or automated observation of controls, events or indicators. Exception: A departure from a defined requirement, rule or control. Inherent risk: Risk before considering controls or other responses. Key Compliance Indicator (KCI): A measure of compliance performance or conformity. Key Risk Indicator (KRI): A measure that signals changing exposure to risk. Operating effectiveness: The extent to which a control functioned as intended during a specified period. Population: The complete set of items from which audit selections are made. Reperformance: Independently carrying out a control or calculation to verify its result. Residual risk: Risk remaining after controls and responses are considered. Requirements-to-controls matrix: A structured mapping from requirements to risks, controls, evidence and tests. Sampling: Examining selected items to draw a conclusion about a defined population. Triangulation: Supporting a conclusion using multiple complementary evidence sources. Working papers: Records documenting audit planning, procedures, evidence, judgements and conclusions. Review QuestionsShort Answer Questions- Distinguish compliance auditing from continuous monitoring.
- What is the difference between control design effectiveness and operating effectiveness?
- Identify four characteristics of defensible audit evidence.
- Define a KRI and a KCI, and state one example of each.
- Why must the completeness of an analytics population be validated?
Long Answer Questions- Explain how a legal or regulatory requirement can be translated into an auditable control framework.
- Describe the stages of planning and performing a risk-based IT compliance audit.
- Discuss the strengths and limitations of automated controls and IT-dependent manual controls.
- Explain how evidence integrity, chain of custody and privacy obligations affect digital audit work.
- Evaluate the role of dashboards and continuous monitoring in an enterprise compliance programme.
Analytical / Application Questions- An organisation reports a 99% access-review completion rate, but its report excludes service accounts and terminated users. Analyse why the indicator is unreliable and design a better control and dashboard.
- A sample of 40 change tickets contains three exceptions selected through a random method. Calculate the observed exception rate and explain why it should not automatically be presented as the exact population rate. What additional information would be needed for a statistical projection?
- A machine-learning system flags unusual administrator activity, but the organisation cannot explain the model’s logic and has no documented human-review process. Assess the governance, auditability and privacy risks, and propose safeguards.
Multiple Choice Questions with AnswersQuestion 1Which sequence best represents traceable compliance control development? A. Dashboard → incident → policy → audit opinion B. Authority → obligation → risk → control objective → evidence → test C. Sample → conclusion → contract → risk appetite D. Finding → system purchase → regulation → interview Correct Answer: B. Authority → obligation → risk → control objective → evidence → test Question 2What does design effectiveness primarily assess? A. Whether a control is capable of addressing the relevant risk B. Whether every employee attended training C. Whether an auditor agrees with management’s preferred rating D. Whether a dashboard contains enough charts Correct Answer: A. Whether a control is capable of addressing the relevant risk Question 3Which procedure generally provides stronger evidence than inquiry alone? A. Repeating the control independently B. Accepting an unsigned verbal explanation C. Removing exceptions from the population D. Assuming policy wording proves operation Correct Answer: A. Repeating the control independently Question 4If 5 exceptions are found in 50 tested items, what is the observed exception rate? A. 0.1% B. 5% C. 10% D. 50% Correct Answer: C. 10% Question 5Which statement about a judgemental sample is correct? A. It always supports a precise statistical projection B. It may target high-risk items but does not automatically represent the whole population C. It eliminates sampling uncertainty D. It is invalid for every audit purpose Correct Answer: B. It may target high-risk items but does not automatically represent the whole population Question 6What is a principal purpose of a chain of custody? A. To increase the number of dashboard indicators B. To demonstrate how evidence was acquired, handled and preserved C. To replace access controls D. To guarantee that evidence is truthful Correct Answer: B. To demonstrate how evidence was acquired, handled and preserved Question 7Which measure is most clearly a KCI? A. Percentage of required access reviews completed by the due date B. Estimated probability of a major cyberattack C. Number of threat actors in global intelligence reports D. Market value of a technology supplier Correct Answer: A. Percentage of required access reviews completed by the due date Question 8Why can a high compliance completion percentage be misleading? A. Percentages can never be used in compliance B. The measured population or definition of completion may be incomplete or inappropriate C. All completed activities are necessarily fraudulent D. A dashboard cannot display percentages Correct Answer: B. The measured population or definition of completion may be incomplete or inappropriate Question 9What is a key risk of excessive automated alerts? A. Improved evidence preservation B. Alert fatigue that causes important signals to be overlooked C. Automatic legal privilege D. Guaranteed reduction in residual risk Correct Answer: B. Alert fatigue that causes important signals to be overlooked Question 10Which statement about machine-learning alerts in compliance auditing is most accurate? A. An alert is automatically an audit finding B. A model removes the need for human judgement C. Alerts require validation, investigation and governance D. Model outputs are exempt from privacy requirements Correct Answer: C. Alerts require validation, investigation and governance
|