Total Quality Management & ISO Standards

Chapter 6
Statistical Quality Control and Analytics

Graduate Program in Operation Management (GPOM)
Total Quality Management & ISO Standards   •   Graduate

Statistical Quality Control and Analytics

Introduction and Context

Statistical quality control (SQC) is the disciplined use of statistical reasoning to understand, monitor, and improve process performance. Total Quality Management (TQM) treats quality as an organizational responsibility, whereas SQC supplies many of the analytical methods needed to determine whether a process is stable, capable, and producing conforming output. ISO 9001 reinforces this evidence-based orientation by requiring organizations to monitor, measure, analyze, and evaluate process performance and the effectiveness of the quality management system.

A central premise is that every process exhibits variation. The managerial question is not whether variation exists, but whether it is predictable and acceptable. Common causes are sources of natural, system-level variation that remain within the process design. Special causes are unusual, identifiable sources that disturb the process. Confusing the two leads to either overreaction—tampering with a stable process—or underreaction—accepting an unstable process as normal.

SQC combines descriptive statistics, measurement-system analysis, sampling, control charts, process capability analysis, and acceptance sampling. These tools do not replace process knowledge. They support informed decisions when their assumptions, data quality, and operational consequences are understood.

Learning Objectives

By the end of this chapter, students should be able to:

  1. Describe quality data using appropriate statistical measures and graphical methods.
  2. Distinguish common-cause from special-cause variation.
  3. Evaluate measurement systems for bias, repeatability, reproducibility, stability, and discrimination.
  4. Design rational sampling approaches and explain sampling risk.
  5. Construct and interpret variable and attribute control charts.
  6. Estimate process capability and distinguish capability from stability.
  7. Explain acceptance sampling and its relationship to producer’s and consumer’s risk.
  8. Integrate statistical evidence into operational, managerial, and ISO-oriented decisions.

1. Statistical Foundations for Quality Decisions

A population is the complete set of units or outcomes of interest; a sample is a subset observed to learn about that population. A parameter, such as the population mean μ, describes a population. A statistic, such as the sample mean x̄, describes a sample.

For observations x₁, x₂, …, xₙ, the sample mean is:

x̄ = (1/n) ∑ᵢ₌₁ⁿ xᵢ

where n is the sample size. The sample variance and standard deviation are:

s² = [∑ᵢ₌₁ⁿ (xᵢ − x̄)²] / (n − 1)
s = √s²

The denominator n − 1 provides an unbiased estimator of population variance under the usual independent random-sampling assumptions. Standard deviation is expressed in the same units as the measured characteristic; variance is expressed in squared units.

For a sample proportion p̂ = x/n, where x is the number of observed successes or nonconforming units, an approximate standard error is:

SE(p̂) = √[p̂(1 − p̂)/n]

The approximation is most reliable when n p̂ and n(1 − p̂) are sufficiently large. For small samples or extreme proportions, exact or improved interval methods should be considered.

Descriptive analysis

Useful descriptive tools include:

  • Time plots, which reveal trends, shifts, cycles, and persistence.
  • Histograms, which display distribution shape, spread, skewness, and possible mixtures.
  • Box plots, which summarize median, quartiles, spread, and potential outliers.
  • Scatter diagrams, which explore association between two variables.
  • Pareto charts, which prioritize categories by frequency, cost, or risk.
  • Stratification, which separates data by machine, shift, supplier, product, operator, or environment.

The mean alone can conceal important structure. Two processes may have the same mean but differ greatly in variation or distributional shape. Before calculating a capability index or fitting a model, analysts should examine data provenance, time order, stratification, missing values, outliers, and independence.

Statistical inference

An estimate should usually be accompanied by uncertainty. A two-sided approximate confidence interval for a mean, when observations are independent and the population standard deviation is unknown, is:

x̄ ± t_(1−α/2, n−1) × s/√n

Here α is the significance level, t is the appropriate Student’s t critical value, and n − 1 is the degrees of freedom. This interval is appropriate when the data are reasonably normal or the sample is sufficiently large for the mean’s sampling distribution to be approximately normal. A confidence interval is not a statement that a fixed parameter has a probability of lying in the already calculated interval; it describes the long-run performance of the interval-generating procedure.

Hypothesis tests should be linked to an operational decision. For example, a test of whether a mean differs from a target can be written as H₀: μ = μ₀ versus H₁: μ ≠ μ₀. Statistical significance does not automatically imply practical significance. A small, operationally irrelevant difference can become statistically significant with a very large sample, while a consequential difference may be missed with inadequate data.

2. Variation and the Logic of Statistical Control

A process is statistically stable when its observed variation is consistent with a defined system of common causes. Stability does not mean that every output meets specification. A stable process can be predictably incapable. Conversely, an unstable process may occasionally produce excellent results but cannot be reliably managed by its current design.

Deming’s distinction between common and special causes is central to TQM:

Type of variationTypical sourceAppropriate response
Common causeEquipment design, standard method, material system, ambient conditionsImprove or redesign the system
Special causeTool breakage, incorrect setting, unusual material lot, data errorInvestigate and remove the assignable cause

A control chart is a time-ordered process signal. Its control limits are calculated from process data and describe expected statistical variation; specification limits are externally defined customer, engineering, or regulatory requirements. Control limits must not be confused with specification limits.

Tampering occurs when operators adjust a stable process in response to ordinary random fluctuation. Such adjustment commonly increases variation. The preferred sequence is: establish a rational subgroup, verify the measurement system, assess stability, investigate special causes, and only then evaluate capability against specifications.

3. Measurement-System Analysis

No statistical conclusion can be stronger than the measurement process supporting it. Measurement-system analysis (MSA) evaluates whether observed data adequately represent the characteristic of interest.

Important properties include:

  • Bias: systematic difference between the average observed value and a reference value.
  • Repeatability: variation when the same operator measures the same item with the same instrument repeatedly.
  • Reproducibility: variation attributable to different operators or appraisers.
  • Stability: consistency of measurement performance over time.
  • Linearity: whether bias remains reasonably constant across the measurement range.
  • Discrimination: the ability to distinguish meaningful process differences.

A gauge repeatability and reproducibility (Gage R&R) study commonly uses several parts, operators, and repeated trials. A variance-components representation is:

σ²total = σ²gage + σ²part-to-part

where σ²_gage includes repeatability and reproducibility components, subject to the design used. The percentage contribution may be expressed as:

%Contribution = 100 × σ²component / σ²total

A study based on standard deviations may report the study-variation ratio:

%Study Variation = 100 × σgage / σtotal

These percentages are not interchangeable. Many organizations use approximate screening guidance in which less than 10% is generally acceptable, 10–30% may be conditionally acceptable, and greater than 30% is usually inadequate. Such thresholds are conventions, not universal laws. Critical safety characteristics may require stricter criteria, while destructive or expensive measurements may justify a risk-based alternative.

An MSA should be designed around the measurement’s intended use. A gauge that is adequate for detecting large shifts may be inadequate for verifying a narrow tolerance. If measurement error is large, apparent process variation is inflated and capability is understated; if measurement bias exists, the process may appear centered when it is not.

4. Sampling and Data Collection

Sampling is necessary when inspection of every unit is costly, destructive, slow, or impractical. Good sampling begins with a clearly defined population, sampling frame, unit of analysis, sampling interval, and decision rule.

Probability sampling methods include simple random, systematic, stratified, cluster, and sequential sampling. In quality operations, rational subgrouping is especially important. Items within a subgroup should be produced under closely similar conditions so that short-term variation is estimated; subgroups should be collected across time to reveal shifts and trends.

A simple approximation for the required sample size when estimating a proportion with margin of error E is:

n ≈ z_(1−α/2)² p(1 − p) / E²

where p is the anticipated proportion, E is the desired absolute margin of error, and z is the standard-normal critical value. When p is unknown, p = 0.5 gives the largest required sample size for a fixed E and confidence level. Finite-population correction may be appropriate when sampling a substantial fraction of a small finite population:

nadj = nN / (N + n − 1)

where N is the population size and n is the initial sample size.

Convenience samples, such as parts collected only during an easy shift, can create serious bias. Sampling plans should also prevent autocorrelation, in which nearby observations are dependent. A control chart designed for independent observations may generate misleading signals when data are highly time-dependent.

5. Control Charts

A control chart contains a center line (CL), an upper control limit (UCL), and a lower control limit (LCL). For a statistic W:

UCL = E(W) + 3√Var(W)
CL = E(W)
LCL = E(W) − 3√Var(W)

The familiar three-sigma limits are probability-based decision boundaries, not specification limits. Their validity depends on the chart statistic, sampling design, and estimation method.

Variables charts

For subgroup means and ranges, the commonly used X̄–R chart is:

UCLX̄ = X̄̄ + A₂ R̄
CLX̄ = X̄̄
LCLX̄ = X̄̄ − A₂ R̄
UCLR = D₄ R̄
CLR = R̄
LCLR = D₃ R̄

Here X̄̄ is the average of subgroup means, R̄ is the average subgroup range, and A₂, D₃, and D₄ are constants determined by subgroup size. The range chart should generally be evaluated before interpreting the mean chart because unstable within-subgroup variation compromises the mean-chart limits.

For larger subgroups, the X̄–S chart uses subgroup standard deviations. For individual measurements, an Individuals–Moving Range (I–MR) chart is often used, but it requires careful attention to autocorrelation and the moving-range estimation method.

Attribute charts

For a fraction nonconforming p chart with constant subgroup size n:

p̄ = total nonconforming units / total inspected units
UCLp = p̄ + 3√[p̄(1 − p̄)/n]
LCLp = p̄ − 3√[p̄(1 − p̄)/n]

Limits below zero are set to zero. For varying subgroup sizes, limits must be calculated separately using each subgroup’s n. A np chart monitors the number nonconforming when n is constant. A c chart monitors defect counts when the inspection unit and opportunity for defects are constant; a u chart monitors defects per unit when the number of units or opportunities varies.

Interpreting signals

A point beyond a control limit is strong evidence of a special cause, but in-control patterns also matter. Long runs on one side of the center line, sustained trends, cycles, and unusual clustering can indicate nonrandom behavior. Rules should be selected before examining the results and should reflect the cost of false alarms. Applying many rules increases the false-signal rate, so the organization should document its scheme and response protocol.

The correct response to a signal is not automatic adjustment. First preserve evidence, verify the measurement, identify the affected time window, examine process conditions, and determine whether product containment is required. Control charts should be living management tools, not retrospective graphics produced after failures.

6. Process Capability and Performance

Capability analysis compares the natural process spread and centering with specification requirements. It should normally be performed only after the process is stable and the measurement system is adequate.

For lower and upper specification limits LSL and USL, estimated capability indices are:

Cp = (USL − LSL) / (6σ)
Cpu = (USL − μ) / (3σ)
Cpl = (μ − LSL) / (3σ)
Cpk = min(Cpu, Cpl)

Here μ is the process mean and σ is the within-process standard deviation. Cₚ measures potential capability if the process is centered; Cₚₖ incorporates centering. Therefore Cₚ can be high while Cₚₖ is low.

Performance indices use overall observed variation s rather than an estimate of within-subgroup variation:

Pp = (USL − LSL) / (6s)
Ppk = min[(USL − x̄)/(3s), (x̄ − LSL)/(3s)]

The choice between capability and performance indices depends on the analytical question and data structure. A nonnormal distribution, autocorrelation, mixture of populations, or unstable process can make normal-based indices misleading. Alternatives include transformation, distribution-specific capability analysis, percentile-based methods, or modeling the physical failure mechanism.

Worked example

A stable filling process has LSL = 495 ml, USL = 505 ml, estimated mean μ = 500.8 ml, and within-process σ = 1.2 ml. Then:

Cp = (505 − 495)/(6 × 1.2) = 10/7.2 ≈ 1.39
Cpu = (505 − 500.8)/(3 × 1.2) = 4.2/3.6 ≈ 1.17
Cpl = (500.8 − 495)/(3 × 1.2) = 5.8/3.6 ≈ 1.61

Thus Cₚₖ ≈ 1.17. The process has adequate potential spread relative to the tolerance, but its mean is closer to the upper specification. Improvement should first address centering, while continued monitoring confirms that variation remains controlled. Any organizational threshold, such as 1.33, is a policy or customer requirement rather than a universal statistical law.

7. Acceptance Sampling

Acceptance sampling is a decision procedure for accepting or rejecting a lot based on a sample. It is not a method for controlling or improving the production process. A single-sample attributes plan is described by sample size n and acceptance number c: inspect n units and accept the lot if the number of nonconforming units is no greater than c.

If the lot’s nonconforming fraction is p and sampling is approximated as independent, the probability of acceptance is:

Pa(p) = ∑i=0c C(n,i) pi (1 − p)^(n−i)

where C(n,i) is the binomial coefficient. For finite lots sampled without replacement, the hypergeometric distribution is more appropriate.

The operating characteristic (OC) curve plots Pₐ against lot quality p. The producer’s risk α is the probability of rejecting a lot at the acceptable quality level (AQL). The consumer’s risk β is the probability of accepting a lot at the limiting quality level (often called LTPD or RQL, depending on the scheme). A plan cannot simultaneously provide zero risk to both parties with a finite sample.

Sampling plans should be selected using risk, cost, lot size, process history, and criticality. For safety-critical characteristics, acceptance sampling should not substitute for process prevention, traceability, supplier development, or 100% automated verification where justified.

8. Analytics, Digital Quality, and Governance

Modern quality systems combine statistical methods with manufacturing execution systems, laboratory information systems, sensor data, and enterprise resource planning records. Automated anomaly detection can identify changes earlier, but algorithms inherit problems in data quality, sampling, labeling, and measurement bias.

Machine-learning models may forecast defects or classify images, while classical control charts remain valuable because their logic is transparent and their assumptions are inspectable. A responsible analytics program should define data ownership, version control, audit trails, access permissions, model validation, drift monitoring, and human authority for disposition decisions. AI-generated alerts should not be treated as proof of causation.

ISO-aligned governance requires documented evidence, competent personnel, controlled changes, traceability, and corrective-action effectiveness. Statistical evidence must be protected from manipulation: deleting inconvenient observations, changing subgroup definitions after seeing results, or repeatedly testing until significance appears undermines both scientific validity and quality integrity.

9. Illustrative Case: Stability Before Capability in a Medical-Device Process

Background

A medical-device manufacturer molded polymer housings with a critical wall-thickness requirement of 2.00 ± 0.10 mm. Customer complaints suggested occasional assembly interference. The organization initially reported Cₚ = 1.45 and concluded that the process was capable.

Problem

The capability study combined measurements from three machines and four shifts. A time plot showed alternating high and low means, and an MSA study showed that repeatability and reproducibility consumed approximately 24% of total study variation. The reported capability therefore mixed machine populations and included substantial measurement error.

Analysis

The quality team first improved the measurement fixture, trained appraisers, and verified calibration. It then stratified the data by machine and established rational subgroups of five consecutive parts per machine. X̄–R charts showed that Machine 2 had a special-cause shift following mold maintenance. The affected product interval was placed on hold while maintenance records and retained samples were reviewed.

After removal of the special cause and collection of new stable data, Machine 2 had μ = 2.07 mm and σ = 0.025 mm. With LSL = 1.90 mm and USL = 2.10 mm:

Cp = (2.10 − 1.90)/(6 × 0.025) = 0.20/0.15 ≈ 1.33
Cpu = (2.10 − 2.07)/(3 × 0.025) = 0.03/0.075 = 0.40
Cpl = (2.07 − 1.90)/(3 × 0.025) = 0.17/0.075 ≈ 2.27

Therefore Cₚₖ = 0.40, despite Cₚ ≈ 1.33. The process spread was potentially acceptable, but centering was unacceptable.

Solution and outcome

The team adjusted the mold-temperature set point, introduced a start-up verification, and added a maintenance-triggered first-piece study. Follow-up data showed a mean near 2.00 mm, with capability reassessed using stable, stratified data. Complaint risk declined, and the organization retained evidence linking corrective action to measured process performance.

Learning points

  1. Capability indices are not meaningful evidence of predictable performance unless stability is established.
  2. Mixed populations can conceal machine-specific failure mechanisms.
  3. Measurement-system improvement may change the apparent process diagnosis.
  4. Cₚ and Cₚₖ answer different questions.
  5. Containment and traceability are essential when a special cause may have affected released product.

Challenges and Limitations

Statistical tools can mislead when data are selectively sampled, measurements are unreliable, subgroups are irrational, distributions are nonnormal, or control limits are recalculated after every event. Large datasets do not automatically provide representative evidence. Multiple comparisons, autocorrelation, seasonality, and confounding may create apparent signals.

Managers should also avoid reducing quality to a single index. Capability does not measure customer value, reliability, safety, lead time, or total cost. A process may meet dimensional specifications while producing excessive energy use, ergonomic risk, or downstream defects. SQC is therefore one component of a broader TQM system involving prevention, standardization, learning, supplier management, and customer feedback.

Best-Practice Decision Sequence

A robust quality-analysis sequence is:

  1. Define the customer, characteristic, specification, and decision consequence.
  2. Verify the measurement system and data integrity.
  3. Select a rational sampling and subgrouping plan.
  4. Display data in time order and stratify meaningful sources.
  5. Establish statistical stability and investigate special causes.
  6. Estimate capability only with appropriate, stable data.
  7. Choose improvement actions based on the dominant source of variation.
  8. Validate effectiveness with independent follow-up data.
  9. Document assumptions, decisions, risks, and evidence for auditability.

Chapter Summary

Statistical quality control provides an evidence-based framework for understanding and improving process performance. Descriptive statistics summarize location and variation, while inferential methods quantify uncertainty. Measurement-system analysis is a prerequisite because biased or imprecise data can distort every subsequent conclusion. Sampling must be representative and organized into rational subgroups.

Control charts distinguish predictable common-cause variation from special-cause signals. Variables charts monitor measured characteristics, while attribute charts monitor counts or proportions. Process capability indices compare stable process behavior with specification limits; Cₚ measures potential spread and Cₚₖ incorporates centering. Acceptance sampling makes lot decisions and explicitly involves producer’s and consumer’s risks, but it does not improve the underlying process.

Graduate-level quality management requires more than calculating indices. It requires questioning assumptions, separating statistical from practical significance, protecting data integrity, integrating technology responsibly, and connecting analysis to containment, corrective action, prevention, and organizational learning.

Key Terms

Acceptance sampling: A procedure for accepting or rejecting a lot using sample evidence.

Assignable cause: Another term for a special cause that can be identified and acted upon.

Bias: Systematic difference between an observed average and a reference value.

Capability: The ability of a stable process to meet specification requirements.

Common cause: Natural, system-level source of process variation.

Control chart: A time-ordered graph with statistically derived control limits.

Control limit: A statistical boundary used to detect unusual process behavior.

Cₚ: Potential capability index based on specification width and process spread.

Cₚₖ: Capability index incorporating both process spread and centering.

Consumer’s risk: Probability of accepting a lot of unacceptable quality.

Discrimination: Measurement-system ability to distinguish meaningful differences.

Gage R&R: Study of measurement repeatability and reproducibility.

Measurement-system analysis: Evaluation of measurement accuracy and variation.

Producer’s risk: Probability of rejecting a lot of acceptable quality.

Rational subgroup: A group of observations collected under closely similar conditions.

Repeatability: Variation from repeated measurements by the same appraiser and instrument.

Reproducibility: Variation associated with different appraisers or conditions.

Special cause: An unusual, identifiable source of process variation.

Statistical stability: Condition in which variation is predictable under the defined process.

Specification limit: Customer, engineering, or regulatory requirement boundary.

Review Questions

Short Answer Questions

  1. Distinguish common-cause variation from special-cause variation.
  2. Why must measurement-system adequacy be assessed before capability analysis?
  3. Explain the difference between a control limit and a specification limit.
  4. What does Cₚ measure, and how does Cₚₖ extend its interpretation?
  5. Define producer’s risk and consumer’s risk in acceptance sampling.

Long Answer Questions

  1. Explain how rational subgrouping affects the interpretation of an X̄–R chart.
  2. Discuss the principal components of measurement-system analysis and their managerial implications.
  3. Compare variables control charts with attribute control charts, including appropriate applications.
  4. Explain why a statistically stable process may still be unacceptable to a customer.
  5. Critically evaluate the role of AI-based anomaly detection alongside traditional SQC methods.

Analytical / Application Questions

  1. A stable process has USL = 110, LSL = 90, μ = 106, and σ = 2. Calculate Cₚ, Cₚᵤ, Cₚₗ, and Cₚₖ. Interpret the result.
  2. A p chart monitors 100 units per subgroup, with p̄ = 0.04. Calculate the approximate three-sigma control limits and explain how a negative lower limit should be treated.
  3. A capability study combines data from two machines and shows a high Cₚ but a low Cₚₖ. Identify at least three possible explanations and propose an investigation plan.

Multiple Choice Questions with Answers

Question 1

Which statement best distinguishes control limits from specification limits?

A. Control limits are customer requirements, whereas specification limits are calculated from process data.

B. Control limits describe expected process variation, whereas specification limits define acceptable output.

C. Both are always set at plus or minus three standard deviations.

D. Specification limits are used only for attribute data.

Correct Answer: B. Control limits describe expected process variation, whereas specification limits define acceptable output.

Question 2

A process has USL = 105, LSL = 95, and σ = 1. What is Cₚ?

A. 0.60

B. 1.00

C. 1.67

D. 3.33

Correct Answer: C. 1.67

Question 3

Which measurement-system property concerns variation between different appraisers?

A. Bias

B. Repeatability

C. Reproducibility

D. Linearity

Correct Answer: C. Reproducibility

Question 4

What is the most appropriate first response to a point beyond a control limit?

A. Automatically adjust the process toward the target

B. Recalculate the specification limits

C. Investigate the measurement and possible special cause

D. Delete the point as an outlier

Correct Answer: C. Investigate the measurement and possible special cause

Question 5

For a p chart with p̄ = 0.04 and subgroup size n = 100, the approximate upper three-sigma limit is:

A. 0.040

B. 0.098

C. 0.160

D. 0.280

Correct Answer: B. 0.098

Question 6

Which condition is most important before interpreting a capability index?

A. The process has a large sample only

B. The process is statistically stable and the measurement system is adequate

C. The specification limits were calculated from the sample mean

D. Every observation is identical

Correct Answer: B. The process is statistically stable and the measurement system is adequate

Question 7

A high Cₚ but low Cₚₖ most directly indicates that the process:

A. Has excessive measurement bias only

B. Has potentially adequate spread but is poorly centered

C. Is necessarily unstable

D. Has no specification limits

Correct Answer: B. Has potentially adequate spread but is poorly centered

Question 8

Acceptance sampling primarily provides:

A. A method for improving machine capability

B. A lot acceptance decision based on sample evidence

C. A replacement for process control

D. A guarantee that no defective unit exists

Correct Answer: B. A lot acceptance decision based on sample evidence

Question 9

Which sampling practice is most likely to create biased quality conclusions?

A. Stratifying by machine and shift

B. Collecting observations across time

C. Using only conveniently available units from one shift

D. Defining the population before sampling

Correct Answer: C. Using only conveniently available units from one shift

Question 10

What is the main danger of tampering with a stable process?

A. It eliminates all common-cause variation

B. It can increase variation by reacting to random fluctuation

C. It converts specifications into control limits

D. It guarantees a higher Cₚₖ

Correct Answer: B. It can increase variation by reacting to random fluctuation

Total Quality Management & ISO Standards
Chapter 6 of 15