5. Statistical Process Control and Process Stability

Introduction and Context

Quality management depends not only on inspecting finished outputs but also on understanding how processes behave while work is being performed. Statistical Process Control (SPC) provides a disciplined method for distinguishing ordinary process variation from unusual variation that requires investigation. It converts observations collected over time into evidence for operational and managerial decisions.

A process may produce outputs that meet specifications while nevertheless being unstable. Conversely, a stable process may consistently produce outputs outside customer requirements because its average or variability is poorly positioned. This distinction is central: control limits describe the voice of the process, whereas specification limits describe the voice of the customer, designer, regulator, or contract. SPC therefore complements, but does not replace, capability analysis, process knowledge, measurement-system evaluation, and managerial judgment.

The chapter develops the logic of rational subgrouping and explains the selection, construction, and interpretation of variable, attribute, rare-event, CUSUM, and EWMA charts. Particular attention is given to common-cause and special-cause variation, because inappropriate reactions to either type can increase rather than reduce process variation.

Learning Objectives

After studying this chapter, the reader should be able to:

1. Explain process stability, common-cause variation, special-cause variation, control limits, and specification limits.

2. Form rational subgroups that represent meaningful snapshots of process behaviour.

3. Select and construct appropriate variable and attribute control charts.

4. Apply c, u, p, np, g, and t charts to suitable data situations.

5. Explain the purposes and assumptions of CUSUM and EWMA charts.

6. Interpret control-chart signals without confusing statistical evidence with automatic proof of a cause.

7. Distinguish process stability from process capability and customer conformance.

8. Use SPC results in operational, managerial, and improvement decisions.

The Statistical Logic of Process Stability

Every process exhibits variation. Some variation arises from many small, persistent influences such as ordinary machine wear, routine environmental fluctuation, differences in raw material properties, and normal operator-to-operator differences. This is common-cause variation. Other variation arises from identifiable or potentially identifiable events, such as a damaged tool, incorrect material, calibration failure, software change, or unusual operating condition. This is special-cause variation.

A stable or statistically controlled process is one in which the observed pattern of variation is consistent over time with a defined statistical model. Stability does not mean that every observation is equal, nor does it mean that all observations fall within specification limits. It means that the process is predictable within the limits of the model and sampling plan.

A control chart normally contains:

• a centre line representing the estimated process location or average;
• an upper control limit (UCL) and lower control limit (LCL), representing expected boundaries of common-cause variation; and
• observations plotted in chronological order, usually as subgroup statistics.

For many Shewhart charts, limits are positioned approximately three standard errors from the centre line. The familiar three-sigma convention is a practical statistical rule, not a universal law. The limits must be based on appropriate data and should not be confused with engineering specifications. A point beyond a control limit is evidence that the process pattern has changed or that the assumed model is inappropriate. It is not, by itself, an explanation of why the change occurred.

Stability, Capability, and Conformance

Three questions should be kept separate:

1. Is the process stable? Is its variation predictable over time?

2. Is the stable process capable? Can its natural variation fit within customer or engineering requirements?

3. Is the current output conforming? Are individual units meeting specifications at a particular time?

A stable but incapable process requires fundamental improvement, such as centring the process, reducing variation, changing technology, or revising an unrealistic specification. An unstable process should generally not be assessed for capability until assignable causes have been investigated and the process has reached a defensible state of control.

Rational Subgrouping: Making Time and Context Visible

A control chart is only as informative as the sampling design behind it. Rational subgrouping means collecting observations so that units within a subgroup are produced under conditions that are as similar as possible, while differences between subgroups reflect changes over time, shifts, machines, lots, or other meaningful sources.

For example, five consecutive bottle fills taken every hour may form a rational subgroup for monitoring short-term filling variation. The subgroup estimates the process’s immediate variation, while the sequence of subgroup means reveals movement over time. If samples are instead collected by taking one bottle from five different hours and combining them, within-subgroup variation may be inflated and time-related shifts may be hidden.

Rational subgrouping is not simply a statistical convenience. It expresses a theory about how the process generates variation. The designer should ask:

• What source of variation is intended to be detected?
• What changes are likely to occur between subgroups?
• Which observations should be comparable within a subgroup?
• How frequently can the process be sampled without creating excessive cost or disruption?

Subgroups may be based on consecutive units, short time windows, production shifts, machines, suppliers, batches, patients, transactions, or service locations. If multiple streams are pooled, the chart may represent an artificial average rather than any real process. Where machines or lines behave differently, separate charts or stratified analyses are usually more informative.

Subgroup size involves a trade-off. Larger subgroups estimate short-term variation more precisely but require more observations and may conceal rapid changes. Small subgroups are economical and responsive, but their estimates of variation are less precise. When individual observations are naturally available or production is slow, an individuals-and-moving-range chart may be appropriate, although its assumptions and sensitivity differ from those of an X-bar and R chart.

Variable Control Charts

Variable data are measured on a numerical scale, such as diameter, weight, cycle time, temperature, tensile strength, or waiting time. Variable charts can monitor both process location and process dispersion.

X-bar and R Charts

For rational subgroups of size typically between 2 and 10, the X-bar and R chart is a widely used approach. For subgroup i, the mean is

x̄ᵢ = (sum of observations in subgroup i) / n

and the range is

Rᵢ = maximum observation − minimum observation.

The average of subgroup means, x-double-bar, and the average range, R-bar, are then calculated. Standard constants depend on subgroup size. The chart limits are commonly written as:

X-bar chart:

UCL = x-double-bar + A₂R-bar

CL = x-double-bar

LCL = x-double-bar − A₂R-bar

R chart:

UCL = D₄R-bar

CL = R-bar

LCL = D₃R-bar

The constants A₂, D₃, and D₄ are tabulated for each subgroup size. The R chart should normally be examined before interpreting the X-bar chart because an unstable estimate of within-subgroup variation makes the location limits unreliable.

An X-bar chart detects changes in the subgroup average, while an R chart detects changes in short-term dispersion. A process may have a stable average but increasing variation, or a stable range but a shifting average. These are operationally different conditions and may have different causes.

X-bar and s Charts

When subgroup sizes are larger, the sample standard deviation is generally more efficient than the range. The X-bar and s chart uses the subgroup standard deviation and constants such as A₃, B₃, and B₄:

UCL for X-bar = x-double-bar + A₃s-bar

LCL for X-bar = x-double-bar − A₃s-bar

UCL for s = B₄s-bar

LCL for s = B₃s-bar.

The exact constants depend on subgroup size. The same interpretive logic applies: assess dispersion first, then location, and investigate signals in chronological and process context.

Individuals and Moving-Range Charts

An individuals chart is used when data are collected one observation at a time or when rational subgroups of size one are appropriate. The moving range is often calculated between successive observations. The average moving range estimates short-term variation, and the individuals limits are derived from that estimate. This chart is useful for low-volume production, financial transactions, laboratory results, and service processes, but successive observations should be meaningfully comparable. Autocorrelation, seasonality, or changing operating conditions can make a basic individuals chart misleading.

Attribute Control Charts

Attribute data arise when units are classified or counted rather than measured on a continuous scale. Examples include defective invoices, failed inspections, missing documents, complaints, and printing errors. The distinction between a defective unit and a defect is important: one unit may contain several defects but remains one defective unit.

p and np Charts

A p chart monitors the fraction or proportion of defective units. It is appropriate when subgroup sizes may vary. If p-bar is the overall fraction defective and nᵢ is the subgroup size, the limits are:

UCLᵢ = p-bar + 3√[p-bar(1 − p-bar)/nᵢ]

LCLᵢ = p-bar − 3√[p-bar(1 − p-bar)/nᵢ].

Negative lower limits are conventionally set to zero. The np chart monitors the number of defective units when subgroup size is constant. It is easier for operators to read in some settings because it reports counts rather than proportions.

These charts assume that the classification rule is stable and that the units within a subgroup are reasonably comparable. Changing inspection standards, inconsistent auditors, or an unstable measurement system can create apparent process signals.

c and u Charts

A c chart monitors the count of defects when the area of opportunity or inspection unit is constant. Examples include the number of scratches on a fixed-size panel or documentation errors in a standard-length record. Its conventional limits are:

UCL = c-bar + 3√c-bar

LCL = c-bar − 3√c-bar.

A u chart monitors defects per unit when the number or size of units inspected varies. If cᵢ defects are found in nᵢ units, then uᵢ = cᵢ/nᵢ. The limits are:

UCLᵢ = u-bar + 3√(u-bar/nᵢ)

LCLᵢ = u-bar − 3√(u-bar/nᵢ).

Using a c chart when inspection opportunities vary can produce false signals. A u chart or an appropriately standardized measure is then required.

Rare-Event and Opportunity-Based Charts

In many processes, the event of interest is uncommon: a serious safety incident, a warranty claim, a cybersecurity breach, a medication error, or a failure after a large number of successful transactions. Conventional charts may be poorly suited because many consecutive subgroups contain zero events and the usual normal approximation is weak.

A g chart monitors the number of opportunities or units between successive events. For example, the number of injury-free days or successful transactions between failures can be plotted. A t chart monitors the time between events, such as hours between breakdowns or days between complaints. These charts are especially useful when the event itself is rare and the operational objective is to increase the interval between occurrences.

Rare-event charts require careful definition of the event and opportunity. A change in reporting behaviour, exposure volume, detection technology, or case definition can change the chart even when the underlying risk has not changed. Zero-event observations should not automatically be interpreted as proof of excellent performance; they may reflect limited exposure or under-reporting.

Detecting Small Shifts: CUSUM and EWMA

Shewhart charts are effective for relatively large, sudden shifts, but they may be slow to detect a small persistent change. CUSUM and EWMA charts use information from successive observations to improve sensitivity to gradual or modest shifts.

CUSUM Charts

A cumulative sum chart accumulates deviations from a target. For a centred standardized observation zᵢ, a one-sided upper CUSUM may be expressed as:

Cᵢ⁺ = max[0, Cᵢ₋₁⁺ + zᵢ − k]

and a lower CUSUM as:

Cᵢ⁻ = min[0, Cᵢ₋₁⁻ + zᵢ + k].

An alarm is generated when the statistic crosses a decision interval h. The reference value k represents the shift size for which sensitivity is desired; h controls the evidence required before signalling. CUSUM design is therefore linked to the economic and operational importance of a shift. It is valuable for detecting gradual tool wear, drift in chemical concentration, or a slowly rising service time.

EWMA Charts

The exponentially weighted moving average is defined as:

Zᵢ = λXᵢ + (1 − λ)Zᵢ₋₁,

where 0 < λ ≤ 1 and Z₀ is commonly the target or baseline mean. A small λ gives greater weight to historical data and smooths short-term noise; a larger λ responds more rapidly to recent observations. Approximate steady-state limits are:

Target ± Lσ√[λ/(2 − λ)].

EWMA charts are useful for subtle shifts and noisy processes. Their interpretation depends strongly on the selected λ, the initial value, and the assumed variance. CUSUM and EWMA should not be introduced merely because they are sophisticated; they are justified when the shift pattern and decision costs call for greater sensitivity than a Shewhart chart provides.

Interpreting Signals Without Overreacting

A point outside a control limit is the clearest traditional signal, but nonrandom patterns within the limits may also indicate special causes. Common supplementary rules include a long run on one side of the centre line, a sustained trend, or an unusual concentration of points near a control limit. The exact rule set should be specified before routine monitoring because adding many rules after looking at the data increases false alarms.

A signal should initiate a structured investigation rather than an automatic adjustment. The response typically includes:

1. Confirming the data, calculation, time stamp, and measurement system.

2. Identifying the affected product, machine, shift, material lot, or transaction group.

3. Checking recent changes in people, methods, equipment, software, environment, and supply.

4. Containing potentially nonconforming output when risk justifies it.

5. Removing or correcting the special cause where evidence supports that action.

6. Recording the finding and evaluating whether the control limits or process design should change.

A common mistake is tampering: adjusting a process after every ordinary fluctuation. If a stable process is repeatedly adjusted toward its target based on individual observations, the intervention itself may increase variation. The opposite mistake is failing to investigate a signal because all units remain within specifications. Control-chart evidence concerns process behaviour, not merely immediate conformance.

Practical Selection Framework

Chart selection should begin with the response variable and the decision objective.

• Use X-bar and R or X-bar and s when continuous measurements are collected in rational subgroups.
• Use an individuals chart when observations are naturally isolated or subgrouping is not feasible.
• Use p when the proportion defective is monitored and subgroup sizes vary.
• Use np when the number defective is monitored with constant subgroup size.
• Use c for defect counts with constant opportunity or inspection area.
• Use u when defect opportunities or inspected units vary.
• Use g or t when the event is rare and the meaningful measure is units or time between events.
• Use CUSUM or EWMA when small or gradual shifts are important and a suitable baseline is available.

Before calculating limits, define the process, sampling frequency, operational definitions, data quality requirements, baseline period, and response plan. Limits estimated from a mixture of stable and unstable conditions may be too wide, masking future signals. However, limits should not be repeatedly recalculated simply to make inconvenient points disappear. Any revision should be justified, documented, and connected to a genuine process change.

Application in Organizations and Digital Operations

SPC supports manufacturing, healthcare, logistics, finance, laboratories, utilities, software operations, and public services. In healthcare, charts may monitor turnaround time, infection events, medication discrepancies, or readmission-related measures. In a contact centre, an individuals chart may track waiting time, while a u chart may monitor errors per hundred cases. In a data centre, EWMA may detect gradual increases in latency before service-level failures occur.

Digital manufacturing systems can collect sensor data continuously, calculate subgroup statistics, and present alerts through dashboards. Automated systems can also connect an alarm to a machine state, material lot, or maintenance record. Such automation improves speed but does not eliminate the need for process knowledge. Excessive data volume can create many false alarms, and algorithmic detection may identify a statistical anomaly without identifying a meaningful operational cause.

Artificial intelligence can assist with anomaly prioritization, variable selection, and pattern recognition, but it should not replace the statistical definition of the monitored process. Models trained on historical data may reproduce past measurement bias or fail after a process redesign. Human review, traceability, and change control remain necessary.

Illustrative Case: Stabilizing a Pharmaceutical Filling Process

Background

A pharmaceutical plant fills liquid containers on three production lines. Each hour, five consecutive containers from a line are weighed. The target fill is 100 millilitres, and the engineering specifications are 99.5 to 100.5 millilitres.

Situation and Problem

The quality team initially used a single chart combining all three lines. The overall average appeared acceptable, but periodic batches exceeded the lower specification. Operators responded by adjusting the filling machines whenever an individual reading was close to a specification limit.

Analysis

A review showed that the lines had different pump designs and that observations from different hours had been mixed into the same subgroups. The sampling plan therefore did not represent a rational subgroup. Separate X-bar and R charts were created for each line using five consecutive containers per hour. The R charts showed that Line 2 had substantially higher short-term variation. Its X-bar chart also displayed a downward shift after a pump-seal replacement.

The team first confirmed the balance and calibration of the weighing system. Maintenance records then showed that the replacement seal had a different compression setting. The process was stable on Lines 1 and 3 but unstable on Line 2. Capability analysis was postponed for Line 2 until the special cause was addressed.

Approach and Solution

The seal installation procedure was revised, the pump was reset, and operators were trained in the revised setup. The team retained the separate charts and introduced a documented response rule: an out-of-control signal required investigation, whereas an ordinary fluctuation did not justify adjustment. After a new stable baseline was established, capability was assessed against the specifications.

Outcome

The principal improvement did not come from changing the control limits. It came from correcting the sampling design, separating unlike processes, identifying a maintenance-related cause, and stopping routine tampering. The resulting charts gave managers a clearer distinction between machine-specific problems and ordinary filling variation.

Learning Points

The case demonstrates that control charts are process-management tools, not decorative graphs. Rational subgrouping, measurement verification, stratification by line, and a defined response plan were more important than selecting a more complex statistical technique.

Limitations, Risks, and Professional Responsibilities

SPC can mislead when data are autocorrelated, seasonal, censored, heavily non-normal, or generated by changing definitions. A control chart for monthly demand may confuse seasonality with special cause unless the baseline model accounts for it. A chart based on biased inspection data may show a stable but false picture. Small samples can produce uncertain estimates, while very large samples may signal inconsequential changes.

Ethically, organizations must not suppress adverse observations, redefine defects after seeing the results, or manipulate limits to avoid escalation. In regulated industries, chart calculations, revisions, investigations, and disposition of affected output should be traceable. Privacy must be protected when patient, employee, or customer-level data are used. Access controls and data lineage are particularly important when charts are generated automatically.

Managers should also consider the consequences of false alarms and missed signals. A system that generates constant alerts may cause alert fatigue; a system with excessively broad limits may normalize deterioration. The appropriate design balances statistical sensitivity, operational cost, safety, customer risk, and the speed with which a cause can be investigated.

Best Practices for Effective SPC

Effective SPC commonly rests on the following practices:

• define the process and operational definitions before collecting data;
• verify the measurement system and classification consistency;
• use rational subgroups linked to the intended source of variation;
• separate unlike streams rather than hiding them in an aggregate chart;
• establish limits from a credible baseline and document revisions;
• examine dispersion before relying on location signals;
• distinguish control limits from specification limits;
• predefine signal rules and investigation responsibilities;
• avoid adjustment in response to common-cause fluctuation;
• combine charts with process knowledge, capability analysis, and risk assessment; and
• review chart effectiveness periodically as the process, technology, or customer requirement changes.

Current Developments

Modern SPC is moving from periodic manual charting toward streaming and event-driven monitoring. Sensor networks permit high-frequency observation, while cloud platforms allow common methods to be deployed across geographically distributed operations. Adaptive methods can account for changing volume or operating context, but they must be governed carefully so that legitimate process changes are not mistaken for anomalies and true deterioration is not absorbed into a moving baseline.

There is also growing interest in integrating SPC with maintenance, process mining, digital twins, and risk-based quality systems. The central principle remains unchanged: statistical detection should lead to informed process action, not indiscriminate automation.

Chapter Summary

Statistical Process Control provides a framework for monitoring process behaviour over time and distinguishing common-cause variation from special-cause variation. Stability means predictable statistical behaviour; it does not guarantee conformance or capability. Rational subgrouping is essential because it determines which sources of variation are visible within and between subgroups.

Variable charts such as X-bar and R, X-bar and s, and individuals charts monitor measured characteristics and can separately reveal shifts in location and dispersion. Attribute charts include p and np charts for defective units and c and u charts for defect counts. Rare-event charts such as g and t charts are appropriate when the meaningful measure is the number of opportunities or time between uncommon events. CUSUM and EWMA improve sensitivity to small or gradual shifts.

Sound SPC requires reliable measurement, suitable chart selection, documented signal rules, investigation of special causes, and avoidance of tampering. Digital systems and AI can support detection and integration, but professional judgment, governance, and process knowledge remain indispensable.

Key Terms

Statistical Process Control: The use of statistical methods to monitor and improve process behaviour over time.

Process stability: A condition in which process variation is statistically predictable.

Common-cause variation: Routine variation produced by the combined effects of the normal process system.

Special-cause variation: Variation associated with an unusual, identifiable, or potentially identifiable factor.

Control limit: A statistically derived boundary used to judge whether process behaviour is unusual.

Specification limit: A customer, engineering, regulatory, or contractual requirement for an individual output.

Rational subgroup: A set of observations selected to be similar within the subgroup and meaningfully comparable across subgroups.

Variable data: Quantitative measurements recorded on a continuous or numerical scale.

Attribute data: Data based on classifications or counts.

Defective unit: A unit that fails to meet one or more requirements.

Defect: A specific nonconformity or error; one unit may contain multiple defects.

X-bar chart: A chart monitoring subgroup means.

R chart: A chart monitoring subgroup ranges.

CUSUM chart: A chart that accumulates deviations from a target to detect persistent shifts.

EWMA chart: A chart using exponentially weighted observations to detect gradual changes.

p chart: A chart monitoring the proportion defective.

u chart: A chart monitoring defects per unit when opportunity varies.

Rare event: An event occurring infrequently relative to the number of opportunities.

Tampering: Unnecessary adjustment of a stable process in response to ordinary fluctuation.

Capability: The extent to which a stable process can meet specified requirements.

Review Questions

Short Answer Questions

1. Distinguish common-cause variation from special-cause variation.

2. Why must control limits not be confused with specification limits?

3. What is meant by rational subgrouping?

4. When is a u chart preferred to a c chart?

5. State one reason for using an EWMA or CUSUM chart instead of a Shewhart chart.

Long Answer Questions

1. Explain the logic, construction, and interpretation of X-bar and R charts.

2. Compare p, np, c, and u charts, including the data conditions required for each.

3. Discuss the relationship among stability, capability, and conformance.

4. Explain how poor sampling design and inappropriate subgrouping can distort SPC conclusions.

5. Describe a disciplined organizational response to a control-chart signal.

Analytical / Application Questions

1. A hospital records the number of medication errors per 1,000 prescriptions, but the number of prescriptions varies substantially each week. Select an appropriate chart and justify your choice.

2. A machining process has a stable average but an R chart signal indicating increased short-term variation. Explain the likely analytical sequence and the types of process causes you would investigate.

3. A customer-service process experiences one serious complaint every several thousand transactions. Design an SPC approach using a rare-event chart and explain how reporting changes could affect interpretation.

22. Multiple Choice Questions with Answers

Question 1

Which statement best distinguishes a stable process from a capable process?

A. A stable process always produces outputs within specifications.

B. A capable process must contain special causes.

C. A stable process is predictable, whereas capability concerns its ability to meet specifications.

D. Stability and capability are identical concepts.

Correct Answer: C. A stable process is predictable, whereas capability concerns its ability to meet specifications.

Question 2

Five consecutive units produced within a short time period are grouped together primarily to:

A. Maximize the number of special causes in each subgroup

B. Make observations within a subgroup as comparable as possible

C. Ensure every subgroup has a different machine

D. Replace the need for measurement-system evaluation

Correct Answer: B. Make observations within a subgroup as comparable as possible

Question 3

Which chart is most appropriate for monitoring the proportion of defective units when subgroup sizes vary?

A. np chart

B. p chart

C. c chart

D. R chart

Correct Answer: B. p chart

Question 4

A u chart is preferred over a c chart when:

A. The number of defects is always zero

B. The inspection opportunity or number of units varies

C. The subgroup size is constant and only means are required

D. The data are continuous measurements

Correct Answer: B. The inspection opportunity or number of units varies

Question 5

What should generally be examined before interpreting an X-bar chart based on X-bar and R charts?

A. The specification target only

B. The R chart for process dispersion

C. The customer complaint rate only

D. The process capability index only

Correct Answer: B. The R chart for process dispersion

Question 6

Which situation most directly justifies using a CUSUM chart?

A. The process has no measurable observations

B. Only large, sudden shifts matter

C. A small persistent shift must be detected quickly

D. The classification rule changes every subgroup

Correct Answer: C. A small persistent shift must be detected quickly

Question 7

In an EWMA chart, selecting a smaller smoothing constant generally:

A. Gives greater weight to recent observations

B. Provides more smoothing and greater weight to historical observations

C. Eliminates the need for control limits

D. Converts variable data into attribute data

Correct Answer: B. Provides more smoothing and greater weight to historical observations

Question 8

An operator adjusts a stable process after every individual fluctuation toward the target. This behaviour is an example of:

A. Rational subgrouping

B. Stratification

C. Tampering

D. Capability improvement

Correct Answer: C. Tampering

Question 9

For a rare event such as a safety incident, which measure is especially suitable for a g chart?

A. The average subgroup range

B. The number of opportunities between successive events

C. The proportion defective in a fixed subgroup

D. The subgroup standard deviation

Correct Answer: B. The number of opportunities between successive events

Question 10

A point outside a control limit should initially be interpreted as:

A. Automatic proof that every unit is defective

B. Evidence of unusual process behaviour requiring investigation

C. Proof that the specification limits are incorrect

D. A reason to recalculate limits immediately without investigation

Correct Answer: B. Evidence of unusual process behaviour requiring investigation