Applied Mathematics

Chapter 2
Units, Measurement, Error and Dimensional Analysis

Bachelors Program in Machine Technology
Applied Mathematics   •   Bachelor

Units, Measurement, Error and Dimensional Analysis

Introduction

Engineering decisions depend on measurements. In machine technology, dimensions determine whether parts assemble, loads determine whether components remain safe, and process measurements determine whether manufacturing remains within specification. A numerical value without a unit is incomplete, while a measurement without an estimate of uncertainty can create false confidence.

This chapter develops a systematic approach to SI units, measurement, dimensional consistency, scaling, significant figures, tolerances, error propagation, and nondimensional parameters. These concepts support the validation of experimental results, engineering equations, CAD specifications, machine-tool settings, and physical models.

Learning Objectives

By the end of this chapter, you should be able to:

  1. Use SI base and derived units correctly.
  2. Convert units and distinguish dimensional quantities from dimensionless quantities.
  3. Apply dimensional analysis to test equations and construct useful relationships.
  4. Report measurements using appropriate significant figures and uncertainty.
  5. Distinguish accuracy, precision, error, uncertainty, tolerance, and calibration.
  6. Estimate propagated uncertainty in calculated quantities.
  7. Use scaling laws and nondimensional parameters to compare systems.
  8. Evaluate measurements and engineering models in a machine-technology context.

1. Measurement as a Technical Process

A measurement compares an unknown quantity with an accepted standard. It normally consists of a measurand, an instrument, a procedure, an operator or automated system, and environmental conditions. For example, measuring a shaft diameter involves identifying the diameter as the measurand, selecting a micrometer, applying a specified contact force, and accounting for temperature and calibration.

A reported measurement should communicate both a value and its unit. A more complete report also states uncertainty, for example:

d = (25.000 ± 0.005) mm

The central value is the best estimate; the ± quantity expresses an interval or uncertainty convention. The meaning of the uncertainty must be stated when high precision is important: it may represent a standard uncertainty, an expanded uncertainty, or an engineering tolerance.

Important terminology

  • Accuracy describes closeness to a reference or true value.
  • Precision describes the agreement among repeated measurements.
  • Resolution is the smallest increment an instrument displays or can distinguish.
  • Sensitivity is the change in instrument output per unit change in input.
  • Calibration compares an instrument with a traceable standard and establishes corrections or performance.
  • Error is the difference between a measured value and a reference value. The true value is often unknown, so practical error estimates rely on standards, repeated measurements, or models.
  • Uncertainty describes reasonable doubt about a measurement result.
  • Tolerance is the permitted range specified for manufacture or operation.

Random effects cause readings to vary unpredictably; systematic effects shift readings in a consistent direction. Repetition can reduce the influence of random variation but cannot, by itself, remove a systematic zero error or calibration bias.

2. The International System of Units

The SI system is founded on seven base quantities. Their units are shown below.

Base quantitySI unitSymbol
Timeseconds
Lengthmetrem
Masskilogramkg
Electric currentampereA
Thermodynamic temperaturekelvinK
Amount of substancemolemol
Luminous intensitycandelacd

Many engineering quantities are derived from these bases. For example, velocity has units m/s, acceleration has units m/s², force has units newton (N), and pressure has units pascal (Pa). Their relationships are:

1 N = 1 kg·m·s⁻²
1 Pa = 1 N·m⁻² = 1 kg·m⁻¹·s⁻²

The SI prefixes indicate powers of ten.

PrefixSymbolFactor
gigaG10⁹
megaM10⁶
kilok10³
millim10⁻³
microμ10⁻⁶
nanon10⁻⁹

Case matters: mm means millimetre, whereas Mm means megametre. The kilogram is the SI base unit of mass; multiples are formed using prefixes attached to gram, such as milligram.

Unit conversion

A conversion factor is a ratio equal to one. For example, since 1 in = 25.4 mm,

38.10 mm × (1 in / 25.4 mm) = 1.500 in

The unit being converted cancels. This cancellation is a reliable check against many conversion errors.

Worked Example 1: Force and pressure units

A cutting force is 2.40 kN and acts over an area of 600 mm². Find the average pressure in MPa.

First convert the force and area:

F = 2.40 kN = 2400 N

A = 600 mm2 = 600 × 10-6 m2 = 6.00 × 10-4 m2

Average pressure is force divided by area:

p = F/A = 2400/(6.00 × 10⁻⁴) = 4.00 × 10⁶ Pa = 4.00 MPa

The result is dimensionally correct because N/m² is Pa. The three significant figures reflect the supplied data.

3. Dimensions and Dimensional Consistency

A dimension identifies the physical nature of a quantity independently of the unit used. The fundamental mechanical dimensions are commonly mass M, length L, and time T. Thus:

QuantityDimensional representation
DisplacementL
VelocityL T-1
AccelerationL T-2
ForceM L T-2
EnergyM L2 T-2
PowerM L2 T-3
PressureM L-1 T-2

An equation is dimensionally homogeneous when every additive term has the same dimensions and both sides have identical dimensions. For example, the kinematic equation

s = ut + ½at²

is consistent: s has dimension L; ut has dimensions (L/T)(T) = L; and at2 has dimensions (L/T²)(T²) = L.

Dimensional consistency is necessary but not sufficient. An equation may have correct dimensions and still have an incorrect numerical coefficient or incorrect physical assumptions. Dimensional analysis cannot determine whether a friction coefficient, boundary condition, or material law has been used correctly.

Testing an equation

Consider the proposed relation v = u + at2. The left side and u have dimensions L/T, but at² has dimensions L. Since unlike dimensions are added, the equation is invalid. The corrected constant-acceleration relation is v = u + at.

Trigonometric, exponential, and logarithmic functions require dimensionless arguments. Therefore expressions such as sin(θ) require θ to be expressed as a pure ratio, normally in radians. The expression e−t is incomplete unless t is divided by a characteristic time, such as e−t/τ.

4. Dimensional Analysis and Model Construction

Dimensional analysis can test equations, reduce variables, and identify governing dimensionless groups. The Buckingham Π theorem states that if a physical problem contains n dimensional variables involving r independent fundamental dimensions, the relationship can be rewritten using n − r independent dimensionless products, called Π groups.

The theorem does not provide the physical law automatically. It identifies possible structure and reduces the number of independent variables.

Worked Example 2: Period of a simple pendulum

Suppose the period T of a pendulum depends on length L, gravitational acceleration g, and bob mass m. Assume no dependence on amplitude for small oscillations. The dimensions are:

  • T: T
  • L: L
  • g: L T⁻²
  • m: M

A dimensionless product may be written as:

Π = T ga Lb mc

Its dimensions are T1−2a+b Mc La+b. Setting all exponents to zero gives c = 0, a + b = 0, and 1 − 2a + b = 0. Hence a = 1/2 and b = −1/2. Therefore:

Π = T√(g/L)

The dimensionless relationship is constant for dynamically similar small-angle pendulums, so:

T = C√(L/g)

Experiments and theory establish C = 2π for a simple pendulum under the ideal assumptions. Notice that dimensional analysis predicts the dependence on L and g but not the factor 2π.

Common engineering dimensionless parameters

ParameterDefinitionTypical interpretation
Reynolds numberRe = ρvL/μInertial effects relative to viscous effects
Mach numberMa = v/cSpeed relative to sound speed
Froude numberFr = v/√(gL)Inertial effects relative to gravity
Coefficient of frictionμf = Ff/NFriction force relative to normal force
Strainε = ΔL/LRelative deformation

Here ρ is density, v is characteristic speed, L is characteristic length, μ is dynamic viscosity, c is sound speed, g is gravitational acceleration, Ff is friction force, N is normal force, and ΔL is change in length. Each parameter is dimensionless, provided consistent units are used.

5. Significant Figures and Reporting Results

Significant figures communicate the precision justified by measurement. Zeros between nonzero digits are significant; leading zeros are not; trailing zeros after a decimal point are significant. Thus 0.00420 has three significant figures, while 4200 is ambiguous unless notation or a stated convention clarifies it.

For multiplication and division, the result generally has no more significant figures than the input with the fewest significant figures. For addition and subtraction, the result is limited by the least precise decimal place.

Worked Example 3: Arithmetic and rounding

Suppose a rectangular plate has measured dimensions 125.4 mm and 38.2 mm. Its area is:

A = 125.4 × 38.2 = 4789.?? mm²

Calculating carefully gives A = 4780.28 mm2. Because 38.2 has three significant figures, report:

A = 4.78 × 10³ mm²

Do not round intermediate results unnecessarily; retain guard digits and round the final result. Exact conversion factors, such as 1 in = 25.4 mm, do not limit significant figures.

Significant figures are not the same as uncertainty. Writing 25.00 mm implies a resolution or reporting precision of approximately 0.01 mm, but the actual uncertainty depends on calibration, method, repeatability, temperature, and other effects.

6. Error, Uncertainty and Tolerance

A useful classification is:

  • Gross error: a mistake such as reading the wrong scale or entering 10.0 instead of 100.
  • Systematic error: a repeatable bias, such as a micrometer zero offset.
  • Random error: unpredictable variation caused by noise, surface condition, operator contact, or environmental fluctuation.

If a reference value x_ref is available, absolute error and relative error are:

Absolute error = xmeasured − xref
Relative error = (xmeasured − xref)/xref

Percentage error is relative error multiplied by 100. The sign indicates direction; the magnitude indicates size.

For repeated observations x₁, x₂, …, xₙ, the arithmetic mean is:

x̄ = (1/n)∑xi

The sample standard deviation is:

s = √[∑(xi − x̄)²/(n − 1)]

The sample standard deviation describes spread among observations. Under suitable assumptions of independent, approximately normally distributed observations, the standard uncertainty of the mean is sx̄ = s/√n. Repetition reduces random uncertainty in the mean, but systematic uncertainty remains.

Tolerances

A tolerance defines allowable manufacturing variation. If a shaft is specified as 25.000 ± 0.010 mm, its limits are 24.990 mm and 25.010 mm. A tolerance is a design or acceptance requirement, not automatically a statement of measurement uncertainty. An instrument should normally have substantially smaller uncertainty than the tolerance being checked.

Limits can also be unilateral, such as diameter ≤ 10.00 mm, or expressed through a fit system. In production, capability indices and statistical process control may be used, but acceptance still depends on the stated specification and measurement system.

7. Propagation of Measurement Uncertainty

Suppose a result y depends on measured variables x₁, x₂, …, xₙ. For small, independent uncertainties, the first-order combined standard uncertainty is:

uy = √[∑(∂y/∂xi)² ui²]

Here ui is the standard uncertainty in xi. This root-sum-square expression assumes the inputs are independent and the model can be linearized near the measured values.

If inputs are correlated, covariance terms are required:

uy² = ∑∑(∂y/∂xi)(∂y/∂xj)uij

where uij is the covariance between inputs i and j. For independent inputs, off-diagonal covariance terms are zero.

Useful special cases are:

For y = a + b,

uy = √(ua² + ub²)

For y = ab, with independent inputs,

(uy/y) = √[(ua/a)² + (ub/b)²]

For y = axp,

uy/|y| = |p|ux/|x|

These formulas describe uncertainty, not the maximum possible error. Worst-case tolerance analysis often adds absolute contributions rather than combining them statistically.

Worked Example 4: Density uncertainty

A metal sample has mass m = (780.0 ± 0.5) g and volume V = (100.0 ± 0.8) cm3. Its density is:

ρ = m/V = 780.0/100.0 = 7.800 g·cm⁻³

Using independent uncertainties:

u_ρ/ρ = √[(0.5/780.0)² + (0.8/100.0)²] = 0.00806

Therefore:

u_ρ = 7.800 × 0.00806 = 0.0629 g·cm⁻³

A suitable report is ρ = (7.80 ± 0.06) g·cm-3, subject to the stated uncertainty convention. The volume uncertainty dominates because its relative uncertainty is much larger than that of mass.

8. Scaling and Similarity

Scaling relates a model to a full-size system. Geometric similarity requires corresponding lengths to have a constant ratio. If the linear scale factor is λ = L_model/L_prototype, then area scales as λ² and volume or mass, for equal density, scales as λ³.

For a family of geometrically similar objects:

A₂/A₁ = (L₂/L₁)²
V₂/V₁ = (L₂/L₁)³

Physical scaling also depends on the governing phenomenon. For example, maintaining the same Reynolds number may be essential for a fluid-flow model, while matching the Froude number may be more important for open-channel flow. A model cannot generally preserve every dimensionless parameter simultaneously when size and operating conditions change.

Worked Example 5: Scale effect

A 1:5 geometrically similar gear housing is manufactured as a prototype model. If the prototype length is five times the model length, the prototype surface area is 25 times the model area and, for equal material density, its mass is 125 times the model mass. This cubic increase explains why a modest dimensional increase can produce a substantial mass and handling change.

9. Applied Case: Verification of a Precision Shaft

Background

An illustrative machine-shop case concerns a shaft specified for a bearing seat. The drawing specifies a diameter of 30.000 ± 0.015 mm. The inspection department uses a calibrated micrometer with a stated expanded uncertainty of ±0.004 mm under controlled conditions.

Problem

Five independent readings, in millimetres, are recorded:

29.992, 29.996, 29.994, 29.998, 29.995.

Determine whether the shaft should be accepted and identify the main measurement risks.

Analysis

The mean is:

x̄ = (29.992 + 29.996 + 29.994 + 29.998 + 29.995)/5 = 29.995 mm

The specification limits are 29.985 mm and 30.015 mm, so the mean lies within the limits. The sample standard deviation is approximately 0.0022 mm, indicating good repeatability relative to the tolerance width.

However, acceptance should not be based only on the mean. The individual readings are all within the specification limits, and the instrument uncertainty is smaller than the ±0.015 mm tolerance. If the uncertainty interval is considered, the result remains comfortably above the lower limit and below the upper limit. Temperature, burrs, surface contamination, micrometer contact force, alignment, and calibration status should nevertheless be checked.

Approach and outcome

The part is accepted provisionally because every observation satisfies the limits and the measurement system is sufficiently capable for this decision. The inspection record should identify the instrument, calibration status, operator, temperature, measurement locations, and uncertainty convention. If the diameter varies along the shaft, measurements at several axial and circumferential locations are required; five repeated readings at one location do not establish roundness or cylindricity.

Learning points

  1. Repeatability does not prove accuracy.
  2. A tolerance is not the same as uncertainty.
  3. Measurement location matters for geometric features.
  4. Dimensional compliance requires both correct units and correct feature interpretation.
  5. Traceable calibration and documented conditions support defensible decisions.

10. Limitations, Professional Practice and Contemporary Tools

Dimensional analysis cannot replace experiments, constitutive laws, or knowledge of boundary conditions. Uncertainty propagation based on first-order derivatives can become inaccurate for strongly nonlinear models, very large uncertainties, discontinuities, or non-normal distributions. In such cases, Monte Carlo simulation may be more appropriate: sample input distributions, evaluate the model repeatedly, and examine the resulting output distribution.

Digital calipers, coordinate-measuring machines, laser scanners, sensors, and machine-vision systems can produce large datasets, but more data do not automatically produce better information. Software must preserve units, identify coordinate systems, record calibration metadata, and prevent silent conversion errors. In AI-assisted inspection, training data, reference standards, measurement bias, traceability, and human review remain essential. An algorithmic classification should not be treated as authoritative if the measurement system is unvalidated.

Professional practice includes:

  • use SI units unless a documented standard requires another system;
  • write units beside numerical values during calculations;
  • check dimensions before trusting an equation;
  • avoid reporting more digits than the measurement supports;
  • distinguish specification limits from uncertainty intervals;
  • calibrate instruments against traceable standards;
  • control temperature and environmental conditions where relevant;
  • document assumptions, corrections, and conversion factors;
  • use conservative engineering judgment when uncertainty affects safety;
  • preserve measurement records for quality, maintenance, and regulatory review.

Safety-critical measurements require stronger controls, including validated procedures, competent personnel, calibration intervals based on risk, independent checks, and documented acceptance criteria. Falsifying, selectively deleting, or unjustifiably altering measurements is both unethical and potentially dangerous.

Chapter Summary

SI units provide a coherent language for engineering quantities. Base units generate derived units such as newtons and pascals, while conversion factors must be arranged so unwanted units cancel. Dimensions describe the physical form of a quantity and allow equations to be checked for homogeneity. Dimensional analysis can also reduce variables and construct dimensionless parameters, although it cannot determine every physical constant or assumption.

Significant figures communicate justified numerical precision, while uncertainty quantifies reasonable doubt. Accuracy, precision, resolution, calibration, error, tolerance, and uncertainty have distinct meanings. Random uncertainty may be reduced through repetition, whereas systematic effects require correction, calibration, or improved procedure. Uncertainty propagation uses sensitivity derivatives and, under appropriate assumptions, root-sum-square combination. Scaling laws connect length, area, volume, and physical similarity, while nondimensional parameters support comparison between models and full-scale systems. In machine technology, these ideas enable valid inspection, reliable process control, defensible engineering calculations, and safer decisions.

Key Terms

SI unit: Internationally standardized unit used to express a physical quantity.

Dimension: Representation of a quantity in fundamental forms such as mass, length, and time.

Derived unit: Unit formed from combinations of SI base units.

Dimensional homogeneity: Condition in which all terms in an equation have compatible dimensions.

Dimensional analysis: Method for checking equations and constructing dimensionless relationships.

Measurement: Comparison of a quantity with an accepted standard.

Measurand: Quantity intended to be measured.

Accuracy: Closeness of a result to a reference value.

Precision: Agreement among repeated measurements.

Resolution: Smallest distinguishable instrument increment.

Calibration: Comparison with a traceable standard to determine performance or correction.

Error: Difference between a measured result and a reference value.

Uncertainty: Quantified doubt associated with a measurement result.

Tolerance: Permitted range of variation for a specified feature or quantity.

Significant figures: Digits justified by the precision of a measurement.

Random error: Unpredictable variation between repeated measurements.

Systematic error: Consistent bias affecting measurements in a repeatable way.

Dimensionless parameter: Quantity formed without physical units, often used to compare effects.

Scaling: Relating physical quantities between geometrically or dynamically similar systems.

Traceability: Ability to relate a measurement to standards through an unbroken documented chain.

Review Questions

Short Answer Questions

  1. Distinguish accuracy from precision.
  2. Why must quantities added in an equation have compatible dimensions?
  3. State the SI units of force and pressure.
  4. What is the difference between tolerance and uncertainty?
  5. Why does repeating a measurement not necessarily remove systematic error?

Long Answer Questions

  1. Explain the role of SI units, derived units, and conversion factors in machine-technology calculations.
  2. Describe how dimensional analysis can validate an equation and reduce the number of variables in a model.
  3. Explain significant figures and give rules for addition, subtraction, multiplication, and division.
  4. Derive the first-order uncertainty propagation expression for a function of several independent variables in conceptual terms.
  5. Discuss the differences among calibration, accuracy, precision, resolution, error, and uncertainty in an industrial inspection system.

Analytical / Application Questions

  1. A force of 3.60 kN acts on an area of 450 mm². Calculate the pressure in MPa and show the unit conversion.
  2. A measured length is 120.0 ± 0.3 mm and a width is 40.0 ± 0.2 mm. Estimate the area and its combined standard uncertainty, assuming independent measurements.
  3. A machine component is manufactured to 50.000 ± 0.020 mm, but the inspection instrument has an uncertainty of ±0.030 mm. Assess whether the instrument is suitable for a confident acceptance decision and justify your conclusion.

Multiple Choice Questions with Answers

Question 1

Which expression is dimensionally consistent with velocity?

A. v = u + at

B. v = u + at2

C. v = u + a/t

D. v = u + t/a

Correct Answer: A. v = u + at

Question 2

What is the SI derived unit of pressure?

A. N·m

B. N/m²

C. kg·m/s

D. kg/m²

Correct Answer: B. N/m²

Question 3

A force of 2.00 kN acts on an area of 500 mm². What is the average pressure?

A. 0.004 MPa

B. 0.40 MPa

C. 4.00 MPa

D. 400 MPa

Correct Answer: C. 4.00 MPa

Question 4

Which quantity is dimensionless?

A. Force

B. Pressure

C. Strain

D. Power

Correct Answer: C. Strain

Question 5

For independent measurements, which expression gives the combined standard uncertainty of y = a + b?

A. u_y = u_a + u_b

B. u_y = √(u_a² + u_b²)

C. u_y = u_a/u_b

D. u_y = u_a − u_b

Correct Answer: B. u_y = √(u_a² + u_b²)

Question 6

A tolerance of 25.000 ± 0.010 mm gives which lower limit?

A. 24.900 mm

B. 24.990 mm

C. 25.010 mm

D. 25.100 mm

Correct Answer: B. 24.990 mm

Question 7

Which action is most appropriate for reducing a systematic micrometer zero error?

A. Take more readings without correction

B. Round the readings more heavily

C. Calibrate and apply an appropriate correction

D. Change the unit from millimetres to inches

Correct Answer: C. Calibrate and apply an appropriate correction

Question 8

If all lengths of a geometrically similar object are doubled, how does its volume change?

A. It doubles

B. It becomes four times larger

C. It becomes six times larger

D. It becomes eight times larger

Correct Answer: D. It becomes eight times larger

Question 9

For a pendulum depending on length L and gravitational acceleration g, which combination is dimensionless?

A. TgL

B. T√(g/L)

C. Tg/L

D. T/(gL)

Correct Answer: B. T√(g/L)

Question 10

Which statement about significant figures is correct?

A. Leading zeros are always significant

B. Addition is limited by the fewest total digits

C. Multiplication is generally limited by the input with fewest significant figures

D. Exact conversion factors limit the final significant figures

Correct Answer: C. Multiplication is generally limited by the input with fewest significant figures

Applied Mathematics
Chapter 2 of 15