Time Series Forecasting

Chapter 5
Baseline Methods and Exponential Smoothing

Post Graduate Program in Business Analytics
Time Series Forecasting   •   Post Graduate

Baseline Methods and Exponential Smoothing

Introduction

Forecasting is not synonymous with constructing a sophisticated model. In many business settings, a transparent baseline is the first model against which every advanced method should be judged. Baselines reveal whether additional modelling genuinely adds predictive value, provide operationally stable forecasts, and offer a defensible fallback when data are sparse or systems fail.

This chapter develops a practical framework for forecasting a univariate time series. It covers naïve, seasonal-naïve, drift and moving-average methods, followed by simple exponential smoothing, Holt’s method, damped-trend smoothing, Holt–Winters methods and the ETS framework. Particular attention is given to model components, parameter estimation, forecast uncertainty, validation and managerial interpretation.

Learning objectives

By the end of this chapter, you should be able to:

  1. Construct and interpret naïve, seasonal-naïve, drift and moving-average forecasts.
  2. Explain level, trend, seasonality and error components in exponential-smoothing models.
  3. Select simple, Holt, damped-trend and Holt–Winters specifications.
  4. Estimate smoothing parameters using recursive updating and numerical optimisation.
  5. Produce and interpret point forecasts and prediction intervals.
  6. Compare models using time-respecting validation and appropriate accuracy measures.
  7. Identify limitations, governance risks and professional uses of automated forecasting.

1. Forecasting foundations and notation

Let yt denote the observed value at time t, where observations are equally spaced. The information available through time t is denoted by \mathcal{F}t. A forecast made at time t for h periods ahead is \hat{y}t+h|t. The forecast error is

et+h|t=yt+h-\hat{y}t+h|t

The error has the same units as the series. Forecast intervals describe uncertainty about future observations, not merely uncertainty about estimated parameters. A 95% prediction interval is intended to contain the future outcome in approximately 95% of repeated, comparable forecasting situations, subject to model assumptions.

A useful decomposition is:

yt=\ellt+bt+st+\varepsilont

where \ellt is level, bt is trend, st is seasonal effect and \varepsilont is an irregular error. This is an additive representation. For series whose seasonal variation grows with level, a multiplicative representation is often more appropriate:

yt=(\ellt+bt)st\varepsilont

Multiplicative models require positive observations. A logarithmic transformation can sometimes convert multiplicative behaviour into approximately additive behaviour, but forecasts must then be carefully back-transformed because E(eX) is generally not equal to eE(X).

2. Baseline forecasting methods

2.1 Naïve forecasting

The naïve forecast uses the latest observation as the forecast for every future period:

\hat{y}t+h|t=yt,\quad h\geq1

It is appropriate when the series behaves approximately like a random walk, when rapid adaptation is important, or when a simple benchmark is required. It does not model trend or seasonality. Its forecast intervals generally widen with the horizon because uncertainty accumulates.

For a random-walk model with drift-free increments, yt=yt-1+\varepsilont, the naïve forecast is the conditional mean if the errors have mean zero.

2.2 Seasonal naïve forecasting

If a stable seasonal cycle has period m, the seasonal-naïve forecast repeats the observation from the corresponding season:

\hat{y}t+h|t=yt+h-mk

where k is the smallest positive integer that makes the referenced time no later than t. For monthly data with m=12, the forecast for March next year equals the most recent March observation. This method is especially strong when seasonality is persistent and other dynamics are weak.

2.3 Drift method

The drift method extrapolates the average historical change. With observations from times 1 through t,

\hat{y}t+h|t=yt+h\left(\frac{yt-y1}{t-1}\right)

The slope has units of “series units per time period.” The method is equivalent to forecasting from a random walk with drift estimated by the average change. It can perform poorly when a historical trend is not stable or when structural breaks have occurred.

2.4 Moving-average forecasts

A trailing moving average of window length k is

\hat{y}t+1|t=\frac{1}{k}\sumi=0k-1yt-i

It smooths short-term noise, but it is a forecast only when the average is used to predict future observations. A larger k produces greater smoothing and slower response to changes. A moving average does not automatically account for seasonality and can produce implausible forecasts near turning points.

Worked example. Suppose the last four weekly sales are 100, 110, 90 and 120 units. A four-week moving-average forecast is

(100+110+90+120)/4=105 units. A naïve forecast would be 120 units. The two forecasts embody different assumptions: the moving average assumes recent fluctuations will average out, whereas the naïve method assumes the latest level persists.

2.5 Why baselines matter

A model that is more complex than a seasonal-naïve benchmark should be retained only if it improves out-of-sample performance or provides a valuable decision feature. Baselines also detect data leakage, incorrect seasonality settings and overfitting. In a forecasting report, baseline results should be shown rather than hidden.

3. Exponential smoothing as a state-space idea

Exponential smoothing assigns larger weights to recent observations and progressively smaller weights to older observations. The weights decline geometrically. For simple exponential smoothing, the one-step forecast can be written as

\hat{y}t+1|t=\alpha yt+(1-\alpha)\hat{y}t|t-1

where 0<\alpha<1 is the level-smoothing parameter. Repeated substitution gives weights proportional to \alpha(1-\alpha)j for an observation j periods old. Thus, high \alpha reacts quickly; low \alpha produces stable forecasts.

Exponential-smoothing models are commonly expressed in state-space form. The observed series is generated from unobserved states such as level and trend, while an error process links forecasts to observations. This formulation supports likelihood-based parameter estimation and prediction intervals.

3.1 Simple exponential smoothing

Simple exponential smoothing (SES) is appropriate for data with a changing level but no systematic trend or seasonality. A common recursive form is

\ellt=\alpha yt+(1-\alpha)\ellt-1

and

\hat{y}t+h|t=\ellt,\quad h\geq1

Here \ellt is the estimated current level. An initial level must be specified, often as the first observation or an estimated value. The choice has diminishing influence as more data arrive.

SES is not a regression line and should not be interpreted as a trend model. It is useful for inventory demand, call volumes and other series whose future level is expected to remain approximately constant apart from random variation.

3.2 Holt’s linear trend method

Holt’s method extends SES by maintaining level and trend states:

\ellt=\alpha yt+(1-\alpha)(\ellt-1+bt-1)
bt=\beta(\ellt-\ellt-1)+(1-\beta)bt-1
\hat{y}t+h|t=\ellt+hbt

where 0<\alpha<1 and 0<\beta<1. The trend bt has units of series units per time period. Holt’s method projects the trend indefinitely, which can create unrealistic forecasts over long horizons when growth eventually slows.

3.3 Damped-trend method

The damped-trend method reduces the influence of trend as the horizon increases:

\hat{y}t+h|t=\ellt+(\phi+\phi2+\cdots+\phih)bt

where 0<\phi<1. The corresponding updating equations are

\ellt=\alpha yt+(1-\alpha)(\ellt-1+\phi bt-1)
bt=\beta(\ellt-\ellt-1)+(1-\beta)\phi bt-1

As h grows, the geometric sum approaches \phi/(1-\phi), so the forecast does not increase linearly without bound. Damping is often a sensible compromise between no trend and unrestricted trend extrapolation.

4. Seasonal exponential smoothing: Holt–Winters

Holt–Winters methods add a seasonal state with period m. They have additive and multiplicative forms.

4.1 Additive seasonality

For a series whose seasonal amplitude is roughly constant:

\ellt=\alpha(yt-st-m)+(1-\alpha)(\ellt-1+bt-1)
bt=\beta(\ellt-\ellt-1)+(1-\beta)bt-1
st=\gamma(yt-\ellt)+(1-\gamma)st-m
\hat{y}t+h|t=\ellt+hbt+st-m+1+((h-1)\bmod m)-1?

To avoid indexing ambiguity, the forecast is more clearly stated as \hat{y}t+h|t=\ellt+hbt+st+h-mk, where k is selected so that the seasonal index refers to the corresponding most recent seasonal position. Parameters \alpha,\beta,\gamma lie between zero and one.

4.2 Multiplicative seasonality

For seasonal variation proportional to the level:

\ellt=\alpha\left(\frac{yt}{st-m}\right)+(1-\alpha)(\ellt-1+bt-1)
bt=\beta(\ellt-\ellt-1)+(1-\beta)bt-1
st=\gamma\left(\frac{yt}{\ellt}\right)+(1-\gamma)st-m
\hat{y}t+h|t=(\ellt+hbt)st+h-mk

Multiplicative seasonality requires positive data and positive seasonal states. Additive seasonality is safer when values may be zero or when the seasonal amplitude does not increase with the level.

4.3 Choosing components

Component selection should be based on data behaviour and validation, not visual preference alone.

Observed featureCandidate specification
Stable level, no trend or seasonalitySES
Trend without seasonalityHolt or damped Holt
Seasonality with constant amplitudeAdditive Holt–Winters
Seasonality proportional to levelMultiplicative Holt–Winters
Long-term trend likely to flattenDamped trend
Strong repeating cycle and little additional structureSeasonal naïve

5. ETS models and parameter estimation

ETS means error, trend and seasonal components. Each component may be additive or multiplicative, and trend may be absent, additive, multiplicative or damped, subject to coherent combinations. For example, ETS(A,A,N) has additive errors, additive trend and no seasonality; ETS(A,A,A) has additive errors, additive trend and additive seasonality.

The first letter describes the error equation, the second the trend, and the third the seasonality. The notation is a compact model description rather than a guarantee that every possible combination is statistically appropriate.

5.1 Estimating parameters

Parameters such as \alpha, \beta, \gamma and, where relevant, \phi can be estimated by minimising a training loss or maximising a likelihood. A common least-squares objective for one-step errors is

S(\theta)=\sumt=t0+1Tet(\theta)2

where \theta contains model parameters and initial states, et=yt-\hat{y}t|t-1, and T is the last training time. Least squares is sensitive to large errors. Maximum likelihood additionally specifies an error distribution and estimates parameters by maximising

L(\theta)=\prodt=t0+1Tf(et\mid\theta)

or, more conveniently, its logarithm. Under Gaussian errors, minimising the sum of squared errors is closely related to maximising likelihood, although the treatment of initial states and variance matters.

Constraints are essential: smoothing parameters generally lie in [0,1], damping parameters are commonly constrained to (0,1), and multiplicative models require valid positive states. Numerical optimisation may find local solutions; software should use sensible initialisations and convergence diagnostics.

5.2 Initialisation

Initial level, trend and seasonal states can be estimated jointly, derived from early observations, or obtained using decomposition. Poor initialisation can distort short samples. A professional workflow records the initialisation method and tests whether reasonable alternatives materially change forecasts.

6. Prediction intervals and uncertainty

A point forecast is incomplete without an indication of uncertainty. For an approximate normal forecast distribution,

\hat{y}t+h|t\pm z1-\alpha/2\,\sigmah

is a two-sided 100(1-\alpha)% prediction interval, where z1-\alpha/2 is the standard-normal quantile and \sigmah is the forecast-error standard deviation at horizon h. For a 95% interval, the quantile is approximately 1.96.

A rough constant-variance approximation uses \sigmah=\hat{\sigma}, but this understates uncertainty for many multi-step models. For a random walk with independent errors of variance \sigma2, the h-step forecast-error variance is approximately

Var(et+h|t)=h\sigma2

so interval width grows with \sqrt{h}. Exponential-smoothing software may derive intervals from the state-space model, simulation, or bootstrap. Bootstrap intervals can be useful when normality is doubtful, but they depend on whether residuals are independently and identically distributed and whether seasonal or time-varying volatility has been represented.

Intervals should not be interpreted as guarantees. Structural breaks, promotions, pandemics, policy changes and data revisions can produce outcomes outside model-based ranges.

7. Validation and accuracy assessment

Random train–test splitting is inappropriate for ordinary time series because it allows future information to influence training. Instead, reserve the latest observations as a test set or use rolling-origin evaluation. In rolling-origin evaluation, a model is fitted using data through one origin, forecasts the next observations, then the origin advances.

Common measures include:

MAE=\frac{1}{n}\sumi=1n|ei|
RMSE=\sqrt{\frac{1}{n}\sumi=1nei2}
MAPE=\frac{100}{n}\sumi=1n\left|\frac{ei}{yi}\right|

MAE is in the original units and is easy to explain. RMSE penalises large errors more heavily. MAPE is undefined when actual values are zero and can be distorted when actual values are near zero; it should not be used automatically. Scaled measures such as MASE compare errors with a naïve benchmark and are often more robust across series:

MASE=\frac{\text{mean absolute forecast error}}{\text{mean absolute in-sample one-step naïve error}}

Model selection should consider accuracy across relevant horizons, interval coverage, interpretability, stability and the cost of errors. A small average improvement may not justify operational complexity.

8. Illustrative case: retail replenishment forecasting

Background. A grocery retailer forecasts weekly demand for a chilled product sold in 52 stores. Demand rises during summer, falls after holidays and displays a strong annual cycle. Stockouts are expensive, but over-ordering creates waste.

Problem. The existing process uses last week’s demand. Managers suspect that the method underestimates demand before holidays and overestimates it immediately afterward.

Analysis. The analyst plots four years of weekly observations, checks missing values and records promotions, store closures and stockouts. Stockout weeks are not treated as ordinary low demand because observed sales then censor true demand. The seasonal period is set to 52 only after confirming that the calendar and data frequency support that assumption. Seasonal-naïve, drift, damped Holt–Winters and an ETS candidate are evaluated using rolling-origin forecasts for horizons of 1, 4 and 8 weeks.

Approach and solution. Seasonal-naïve performs well at four weeks. A multiplicative seasonal model performs best at one-week and eight-week horizons because seasonal amplitude increases with demand. A damped trend is selected rather than an unrestricted trend because long-range linear growth produces implausibly high forecasts. Prediction intervals are communicated to procurement: the central forecast supports normal ordering, while the upper interval informs capacity and service-level decisions.

Outcome. The retailer adopts the selected model as a statistical baseline, but allows planners to add documented promotion information. Forecast accuracy improves relative to the previous naïve method, while the system retains seasonal-naïve forecasts as a fallback. Exceptions are reviewed when actual demand lies outside the interval or when a promotion, closure or supply disruption occurs.

Learning points. The best model is context-dependent; data quality can matter more than algorithm choice; intervals support inventory decisions; and human adjustments should be recorded so that their value can be audited.

9. Limitations, governance and professional practice

Exponential smoothing is primarily univariate. It does not automatically explain demand using price, advertising, weather or competitor actions. Forecasts can also fail under structural change, intermittent demand, changing seasonal periods or calendar irregularities. When explanatory variables are central, regression with time-series errors, dynamic regression or machine-learning models may be appropriate, but they should still be compared with strong baselines.

Governance requires reproducible data pipelines, versioned model specifications, documented overrides and monitoring of forecast errors. Analysts should distinguish actual demand from observed sales when stockouts or capacity constraints exist. Forecasts can influence staffing, credit, healthcare access and public services; therefore, systematic bias across locations or customer groups should be examined. Privacy-preserving aggregation and access controls are required when forecasts use personal or commercially sensitive data.

Artificial intelligence does not eliminate these responsibilities. Automated model selection can efficiently search ETS candidates, but an analyst must verify frequency, missingness, leakage, interval calibration and business plausibility. A model should be retrained only under a documented policy, not merely because a dashboard appears inaccurate.

Best-practice workflow

  1. Define the forecasting target, frequency, horizon and decision cost.
  2. Inspect data quality, calendar effects, outliers, stockouts and revisions.
  3. Establish naïve and seasonal-naïve benchmarks.
  4. Diagnose level, trend, seasonal amplitude and possible transformations.
  5. Fit a small, coherent set of SES, Holt, damped and Holt–Winters/ETS candidates.
  6. Estimate parameters using a documented objective and constraints.
  7. Evaluate using rolling-origin validation and relevant horizons.
  8. Examine residuals, interval coverage and forecast plausibility.
  9. Select the simplest model that meets performance and operational requirements.
  10. Monitor errors, bias, overrides and structural changes after deployment.

Chapter Summary

Baseline methods provide transparent and essential reference forecasts. The naïve method carries the latest level forward; seasonal naïve repeats the corresponding seasonal observation; drift extrapolates average historical change; and moving averages smooth recent observations. Exponential smoothing represents evolving latent states. Simple exponential smoothing models level, Holt’s method adds trend, damped Holt limits long-run trend extrapolation, and Holt–Winters adds additive or multiplicative seasonality. ETS notation describes error, trend and seasonal components.

Smoothing parameters and initial states can be estimated by least squares or likelihood-based methods subject to model constraints. Prediction intervals must reflect increasing multi-step uncertainty and should be interpreted as conditional, model-dependent statements. Rolling-origin validation, suitable accuracy measures, residual checks and business plausibility are more reliable than random splitting or in-sample fit alone. Finally, data quality, structural breaks, stockouts, fairness, auditability and documented human intervention are central to professional forecasting.

Key Terms

Naïve forecast: Forecast equal to the latest observed value.

Seasonal-naïve forecast: Forecast that repeats the latest observation from the corresponding season.

Drift: Extrapolated average change between the first and latest observations.

Moving average: Average of a fixed number of recent observations.

Exponential smoothing: Forecasting approach that weights recent observations more heavily.

Level: Estimated current baseline value of a series.

Trend: Systematic change in level over time.

Seasonality: Repeating pattern with a known or stable period.

Additive model: Model in which components are combined by addition.

Multiplicative model: Model in which components interact through multiplication.

Holt’s method: Exponential-smoothing method with level and trend.

Damped trend: Trend whose influence decreases with forecast horizon.

Holt–Winters method: Exponential-smoothing method incorporating trend and seasonality.

ETS: Framework identifying error, trend and seasonal components.

Smoothing parameter: Weight controlling how rapidly a state responds to new data.

Prediction interval: Range intended to contain a future observation at a stated confidence level.

Rolling-origin evaluation: Time-respecting validation using successive forecast origins.

MAE: Mean absolute error in the original measurement units.

RMSE: Square root of mean squared error, giving extra weight to large errors.

MASE: Error scaled by the in-sample naïve benchmark error.

Review Questions

Short Answer Questions

  1. Why is a seasonal-naïve forecast a stronger benchmark than a naïve forecast for strongly seasonal data?
  2. What does the smoothing parameter \alpha control in simple exponential smoothing?
  3. Distinguish additive from multiplicative seasonality.
  4. Why can unrestricted Holt trend forecasts become unrealistic at long horizons?
  5. Why is random train–test splitting usually inappropriate for time-series forecasting?

Long Answer Questions

  1. Explain the assumptions, formulas and applications of naïve, drift and moving-average methods.
  2. Describe the recursive equations of Holt’s linear trend method and interpret each state and parameter.
  3. Compare additive and multiplicative Holt–Winters models, including their data requirements and practical selection.
  4. Explain how ETS models are estimated and why initial states and parameter constraints matter.
  5. Discuss the construction, interpretation and limitations of prediction intervals for multi-step forecasts.

Analytical / Application Questions

  1. A monthly series has increasing seasonal amplitude and positive values. Propose a baseline and an exponential-smoothing specification, and justify both choices.
  2. A damped-trend model has a lower RMSE than seasonal naïve at one-step horizons but worse performance at twelve-step horizons. How should a business select and communicate the model?
  3. A retailer’s observed sales fall sharply during stockouts. Explain how this affects estimation, validation and governance, and propose a revised forecasting workflow.

Multiple Choice Questions with Answers

Question 1

Which forecast does the naïve method produce for all future horizons?

A. The average of all historical observations

B. The latest observed value

C. The observation from the same season last year

D. A line fitted through the first and latest observations

Correct Answer: B. The latest observed value

Question 2

For monthly data with stable annual seasonality, what is the usual seasonal period?

A. 4

B. 7

C. 12

D. 52

Correct Answer: C. 12

Question 3

In simple exponential smoothing, a high value of \alpha generally means that the forecast:

A. Responds more quickly to recent observations

B. Ignores the latest observation

C. Imposes a strong seasonal pattern

D. Projects a linear trend indefinitely

Correct Answer: A. Responds more quickly to recent observations

Question 4

Which method explicitly maintains both a level state and a trend state?

A. Simple exponential smoothing

B. Holt’s linear method

C. Seasonal naïve

D. A fixed moving average

Correct Answer: B. Holt’s linear method

Question 5

What is the main purpose of a damping parameter in a damped-trend model?

A. To remove all random errors

B. To make seasonality multiplicative

C. To reduce the long-horizon effect of trend

D. To force the level to equal zero

Correct Answer: C. To reduce the long-horizon effect of trend

Question 6

Multiplicative seasonality is most appropriate when seasonal fluctuations:

A. Have approximately constant absolute size

B. Are proportional to the series level

C. Occur only once

D. Can include negative seasonal states

Correct Answer: B. Are proportional to the series level

Question 7

Which validation design respects the temporal ordering of observations?

A. Randomly assigning every observation to training or test sets

B. Using only the first observation for testing

C. Rolling-origin evaluation

D. Shuffling observations before fitting

Correct Answer: C. Rolling-origin evaluation

Question 8

Which accuracy measure is expressed in the original units of the forecast variable?

A. MAE

B. MAPE

C. A percentage bias ratio

D. A correlation coefficient

Correct Answer: A. MAE

Question 9

For a random walk with independent errors, how does the h-step forecast-error variance generally behave?

A. It is approximately proportional to h

B. It is always zero

C. It decreases as h increases

D. It is independent of h by definition

Correct Answer: A. It is approximately proportional to h

Question 10

Why should stockout observations be treated carefully in demand forecasting?

A. They always represent unusually high demand

B. They may censor true demand and appear as misleadingly low sales

C. They eliminate the need for prediction intervals

D. They make seasonal-naïve forecasting impossible

Correct Answer: B. They may censor true demand and appear as misleadingly low sales

Time Series Forecasting
Chapter 5 of 15