Inferensys

Glossary

ARIMA

A classical statistical model for analyzing and forecasting time-series data that leverages autocorrelation, differencing, and moving averages to capture linear patterns in lead time history.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
TIME-SERIES FORECASTING

What is ARIMA?

ARIMA is a classical statistical model for analyzing and forecasting time-series data by leveraging autocorrelation, differencing, and moving averages to capture linear patterns.

An Autoregressive Integrated Moving Average (ARIMA) model is a statistical analysis tool that uses past values and errors to forecast future points in a time series. It decomposes a signal into three components: autoregression (AR) , which models the dependency between an observation and lagged observations; integration (I) , which applies differencing to make the data stationary; and a moving average (MA) , which models the dependency between an observation and residual errors from a moving average model applied to lagged observations.

ARIMA is explicitly designed for univariate data exhibiting stable, linear trends and is specified by the notation ARIMA(p, d, q). The p parameter defines the lag order, d is the degree of differencing required to remove trends, and q defines the order of the moving average window. While highly effective for stable demand patterns, ARIMA struggles with non-linear volatility and requires manual intervention to handle concept drift, often serving as a baseline before deploying more complex models like LSTM or Temporal Fusion Transformers.

CORE PROPERTIES

Key Characteristics of ARIMA Models

ARIMA models are defined by three core components—autoregression, integration, and moving averages—that work together to capture linear patterns in stationary time-series data.

01

Autoregressive (AR) Component

The AR term models the dependency between an observation and a specified number of lagged observations (p). It captures the momentum or inertia in a time series.

  • Mechanism: Regresses the variable on its own prior values
  • Parameter p: The number of lag observations included in the model
  • Example: A lead time series where today's delay is correlated with yesterday's delay uses AR(1)
  • Diagnostic: Identified by decaying spikes in the Partial Autocorrelation Function (PACF) plot
02

Integrated (I) Differencing

The I component applies differencing to make a non-stationary time series stationary by removing trend and seasonality. This is a critical preprocessing step before modeling.

  • Order d: The number of times the data is differenced
  • First-order differencing: Subtracts the previous observation from the current one
  • Stationarity requirement: ARIMA assumes constant mean, variance, and autocorrelation over time
  • Over-differencing risk: Excessive differencing introduces unnecessary noise and reduces forecast accuracy
03

Moving Average (MA) Component

The MA term models the dependency between an observation and the residual errors from a moving average applied to lagged forecast errors (q). It captures shock effects.

  • Mechanism: Uses past forecast errors to correct future predictions
  • Parameter q: The size of the moving average window of error terms
  • Example: A one-time port closure creates a shock that propagates through subsequent lead time forecasts
  • Diagnostic: Identified by a sharp cutoff in the Autocorrelation Function (ACF) plot after lag q
04

Seasonal ARIMA (SARIMA)

SARIMA extends the standard ARIMA framework by adding seasonal autoregressive, differencing, and moving average terms to capture repeating cyclical patterns.

  • Notation: SARIMA(p,d,q)(P,D,Q)m where m is the seasonal period
  • Seasonal P,D,Q: Separate parameters for the seasonal component
  • Example: Monthly lead time data with annual seasonality uses m=12
  • Application: Critical for supply chains with predictable seasonal demand spikes like holiday retail or agricultural harvest cycles
05

Box-Jenkins Methodology

The systematic three-stage approach for building ARIMA models, developed by statisticians George Box and Gwilym Jenkins in 1970.

  • Stage 1 - Identification: Use ACF and PACF plots to determine initial p, d, q values
  • Stage 2 - Estimation: Fit the model parameters using maximum likelihood estimation
  • Stage 3 - Diagnostic Checking: Analyze residuals to confirm they resemble white noise with no remaining autocorrelation
  • Iterative process: The cycle repeats until residuals are statistically indistinguishable from random noise
06

Stationarity and the Augmented Dickey-Fuller Test

The Augmented Dickey-Fuller (ADF) test is the standard statistical hypothesis test used to verify that a differenced series has achieved stationarity before fitting an ARIMA model.

  • Null hypothesis: The time series has a unit root and is non-stationary
  • Interpretation: A p-value below 0.05 rejects the null, confirming stationarity
  • Practical use: Determines the required differencing order d
  • Limitation: ARIMA cannot model structural breaks or regime changes without manual intervention
MODEL SELECTION GUIDE

ARIMA vs. Modern Forecasting Alternatives

Comparative analysis of ARIMA against contemporary machine learning approaches for lead time forecasting, highlighting key architectural differences and deployment considerations.

FeatureARIMAGradient Boosting (GBM)Temporal Fusion Transformer (TFT)

Model Family

Classical Statistical

Ensemble Tree-Based

Attention-Based Deep Learning

Handles Non-Linear Patterns

Native Uncertainty Quantification

Exogenous Variable Support

Multi-Horizon Forecasting

Interpretability

High (coefficients)

Medium (feature importance)

High (attention weights)

Cold-Start Performance

Poor (needs 50+ obs)

Moderate

Poor (needs large data)

Training Speed

< 1 sec

Seconds to minutes

Minutes to hours

ARIMA FORECASTING

Frequently Asked Questions

Clear, technical answers to the most common questions about ARIMA modeling for supply chain time-series analysis.

ARIMA (Autoregressive Integrated Moving Average) is a classical statistical model for analyzing and forecasting univariate time-series data. It decomposes a time series into three components: Autoregression (AR), which models the dependency between an observation and a specified number of lagged observations; Integration (I), which applies differencing to make the series stationary by removing trends; and Moving Average (MA), which models the dependency between an observation and the residual errors from a moving average applied to lagged observations. The model is denoted as ARIMA(p,d,q), where p is the order of the AR term, d is the degree of differencing, and q is the order of the MA term. For lead time forecasting, ARIMA captures linear patterns in historical supplier delivery data to project future performance.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.