Inferensys

Glossary

Mean Absolute Percentage Error (MAPE)

A scale-independent accuracy metric that measures the average absolute percentage difference between forecasted and actual lead times, commonly used to benchmark model performance.
ML engineer running AI model benchmarks, performance charts on multiple screens, late night home office setup.
FORECAST ACCURACY METRIC

What is Mean Absolute Percentage Error (MAPE)?

MAPE is a scale-independent accuracy metric that measures the average absolute percentage difference between forecasted and actual lead times, commonly used to benchmark model performance.

Mean Absolute Percentage Error (MAPE) is a statistical measure of prediction accuracy that calculates the average of the absolute percentage errors between forecasted values and actual observed outcomes. It expresses accuracy as a percentage, making it intuitively interpretable and scale-independent, which allows for direct comparison of model performance across datasets with different units or magnitudes.

MAPE is computed by summing the absolute differences between each forecast and its corresponding actual value, dividing each by the actual value, and averaging the results across all observations. While widely used for its interpretability, MAPE has known limitations: it is undefined when actual values are zero, penalizes over-forecasts and under-forecasts asymmetrically, and can produce infinite or misleading values when actuals approach zero.

Scale-Independent Accuracy

Key Properties of MAPE

Mean Absolute Percentage Error (MAPE) is a widely used metric for evaluating forecast accuracy. Its key properties make it particularly suitable for benchmarking lead time prediction models across diverse product portfolios and supply chain nodes.

01

Scale Independence

MAPE expresses error as a percentage, making it inherently scale-independent. This allows for direct accuracy comparisons between forecasts for items with vastly different lead times—for example, comparing a 2-day domestic transit forecast against a 45-day ocean freight forecast. Unlike scale-dependent metrics such as Mean Absolute Error (MAE) or Root Mean Squared Error (RMSE), MAPE normalizes the error by the actual value, enabling cross-SKU and cross-supplier benchmarking without requiring data standardization.

02

Intuitive Interpretability

A MAPE of 15% communicates immediately to supply chain stakeholders that the average forecast deviates from the actual lead time by 15%. This percentage-based interpretation bridges the gap between data science teams and business planners. When a procurement director sees that a supplier's lead time forecast has a MAPE of 8%, they can intuitively grasp the model's precision without needing to understand the underlying statistical mechanics. This interpretability makes MAPE the default metric in many executive dashboards and Supplier Reliability Scorecards.

03

Undefined at Zero

A critical limitation of MAPE is that it becomes undefined when the actual value is zero. The formula divides by the actual value, so any period with zero actual lead time causes a division-by-zero error. In supply chain contexts, this occurs when a shipment is recorded with a lead time of 0 days due to data entry errors or same-day deliveries. To handle this, practitioners often:

  • Exclude zero-actual observations from the calculation
  • Apply a small epsilon value to avoid division by zero
  • Use symmetric MAPE (sMAPE) as an alternative bounded metric
04

Asymmetric Penalty

MAPE imposes an asymmetric penalty on over-forecasts versus under-forecasts. When the forecast exceeds the actual value (over-forecast), the error is capped at 100% if the forecast is double the actual. However, when the forecast is lower than the actual (under-forecast), there is no upper bound—the percentage error can exceed 100% arbitrarily. This asymmetry means MAPE inherently penalizes under-forecasting more severely. In lead time prediction, this property can be advantageous when late deliveries carry higher business costs than early arrivals.

05

Sensitivity to Outliers

MAPE uses the absolute value of percentage errors, which provides some robustness against outliers compared to squared-error metrics like RMSE. However, individual observations with very small actual values can produce disproportionately large percentage errors that skew the aggregate metric. For example, if an actual lead time is 1 day and the forecast is 3 days, that single observation contributes a 200% error. Techniques to mitigate this include:

  • Winsorizing extreme percentage errors at a threshold (e.g., 100%)
  • Using weighted MAPE (WMAPE) to prioritize high-volume items
  • Complementing MAPE with Prediction Intervals for uncertainty quantification
06

Weighted MAPE (WMAPE)

Standard MAPE treats all observations equally, which can be problematic when forecasting lead times for items with vastly different business importance. Weighted MAPE (WMAPE) addresses this by weighting each percentage error by the actual value or another relevance metric such as revenue impact or order volume. The formula becomes: Σ(weight × |Actual - Forecast|) / Σ(weight × Actual). In supply chain applications, WMAPE ensures that a 10% error on a high-volume critical component is prioritized over a 10% error on a low-volume consumable, aligning model evaluation with business impact.

MAPE EXPLAINED

Frequently Asked Questions

Clear, concise answers to the most common questions about Mean Absolute Percentage Error and its application in predictive lead time analytics.

Mean Absolute Percentage Error (MAPE) is a scale-independent accuracy metric that measures the average absolute percentage difference between forecasted and actual values. It is calculated by summing the absolute percentage errors for each observation and dividing by the number of observations: MAPE = (1/n) * Σ |(Actual - Forecast) / Actual| * 100. Because the error is expressed as a percentage, MAPE allows you to compare the accuracy of forecasting models across different scales—for example, comparing a model predicting lead times in days against one predicting transit times in hours. A MAPE of 10% means that, on average, the forecast deviates from the actual value by 10%. However, MAPE has a significant limitation: it is undefined when any actual value is zero, and it penalizes over-forecasts and under-forecasts asymmetrically, making it less suitable for intermittent demand patterns.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.