Inferensys

Glossary

Polynomial Chaos Expansion (PCE)

A spectral method that represents a stochastic system's response as a series of orthogonal polynomials in the random input variables, enabling efficient calculation of output statistics.
Developer building agentic RAG system, retrieval pipeline diagram on laptop, technical workspace with notes.
SPECTRAL UNCERTAINTY QUANTIFICATION

What is Polynomial Chaos Expansion (PCE)?

A spectral method that represents a stochastic system's response as a series of orthogonal polynomials in the random input variables, enabling efficient calculation of output statistics.

Polynomial Chaos Expansion (PCE) is a surrogate modeling technique that approximates the output of a computational model—such as a probabilistic power flow solver—as a truncated series of multivariate orthogonal polynomials. By projecting the stochastic response onto a basis of polynomials that are orthogonal with respect to the probability density function of the random inputs, PCE provides an analytical representation of the output's statistical moments.

Unlike Monte Carlo Simulation, which requires thousands of model evaluations to converge, PCE computes the mean, variance, and Sobol Indices directly from the expansion coefficients, often using a fraction of the computational cost. The method is classified as intrusive when it modifies the governing equations, or non-intrusive when it treats the model as a black box and estimates coefficients via regression or Stochastic Collocation.

SPECTRAL UNCERTAINTY QUANTIFICATION

Key Features of Polynomial Chaos Expansion

Polynomial Chaos Expansion (PCE) is a spectral method that represents a stochastic system's response as a series of orthogonal polynomials in the random input variables, enabling efficient calculation of output statistics.

01

Spectral Convergence Rate

Unlike Monte Carlo Simulation which converges at a rate of 1/√N, PCE achieves exponential convergence for smooth functions. This means a PCE with only tens or hundreds of terms can match the accuracy of millions of random samples.

  • Error decay: O(e^(-αN)) for analytic functions vs. O(1/√N) for Monte Carlo
  • A 10-dimensional problem often requires only ~100-1000 model evaluations
  • Exploits the inherent smoothness of power flow equations under normal operating conditions
100-1000x
Fewer evaluations than Monte Carlo
02

Orthogonal Polynomial Basis

PCE selects polynomial families that are orthogonal with respect to the probability density function of each input random variable, maximizing approximation accuracy.

  • Hermite polynomials for Gaussian distributions (load forecast errors)
  • Legendre polynomials for uniform distributions (solar irradiance bounds)
  • Laguerre polynomials for Gamma distributions (wind speed squared)
  • Jacobi polynomials for Beta distributions (cloud cover fraction)

The Askey scheme provides the optimal polynomial-to-distribution mapping, ensuring the expansion captures the statistical moments with minimal terms.

03

Non-Intrusive Implementation

PCE can be applied as a black-box wrapper around existing deterministic power flow solvers without modifying their internal code. This non-intrusive approach treats the solver as an oracle.

  • Spectral projection: Compute expansion coefficients via numerical integration using quadrature rules
  • Stochastic collocation: Evaluate the solver at carefully chosen collocation points and solve a least-squares regression
  • Smolyak sparse grids: Reduce the curse of dimensionality by using a subset of the full tensor-product grid
  • Compatible with any commercial power system software (PSS/E, PowerFactory, OpenDSS)
04

Statistical Moment Extraction

Once the PCE coefficients are computed, all statistical moments of the output are available analytically without further sampling. The mean, variance, skewness, and kurtosis are derived directly from the polynomial coefficients.

  • Mean: Equal to the zeroth-order coefficient (μ = c₀)
  • Variance: Sum of squares of all non-zero-order coefficients (σ² = Σ c²ᵢ ||ψᵢ||²)
  • Sobol sensitivity indices: Computed by grouping coefficients belonging to each input variable
  • PDF reconstruction: Evaluate the polynomial surrogate millions of times at negligible cost to build histograms or kernel density estimates
c₀
Mean = zeroth coefficient
05

Sparse Truncation Strategies

Full tensor-product expansions suffer from the curse of dimensionality — the number of terms grows exponentially with input dimension. Sparse truncation schemes retain only the most significant polynomial interactions.

  • Total-order truncation: Keep all polynomials where the sum of degrees ≤ p (reduces terms from (p+1)^d to (d+p)!/(d!p!))
  • Hyperbolic truncation: Use q-quasinorm (q < 1) to penalize high-order interactions, favoring main effects
  • Low-rank Smolyak: Exploit anisotropic importance where some input variables dominate the output variance
  • For a 20-dimensional problem with p=3, total-order truncation reduces terms from ~3.5 billion to 1,771
1,771
Terms for d=20, p=3 (total-order)
06

Adaptive Sparse PCE

Modern implementations use adaptive basis selection to iteratively enrich the polynomial basis only in directions that reduce the approximation error, avoiding wasted terms on irrelevant dimensions.

  • Least Angle Regression (LARS): Greedily selects basis functions most correlated with the residual
  • Basis-adaptive methods: Start with a low-order expansion and add higher-degree terms only where needed
  • Leave-one-out cross-validation error: Used as a stopping criterion without requiring a separate test set
  • Particularly effective for high-dimensional power grids where only a few uncertain injections dominate the voltage variance
PCE CLARIFIED

Frequently Asked Questions

Concise answers to the most common technical questions about Polynomial Chaos Expansion and its role in stochastic power system analysis.

Polynomial Chaos Expansion (PCE) is a spectral method that represents a stochastic system's response—such as a bus voltage in a power grid—as a series of orthogonal polynomials in the random input variables. Instead of running thousands of brute-force Monte Carlo simulations, PCE constructs a surrogate model that directly maps uncertain inputs (like wind speed or load) to output statistics.

  • Mechanism: The method projects the model output onto a basis of polynomials (e.g., Hermite, Legendre) that are orthogonal with respect to the probability density function of the inputs.
  • Efficiency: Once the expansion coefficients are computed—typically via Stochastic Collocation or Galerkin projection—the mean, variance, and Sobol sensitivity indices can be calculated analytically from the coefficients without further sampling.
  • Application: In probabilistic power flow, PCE replaces the iterative Newton-Raphson solver with a polynomial function that can be evaluated millions of times per second to compute risk metrics like Conditional Value at Risk (CVaR).
Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.