Inferensys

Glossary

Cloud Motion Vector (CMV)

A technique that derives wind velocity fields by tracking the displacement of cloud features in consecutive sky imagery or satellite frames to advect cloud fields for short-term irradiance prediction.
Data engineer managing feature store on laptop, feature definitions visible, casual data engineering session.
SKY IMAGERY ANALYSIS

What is Cloud Motion Vector (CMV)?

A computer vision technique that derives atmospheric wind velocity fields by tracking the displacement of cloud features in consecutive sky images or satellite frames to advect cloud fields for short-term irradiance prediction.

A Cloud Motion Vector (CMV) is a two-dimensional velocity field derived by applying optical flow algorithms—such as Lucas-Kanade or phase correlation—to sequential hemispherical sky imagery or geostationary satellite frames. The technique identifies and tracks distinct cloud features between consecutive images to estimate the pixel-wise displacement vector, effectively measuring the apparent motion of clouds across the image plane.

In solar forecasting, CMVs are used to advect current cloud fields forward in time, predicting future cloud positions and their associated shadow impacts on photovoltaic arrays for horizons of 0 to 60 minutes. By projecting the derived velocity field onto a future time step, grid operators can anticipate irradiance ramp rates and prepare for sudden power fluctuations. The technique is often combined with a Clear Sky Index to isolate cloud-driven attenuation from the diurnal solar cycle.

MECHANICS

Key Characteristics of CMV Forecasting

Cloud Motion Vector (CMV) forecasting is a computer vision technique that derives atmospheric wind fields by tracking the displacement of cloud features in consecutive sky images or satellite frames. These motion vectors are then used to advect cloud fields forward in time for short-term irradiance prediction.

01

Block Matching Algorithm

The foundational computer vision technique that partitions consecutive sky images into pixel sub-regions and identifies the displacement vector that maximizes the cross-correlation coefficient between frames. Normalized Cross-Correlation (NCC) is the standard similarity metric, computed as the dot product of normalized pixel intensities within a search window. The algorithm searches a bounded neighborhood in the subsequent frame to find the best match, generating a sparse velocity field. Multi-scale pyramidal implementations refine coarse displacements at reduced resolutions before fine-tuning at full resolution, dramatically reducing computational cost while capturing both small cumulus and large stratus advection.

16×16 px
Typical Block Size
32 px
Search Window Radius
02

Optical Flow Estimation

A dense motion estimation alternative to block matching that computes a velocity vector for every pixel by solving the brightness constancy constraint equation. The Horn-Schunck method imposes a global smoothness regularization term, while the Lucas-Kanade method assumes constant flow within a local neighborhood and solves an overdetermined least-squares system. Modern deep optical flow architectures like RAFT (Recurrent All-Pairs Field Transforms) use iterative residual refinement with correlation volumes to produce state-of-the-art dense flow fields. Optical flow captures non-rigid cloud deformation that rigid block matching misses, improving advection fidelity for shearing and convective cloud fields.

Dense
Vector Field Density
03

Cloud Advection and Extrapolation

Once the 2D motion field is derived, the current cloud map is propagated forward in time using a semi-Lagrangian advection scheme. Each pixel in the forecast frame is computed by tracing its trajectory backward along the velocity field to sample the source image at fractional coordinates, typically using bilinear interpolation. The core assumption is Lagrangian persistence—that cloud brightness patterns are conserved as they translate, ignoring formation, dissipation, and vertical development. This assumption holds for lead times of 0–60 minutes before convective evolution dominates. The advected cloud map is then converted to a Clear Sky Index field by applying a transmittance model, which is multiplied by the theoretical clear-sky irradiance to produce the final GHI forecast.

0–60 min
Effective Forecast Horizon
< 1 min
Update Cadence
04

Sky Imager Hardware

Ground-based CMV systems rely on Total Sky Imagers (TSI) or All-Sky Cameras equipped with fisheye lenses and hemispherical mirrors to capture the full sky dome in a single frame. Modern systems use high-dynamic-range (HDR) sensors to prevent saturation near the solar disk and spectral filters (typically 650 nm red band) to maximize cloud-sky contrast. The raw circular image undergoes geometric calibration to map pixel coordinates to zenith and azimuth angles, correcting for lens distortion. Paired with a shadowband or occulting disk to block direct sunlight, these imagers capture images every 15–30 seconds, providing the high temporal resolution necessary to track cloud motion before features decorrelate.

15–30 sec
Image Capture Interval
180°
Field of View
05

Satellite-Derived CMVs

Geostationary satellites like GOES-16/17 and Meteosat provide CMV inputs at continental scales by tracking cloud features across sequential multispectral images. The Advanced Baseline Imager (ABI) captures full-disk scans every 10 minutes across 16 spectral bands, enabling motion vector derivation for multiple atmospheric levels. Atmospheric Motion Vectors (AMVs) are operationally produced by numerical weather prediction centers by tracking water vapor and infrared channel features. These satellite-derived vectors are assimilated into NWP models but can also drive standalone advection forecasts for utility-scale solar plants, offering a spatially continuous alternative to ground-based sky imagers without the need for on-site hardware deployment.

10 min
Full-Disk Scan Interval
0.5–2 km
Spatial Resolution
06

Hybrid CMV-NWP Fusion

Operational forecasting systems combine CMV advection with Numerical Weather Prediction (NWP) using a nowcasting-blending framework. CMV dominates the 0–2 hour horizon where its high-resolution cloud tracking outperforms NWP's delayed spin-up. NWP takes over at 2–6 hours as its physics-based convection schemes capture cloud formation and dissipation that pure advection misses. The transition uses an exponential weighting function that smoothly interpolates between the two forecasts based on lead time. Advanced implementations use a dynamic weighting approach where the blending factor is a function of the local convective available potential energy (CAPE), giving more weight to NWP during unstable conditions when cloud evolution is rapid.

0–2 hrs
CMV Dominant Window
2–6 hrs
NWP Transition Zone
CLOUD MOTION VECTOR FUNDAMENTALS

Frequently Asked Questions

Core concepts and operational mechanisms behind cloud motion vector derivation for short-term solar irradiance forecasting.

A Cloud Motion Vector (CMV) is a two-dimensional velocity field that quantifies the speed and direction of cloud movement by tracking the displacement of pixel patterns between consecutive sky images or satellite frames. The derivation process begins with image acquisition from a Total Sky Imager (TSI) or geostationary satellite, followed by preprocessing steps including lens calibration, masking of the sun and static occlusions, and contrast enhancement. The core algorithm applies block matching or optical flow techniques—such as the Lucas-Kanade method or phase correlation—to identify the translation vector that maximizes the cross-correlation coefficient between a template block in the first image and candidate blocks in the subsequent image. The resulting vector field is then quality-controlled by removing outliers through median filtering and spatial interpolation, producing a dense motion field that represents the advection of cloud structures across the sensor's field of view.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.