Inferensys

Glossary

Synthetic Aggregate Data Generation

The algorithmic creation of realistic total power consumption signals by combining real or simulated appliance load profiles to augment training datasets for Non-Intrusive Load Monitoring (NILM) models.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
DEFINITION

What is Synthetic Aggregate Data Generation?

The algorithmic creation of realistic total power consumption signals by combining real or simulated appliance load profiles to augment training datasets for NILM models.

Synthetic aggregate data generation is the algorithmic process of constructing artificial total power consumption signals by mathematically summing individual appliance load profiles. This technique creates realistic, labeled aggregate data where the exact contribution of each appliance is known, providing ground truth that is impossible to obtain from real-world mains readings alone.

By combining real sub-metered signatures with simulated load profiles based on physical models, this method generates diverse training scenarios covering rare appliance combinations and edge cases. The resulting datasets directly address the critical bottleneck of labeled data scarcity in Non-Intrusive Load Monitoring (NILM), enabling supervised deep learning models to generalize across unseen households.

DATA AUGMENTATION FOR NILM

Key Characteristics of Synthetic Aggregate Data

Synthetic aggregate data generation creates realistic total power consumption signals by combining real or simulated appliance load profiles. This technique overcomes the scarcity of labeled training data that plagues supervised Non-Intrusive Load Monitoring models.

01

Combinatorial Load Mixing

The core mechanism involves linear superposition of individual appliance signatures to form a realistic aggregate signal. A synthetic aggregate $P_{agg}(t)$ is generated as:

$$P_{agg}(t) = \sum_{i=1}^{N} P_i(t) + \epsilon(t)$$

  • $P_i(t)$: The power draw of appliance $i$ at time $t$, drawn from a library of real or simulated load profiles
  • $\epsilon(t)$: Gaussian noise added to simulate sensor imprecision and unmodeled base loads
  • Combinatorial explosion: With just 10 appliances each having 2 states, over 1,024 unique aggregate combinations exist, enabling massive dataset expansion from limited real recordings
10,000+
Synthetic days generated from 30 real days
02

Realistic Temporal Scheduling

Synthetic data must reflect human behavioral patterns and appliance usage rhythms to be useful for training. Key scheduling mechanisms include:

  • Markov chain state transitions: Model the probability of an appliance turning on given the current time of day and previous state
  • Seasonal and diurnal patterns: Heating loads peak in winter mornings; lighting loads dominate evenings
  • Occupancy-driven activation: Simulated occupancy models trigger appliance usage based on the number of active residents
  • Duration modeling: Appliances like dishwashers and washing machines follow characteristic runtime distributions rather than arbitrary on/off toggling

Without realistic scheduling, models trained on synthetic data fail to generalize to real-world consumption patterns.

03

Domain Randomization for Robustness

Domain randomization deliberately varies parameters during synthesis to force NILM models to learn invariant features rather than memorizing specific signatures:

  • Power level perturbation: Vary the steady-state power draw of an appliance by ±15% to simulate manufacturing tolerances and voltage fluctuations
  • Transient shape warping: Apply random scaling and time-stretching to the high-frequency turn-on current spike
  • Background load injection: Add continuously varying loads from unknown devices to prevent the model from relying on a clean residual signal
  • Sampling rate augmentation: Train on mixtures of 1Hz, 1/6Hz, and 1/30Hz data to build sampling-rate-agnostic feature extractors

Models trained with domain randomization consistently outperform those trained on pristine synthetic data when deployed in real homes.

04

Generative Adversarial Synthesis

Beyond rule-based mixing, GAN-based synthesis learns to generate aggregate signals that are statistically indistinguishable from real measurements:

  • Generator network: Takes random noise and conditioning labels (e.g., 'refrigerator + television + lighting') and outputs a synthetic aggregate waveform
  • Discriminator network: Trained to distinguish real aggregate readings from generated ones, pushing the generator toward higher fidelity
  • Conditional GAN architectures: Enable targeted generation of specific appliance combinations, useful for oversampling rare operational states
  • Wasserstein loss: Used instead of standard GAN loss to stabilize training and avoid mode collapse when modeling the complex, multi-modal distribution of household power consumption

GAN-generated aggregates capture subtle correlations and noise characteristics that rule-based methods miss.

05

Privacy-Preserving Data Sharing

Synthetic aggregate generation enables privacy-compliant data sharing between utilities and researchers without exposing sensitive household information:

  • No real occupancy data: Synthetic schedules are statistically representative but not tied to any actual household's behavior patterns
  • Differential privacy guarantees: Noise can be calibrated to provide formal $\epsilon$-differential privacy bounds on the synthetic output
  • Federated synthesis: Individual households generate synthetic data locally; only the synthetic aggregates are shared centrally for model training
  • Regulatory compliance: Synthetic data falls outside GDPR and CCPA definitions of personal data when properly generated, enabling cross-border research collaboration

This approach addresses the fundamental tension between data utility and privacy that has historically limited NILM research.

06

Evaluation Fidelity Metrics

The utility of synthetic aggregate data is measured by how well models trained on it perform on real-world disaggregation tasks:

  • Train-on-synthetic, test-on-real (TSTR): The gold standard evaluation—train a NILM model exclusively on synthetic data and measure its F1-score on real household recordings
  • Distribution similarity: Compare the synthetic and real aggregate distributions using Maximum Mean Discrepancy (MMD) or Wasserstein distance in feature space
  • Event recall: Measure whether synthetic data preserves the frequency and characteristics of appliance state transitions
  • Energy attribution accuracy: Verify that the total energy assigned to each appliance in the synthetic aggregate matches realistic consumption proportions

A low TSTR gap indicates high-fidelity synthesis; a large gap reveals that the synthetic data fails to capture critical real-world complexity.

SYNTHETIC DATA FAQ

Frequently Asked Questions

Clear answers to common questions about generating artificial aggregate power signals for training non-intrusive load monitoring models.

Synthetic aggregate data generation is the algorithmic creation of realistic total power consumption signals by mathematically summing real or simulated individual appliance load profiles. This process produces labeled training datasets where the ground truth for each appliance is perfectly known, bypassing the prohibitive cost and privacy constraints of sub-metering every device in hundreds of real homes. The generated aggregate signal mimics the complex overlapping patterns found in real household mains readings, including steady-state active power, reactive power, and transient harmonics. By controlling the composition, sampling rate, and noise characteristics, engineers can create infinite variations of training data to improve the robustness of non-intrusive load monitoring (NILM) models against unseen appliance combinations and household configurations.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.