Inferensys

Glossary

Data Gravity

Data gravity is the observation that large datasets and the applications that serve them attract other services and processing, making it architecturally and economically difficult to move data across jurisdictional boundaries.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
ARCHITECTURAL PRINCIPLE

What is Data Gravity?

Data gravity is the observation that large datasets and the services that serve them attract other applications and processing, making it architecturally and economically difficult to move data across jurisdictional boundaries.

Coined by engineer Dave McCrory, data gravity describes how the mass of a dataset exerts a pull on compute resources, much like a planet's gravity attracts objects. As data accumulates in a specific geofenced data pipeline or storage location, latency-sensitive services, analytics engines, and dependent applications are forced to move closer to the data source to avoid costly and slow network transfers. This gravitational pull creates an architectural inertia that directly reinforces data residency and data sovereignty requirements.

In the context of sovereign artificial intelligence infrastructure, data gravity is a critical design constraint. Attempting to relocate a petabyte-scale training corpus across a cross-border data transfer link is often infeasible due to bandwidth costs and regulatory prohibition. Consequently, data gravity dictates that model training and inference must occur within the same compliance zoning boundary as the data, solidifying the need for localized, on-premises GPU clusters and air-gapped processing environments.

THE PHYSICS OF DIGITAL MASS

Key Characteristics of Data Gravity

Data gravity describes the attractive force that large datasets exert on applications, services, and other data. As data accumulates, it becomes architecturally and economically prohibitive to move, creating an inescapable pull that shapes infrastructure decisions and jurisdictional compliance strategies.

01

The Mass-Velocity Relationship

The gravitational pull of a dataset is directly proportional to its mass (volume) and inversely proportional to the latency tolerance of its consuming applications. A petabyte-scale data lake with sub-millisecond query requirements exerts immense gravity, effectively anchoring all dependent services to its physical location.

  • Transactional systems requiring ACID compliance cannot tolerate cross-region latency
  • Analytics engines processing terabyte-scale joins must be co-located with storage
  • Real-time inference pipelines collapse if separated from feature stores by high-latency links

This relationship explains why simply copying data across jurisdictions fails—the applications and their performance contracts must move with the data, or the data must stay put.

Latency × Volume
Gravity Formula
02

Jurisdictional Entrapment

Once a dataset reaches critical mass within a specific legal jurisdiction, data residency regulations and cross-border transfer restrictions compound the physical gravity with legal gravity. The dataset becomes doubly anchored—by both physics and policy.

  • GDPR and similar frameworks impose transfer impact assessments that add friction to any movement
  • Data localization mandates in countries like Russia, China, and India create absolute legal barriers
  • Sectoral regulations (HIPAA, PCI-DSS) layer additional compliance requirements on top of geographic constraints

The result is a sovereign gravity well: data that cannot legally leave its jurisdiction, forcing all processing infrastructure to be deployed within the same legal boundary.

160+
Countries with Data Localization Laws
03

The Service Accretion Effect

Data gravity creates a self-reinforcing cycle of service accretion. As a dataset grows, it attracts analytical workloads, which generate derived datasets, which attract machine learning training pipelines, which produce models, which attract inference services.

  • ETL pipelines cluster around source data to minimize egress costs
  • Feature stores materialize alongside data lakes to serve ML training jobs
  • Vector databases index embeddings in the same region as the raw corpus
  • Monitoring and observability stacks deploy adjacent to production data planes

This accretion disk of services makes migration exponentially more complex over time. Moving the core dataset requires relocating an entire ecosystem of interdependent applications.

Exponential
Migration Complexity Growth
04

Egress Cost Economics

Cloud providers impose data egress fees that create a powerful economic disincentive to move large datasets. At scale, these costs can exceed the entire infrastructure budget, making data gravity a function of financial gravity as well.

  • AWS, Azure, and GCP charge per-GB fees for data leaving their networks
  • Cross-region replication incurs both egress and ingress charges on both ends
  • Inter-cloud migration projects routinely face six-to-seven-figure egress bills
  • Content delivery networks partially mitigate read-heavy workloads but do not solve write-path gravity

This economic barrier is intentional—cloud providers design pricing models to increase switching costs and reinforce data gravity within their ecosystems.

$0.05–$0.12/GB
Typical Cloud Egress Rates
06

The Anti-Gravity of Stateless Compute

While data exerts gravity, stateless compute remains relatively weightless. Containerized microservices, serverless functions, and inference endpoints can be deployed anywhere—as long as they can reach their data dependencies within acceptable latency budgets.

  • Kubernetes clusters can span regions but struggle with data locality for stateful workloads
  • CDN-edge functions execute close to users but must call back to regional data stores
  • Model inference is portable, but model training is gravitationally bound to training data
  • Caching layers create temporary anti-gravity by holding hot data near compute, but cache invalidation eventually reasserts gravitational pull

The strategic insight: invest in making compute portable while accepting that data will remain anchored. Design systems where the weightless layer can be repositioned as jurisdictional requirements evolve.

DATA GRAVITY

Frequently Asked Questions

Clear, technical answers to the most common questions about the architectural and economic forces that bind large datasets to their location and the services that surround them.

Data gravity is the observation that the mass of a dataset—its size and velocity—exerts an attractive force on applications, services, and other data. As data accumulates in a specific location, it becomes architecturally and economically prohibitive to move it. Instead, processing and analytics are pulled toward the data. This concept, coined by Dave McCrory in 2010, operates analogously to physical gravity: a small dataset has negligible pull, but a petabyte-scale data lake generates immense gravitational force. The cost and latency of transferring terabytes across a Wide Area Network (WAN) far exceed the cost of co-locating compute. Consequently, microservices, ETL pipelines, and even entire Kubernetes clusters are deployed adjacent to the data source to minimize network egress and maximize throughput.

CONCEPTUAL DISTINCTIONS

Data Gravity vs. Related Sovereign Data Concepts

How data gravity differs from and relates to other sovereign data architecture concepts that influence data movement and jurisdictional control

ConceptData GravityData ResidencyData SovereigntyData Localization

Core Definition

Large datasets attract services and processing, creating economic and architectural inertia against movement

Legal requirement that data be stored and processed within specific geographic boundaries

Principle that data is subject to the laws of the nation where it is physically located

Strict mandate that data must remain within a country's borders, often prohibiting any cross-border transfer

Primary Driver

Physics and economics of data volume, latency, and throughput

Regulatory compliance and legal frameworks

National jurisdictional authority and governance

Government mandate and data protectionism

Enforcement Mechanism

Architectural constraints: bandwidth costs, latency penalties, application coupling

Legal contracts, SCCs, BCRs, and Transfer Impact Assessments

National legislation and judicial oversight

Statutory prohibition with legal penalties for non-compliance

Cross-Border Transfer

Technically possible but economically prohibitive and architecturally disruptive

Permitted with adequate safeguards and legal mechanisms in place

Allowed only if destination jurisdiction provides equivalent legal protection

Generally prohibited; no transfer permitted even for backup or remote access

Scope of Concern

All data types: the mass and velocity of the dataset itself

Personal data and regulated categories under specific laws like GDPR

All data physically located within national territory

All data originating from or pertaining to a nation's citizens or operations

Technical Mitigation

Regional sharding, edge processing, data locality scheduling, distributed query federation

Geofencing, data residency locks, compliance zoning, egress filtering

Sovereign cloud architectures, customer-managed keys, data plane isolation

Air-gapped processing, on-premises deployment, local-only storage tiers

Relationship to Data Gravity

The phenomenon itself

Creates legal boundaries that compound data gravity by restricting where data can accumulate

Establishes the legal ownership framework that determines who controls the gravitational center

Imposes the strictest physical boundaries, maximizing data gravity within a single jurisdiction

Failure Consequence

Degraded application performance, excessive egress costs, architectural brittleness

Regulatory fines, legal liability, loss of data processing permissions

Loss of jurisdictional control, foreign government access to citizen data

Criminal penalties, forced operational shutdown, sovereign data breach

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.