Inferensys

Glossary

Content Delivery Network (CDN)

A geographically distributed network of proxy servers that caches content close to end-users, drastically reducing latency and origin server load for static and dynamic assets.
Accountant using AI for financial close automation, accounting software on screen, home office evening work session.
INFRASTRUCTURE

What is Content Delivery Network (CDN)?

A geographically distributed network of proxy servers that caches content close to end-users, drastically reducing latency and origin server load for static and dynamic assets.

A Content Delivery Network (CDN) is a geographically distributed group of servers that work together to provide fast delivery of internet content by caching files in edge locations close to end-users. When a user requests content, the CDN serves it from the nearest Point of Presence (PoP) rather than the origin server, minimizing round-trip time and reducing bandwidth consumption.

Modern CDNs extend beyond static asset caching to support dynamic content acceleration, edge compute via serverless functions, and security features like DDoS mitigation and Web Application Firewalls (WAF). By terminating user connections at the edge and maintaining persistent, optimized connections to the origin, CDNs dramatically improve Time to First Byte (TTFB) and overall application resilience.

BEYOND BASIC CACHING

Core Capabilities of a CDN

A modern Content Delivery Network is a globally distributed application platform, not just a cache. It provides a suite of capabilities to accelerate, secure, and intelligently route traffic at the network edge.

01

Static & Dynamic Content Caching

The foundational capability. CDNs cache static assets (images, CSS, JS) on edge servers close to users. Modern CDNs also intelligently cache dynamic content by following cache-control headers, using stale-while-revalidate directives to serve fast, slightly outdated content while asynchronously fetching a fresh version from the origin. This drastically reduces origin load and time-to-first-byte (TTFB).

< 20ms
Typical Edge Latency
03

Edge-Side Includes (ESI)

A markup language that enables dynamic content assembly at the edge. An ESI tag in an HTML page instructs the CDN edge server to fetch and assemble a fragment from another URL before delivering the final page. This allows a page with a highly dynamic shopping cart (TTL: 0s) and a static product description (TTL: 1 day) to be composed from separately cached pieces, maximizing cache hit ratios.

99.9%
Target Cache Hit Ratio
05

Image & Code Optimization

Modern CDNs perform real-time content transformation on the edge. This includes:

  • Image optimization: Automatically converting to next-gen formats like WebP/AVIF, resizing, and compressing images based on the client's device.
  • Code minification: Stripping whitespace and comments from JavaScript, CSS, and HTML.
  • HTTP/3 prioritization: Serving assets using the latest multiplexed protocol for faster loading.
60%
Avg. Image Payload Reduction
CDN ESSENTIALS

Frequently Asked Questions

Clear, technically precise answers to the most common questions about Content Delivery Networks, their architecture, and their role in modern web infrastructure.

A Content Delivery Network (CDN) is a geographically distributed group of proxy servers and their data centers that work together to deliver internet content—especially static assets like HTML pages, JavaScript files, stylesheets, images, and videos—to users based on their geographic location. The core mechanism is caching: an origin server holds the definitive version of a resource, and edge servers (also called Points of Presence or PoPs) store copies. When a user requests content, an Anycast DNS system routes the request to the topologically nearest edge server. If the content is cached and fresh, the edge serves it directly, drastically reducing Time to First Byte (TTFB). If not, the edge retrieves it from the origin, caches it, and delivers it to the user. This process offloads traffic from the origin infrastructure, absorbs Distributed Denial-of-Service (DDoS) attacks, and reduces latency by minimizing the physical distance data packets must travel.

INFRASTRUCTURE COMPARISON

CDN vs. Related Infrastructure Concepts

Distinguishing a Content Delivery Network from adjacent caching, compute, and assembly technologies in a dynamic content architecture.

FeatureContent Delivery Network (CDN)Edge Compute PlatformHeadless CMS

Primary Function

Caching and delivering static/dynamic assets near the user to reduce latency

Executing application logic and processing data at the network edge

Storing and managing structured content, delivering it via API

Content Assembly Location

Edge (via Edge-Side Includes) or Origin Server

Edge

Client-side or Application Server

State Management

Cache Invalidation Mechanism

Surrogate Keys, TTL, Purge by URL

Application-level logic

Webhooks triggering static regeneration or CDN purge

Typical Latency

< 30 ms

< 50 ms

50-200 ms (API call to origin)

Core Protocol

HTTP/3, HTTP/2, TLS 1.3

WebAssembly, V8 Isolates

REST, GraphQL

Dynamic Personalization

Limited (Edge-Side Includes, A/B testing at edge)

Full (Real-time decisioning engines)

null

Origin Server Load

Drastically reduced (80-90% cache hit ratio)

Reduced for compute-heavy tasks

Dependent on caching layer; high without CDN

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.