Inferensys

Glossary

Colocation

The practice of placing trading servers physically adjacent to an exchange's matching engine to minimize the cable length and resulting transmission latency.
Performance engineer optimizing AI latency on laptop, latency charts visible, technical optimization session.
LOW-LATENCY INFRASTRUCTURE

What is Colocation?

Colocation is the practice of placing trading servers physically adjacent to an exchange's matching engine to minimize the cable length and resulting transmission latency.

Colocation is the physical hosting of a trading firm's servers within the same data center as an exchange's core infrastructure. By reducing the physical distance between the algorithmic engine and the matching engine, firms eliminate microsecond delays caused by the speed of light through fiber optic cables. This proximity is the foundational hardware prerequisite for competitive high-frequency trading (HFT) and latency-sensitive execution strategies.

Exchanges rent dedicated rack space and cross-connects to provide deterministic, equal-length cabling to all colocated participants. This infrastructure bypasses public internet routing and commercial telecom networks, replacing them with direct fiber handoffs. The resulting latency reduction enables strategies like latency arbitrage and market making, where the speed of reacting to a quote or executing a cancel-replace loop directly determines profitability.

LOW-LATENCY INFRASTRUCTURE

Key Characteristics of Colocation

Colocation is the foundational infrastructure strategy for latency-sensitive trading, defined by specific physical, operational, and economic characteristics that distinguish it from standard data center hosting.

01

Physical Proximity & Cable Length Minimization

The defining characteristic of colocation is the physical adjacency of the trading server to the exchange's matching engine. Providers run fiber optic cables as short as 50-100 meters directly from the client's cage to the exchange's network patch panel. This eliminates the speed-of-light delays inherent in traversing metropolitan area networks or wide-area networks. The goal is not just being in the same building, but being on the same floor or in the same row to shave off nanoseconds of propagation delay.

~5 ns/m
Fiber Propagation Delay
02

Deterministic Latency & Jitter Control

Colocation environments provide microsecond-level determinism, meaning the time for a data packet to travel from the server to the exchange is not just fast, but highly predictable. Providers engineer the network fabric to eliminate jitter (variance in latency) by using:

  • Cut-through switching instead of store-and-forward
  • Dedicated, non-blocking switch ports
  • Strictly managed buffer allocations
  • Bypassing kernel network stacks with kernel bypass technologies like Solarflare/OpenOnload This predictability is critical for algorithms that rely on precise timing assumptions.
< 1 µs
Typical Jitter Target
03

Cross-Connect Topology & Peering

Colocation centers function as carrier-neutral meet-me rooms where trading firms establish direct physical cross-connects to multiple counterparties. A single cage might house fiber connections to:

  • Exchange matching engines (primary trading venue)
  • Market data feeds (direct feeds bypassing consolidated SIP)
  • Broker execution gateways
  • Dark pool and alternative trading system (ATS) endpoints This creates a hub-and-spoke topology where the firm's server is the center, minimizing the hop count to every liquidity destination.
04

Hardware Optimization & FPGA Integration

Colocated servers are not commodity hardware. They are purpose-built for speed, often featuring:

  • Overclocked CPUs with liquid cooling to sustain turbo frequencies
  • Field-Programmable Gate Arrays (FPGAs) for hardware-accelerated order entry, parsing, and risk checks
  • Network Interface Cards (NICs) with on-board timestamping at nanosecond precision (e.g., PTP/IEEE 1588)
  • Precision Time Protocol (PTP) grandmaster clocks for synchronized time across the cage The software stack is stripped down to a bare minimum, often running a real-time operating system or a heavily customized Linux kernel with isolated CPU cores.
FPGA
Hardware Acceleration Standard
05

Economic Model: Premium Pricing for Speed

Colocation is a high-cost, high-barrier-to-entry service. Exchanges charge significant monthly recurring fees for rack space, power, and cross-connects that far exceed standard data center rates. The pricing model reflects the scarcity of physical space near the matching engine. Costs include:

  • Cage/Rack fees: Premium per-square-foot pricing
  • Cross-connect fees: Monthly charges per physical fiber connection
  • Market data fees: Direct feed licenses are separate and substantial
  • Power density premiums: High-performance hardware draws significant kW per rack This creates a natural economic moat where only firms with strategies that can monetize microsecond advantages can justify the expense.
$10k-$50k+
Monthly Colocation Cost Range
06

Regulatory & Fair Access Frameworks

To prevent colocation from becoming an unfair structural advantage, regulators like the SEC (Regulation SCI) and ESMA (MiFID II) impose strict requirements on exchanges:

  • Equal access: All firms must be offered the same colocation services at the same price
  • Latency equalization: Exchanges often introduce intentional delays or speed bumps to neutralize extreme speed advantages
  • Disclosure: Exchange colocation offerings, fees, and latency characteristics must be publicly documented
  • Surveillance: Regulators monitor for any preferential treatment or hidden latency advantages This ensures colocation remains a level playing field for all participants willing to pay the entry cost.
COLOCATION ESSENTIALS

Frequently Asked Questions

Clear answers to the most common technical and strategic questions about exchange colocation for latency-sensitive trading operations.

Colocation is the practice of placing trading servers in a data center physically adjacent to an exchange's matching engine to minimize signal propagation delay. By reducing the physical cable length between the trading system and the exchange gateway, firms eliminate microseconds of transmission latency that would otherwise be incurred over metropolitan or wide-area networks. This proximity ensures that market data reaches the trading algorithm and orders reach the exchange with the lowest possible deterministic latency. Colocation is a foundational infrastructure requirement for high-frequency trading (HFT) strategies, where the speed of reacting to quote changes directly determines profitability. Exchanges like NYSE, NASDAQ, CME, and Eurex operate dedicated colocation facilities with standardized rack space, power, and cross-connect options.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.