Inferensys

Glossary

gRPC Streaming Telemetry

A modern, high-performance protocol for collecting network telemetry data that uses a subscription-based model to stream structured data continuously from devices to a collector, replacing legacy polling methods.
Data scientist building training data pipeline on laptop, data preprocessing visible, technical workspace.
NETWORK MONITORING PROTOCOL

What is gRPC Streaming Telemetry?

gRPC Streaming Telemetry is a modern, high-performance network monitoring protocol that uses a subscription-based model to stream structured data continuously from devices to a collector, replacing legacy polling methods.

gRPC Streaming Telemetry is a data collection framework that establishes a persistent, bidirectional connection between a network device and a collector. Unlike traditional SNMP polling, which requires the collector to periodically request data, this protocol uses a publish-subscribe model where devices push structured time-series data as it changes, dramatically improving scale and efficiency.

The protocol leverages the gRPC framework and Protocol Buffers (protobuf) for compact, strongly-typed data serialization. A collector subscribes to specific sensor paths on a device, and the device streams updates at a cadence defined by the subscription. This enables sub-second granularity for KPI anomaly detection and supports on-change telemetry, where data is sent only when a value changes, minimizing bandwidth.

Protocol Architecture

Key Features of gRPC Streaming Telemetry

gRPC streaming telemetry replaces inefficient polling with a high-performance, subscription-based model that streams structured network data continuously from devices to collectors.

01

Protocol Buffers Serialization

Uses Protocol Buffers (protobuf) as the interface definition language and wire format. This provides a strongly-typed, compact binary encoding that is 3-10x smaller than JSON and significantly faster to serialize/deserialize. The schema is defined in .proto files, which are compiled to generate client and server code in multiple languages. This strict contract eliminates ambiguity in data models and ensures backward-compatible evolution of telemetry paths.

02

Subscription-Based Streaming Model

Operates on a dial-out paradigm where the collector subscribes to specific telemetry paths on the network device. The device then pushes data continuously over a persistent HTTP/2 connection. Subscription types include:

  • ONCE: A single snapshot of current state
  • POLL: On-demand retrieval
  • STREAM: Continuous, low-latency streaming of state changes This eliminates the overhead of periodic SNMP GET requests and enables sub-second cadence for high-resolution data.
03

HTTP/2 Multiplexed Transport

Leverages HTTP/2 as the transport layer, providing native multiplexing of multiple concurrent streams over a single TCP connection. This eliminates head-of-line blocking, reduces connection overhead, and enables bidirectional streaming. The transport also supports TLS 1.3 encryption by default, ensuring all telemetry data is authenticated and encrypted in transit without the performance penalty of separate VPN tunnels.

04

YANG Data Model Integration

Telemetry paths are defined using YANG (RFC 7950) data models, providing a vendor-neutral, structured representation of device configuration and operational state. OpenConfig and IETF YANG models define standardized paths for common network functions. This allows a single collector to subscribe to telemetry from multi-vendor environments without custom parsing logic. The YANG model defines the hierarchy, types, and constraints that protobuf serializes.

05

gNMI Protocol Specification

gRPC Network Management Interface (gNMI) is the standardized service definition for streaming telemetry. It defines four RPCs:

  • Capabilities: Discover supported models and encodings
  • Get: Retrieve a snapshot of state
  • Set: Modify device configuration
  • Subscribe: Stream telemetry updates The Subscribe RPC supports sample (periodic) and on-change (event-driven) modes, with the latter only transmitting data when a value changes, dramatically reducing bandwidth for stable metrics.
06

On-Change vs. Periodic Cadence

Supports two fundamental streaming modes that optimize for different use cases:

  • On-Change (Event-Driven): The device transmits only when a monitored value changes. Ideal for interface state transitions, BGP session flaps, or alarm conditions. Reduces bandwidth by 90%+ compared to fixed-interval polling.
  • Periodic (Sample): The device transmits at a configured interval (e.g., every 10 seconds). Essential for trend analysis, capacity planning, and metrics that change continuously like CPU utilization or throughput counters. Collectors can mix both modes within a single subscription.
PROTOCOL DEEP DIVE

Frequently Asked Questions

Get clear, technically precise answers to the most common questions about gRPC streaming telemetry, its architecture, and how it compares to legacy network monitoring methods.

gRPC streaming telemetry is a modern, high-performance network monitoring protocol that uses a subscription-based model to stream structured data continuously from network devices to a collector, replacing legacy polling methods like SNMP. It works by establishing a persistent bidirectional gRPC channel between a device (server) and a collector (client). The collector sends a Subscribe RPC specifying the data paths and cadence-based sampling intervals it requires. The device then pushes telemetry messages containing GPB-encoded (Google Protocol Buffers) key-value pairs over this long-lived connection. This architecture eliminates the request-response overhead of polling, enabling sub-second data collection at scale. The transport relies on HTTP/2 for multiplexed streams, flow control, and header compression, making it fundamentally more efficient than TCP-based legacy protocols.

Prasad Kumkar

About the author

Prasad Kumkar

CEO & MD, Inference Systems

Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.

His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.