Federated Averaging (FedAvg) is a distributed optimization algorithm that trains a shared global model by averaging the stochastic gradient descent (SGD) updates computed independently on decentralized client datasets. Instead of sending raw training data to a central server, each client downloads the current global model, computes an update using its local data, and transmits only the resulting model weights or gradients back to the aggregation server.
Glossary
Federated Averaging (FedAvg)

What is Federated Averaging (FedAvg)?
The foundational optimization algorithm for federated learning that combines locally trained model updates from distributed clients by computing a weighted average to produce an improved global model without centralizing raw data.
The server then constructs a new global model by computing a weighted average of these client updates, typically weighted by the number of local training samples each client processed. This iterative process repeats over multiple communication rounds, enabling collaborative learning while preserving data sovereignty and addressing the statistical challenges of non-IID data distributions across heterogeneous clients.
Key Characteristics of FedAvg
The core mechanisms that make Federated Averaging the dominant optimization strategy for privacy-preserving, distributed model training across decentralized telecom infrastructure.
Local Stochastic Gradient Descent (SGD)
Each participating client performs multiple steps of stochastic gradient descent on its local data partition before communicating. This contrasts with traditional distributed training that requires gradient synchronization after every batch. By executing E local epochs, FedAvg significantly reduces communication rounds—a critical advantage in bandwidth-constrained radio access networks. The local update rule follows: w_k = w_k - η∇L(w_k; batch) where η is the learning rate and L is the local loss function.
Weighted Model Averaging
The central server aggregates client updates using a weighted average proportional to each client's dataset size n_k. The global update rule is: w_global = Σ (n_k / n_total) * w_k. This weighting mechanism ensures that clients with more representative data exert proportionally greater influence on the global model, while preventing any single large dataset from dominating convergence. The approach naturally handles statistical heterogeneity across base stations with varying traffic patterns.
Communication Round Structure
FedAvg operates in discrete synchronized rounds:
- Round 1: Server broadcasts current global model
w_tto selected clients - Round 2: Each client
kinitializes withw_t, trains forElocal epochs on private dataD_k, producing updated weightsw_k - Round 3: Clients transmit only model deltas
Δw_k = w_k - w_tback to the server - Round 4: Server computes weighted average of deltas and updates global model This structure minimizes uplink bandwidth consumption—critical for edge inference offloading scenarios.
Convergence Under Non-IID Data
A defining challenge for FedAvg is statistical heterogeneity where local datasets are non-IID. In telecom deployments, different base stations observe fundamentally different traffic distributions—urban macrocells see dense daytime demand while rural cells exhibit sparse, bursty patterns. This causes client drift: local models diverge toward their own local optima, and naive averaging can produce a global model that performs poorly on all distributions. The weight divergence is proportional to E * η * (gradient dissimilarity), requiring careful tuning of local epochs.
Client Selection and Straggler Resilience
Each round, the server selects a fraction C of available clients for participation. This client selection strategy balances model convergence speed against communication overhead. FedAvg is inherently vulnerable to stragglers—slow devices that delay round completion. Production deployments implement timeout thresholds: if a client fails to report within T_max, its update is discarded for that round. This trades off some statistical accuracy for predictable latency, essential for zero-touch network provisioning workflows.
Privacy-Preserving Foundation
FedAvg provides a baseline privacy guarantee: raw training data never leaves the base station. Only mathematical weight updates are transmitted. However, these updates are not inherently cryptographically private—gradients can leak information through model inversion attacks. Production telecom deployments layer FedAvg with:
- Secure Aggregation to prevent the server from inspecting individual updates
- Differential Privacy via Gaussian noise injection before transmission
- Gradient clipping to bound per-example sensitivity This layered approach satisfies data sovereignty requirements for cross-jurisdiction deployments.
Frequently Asked Questions
Clear, technically precise answers to the most common questions about the foundational algorithm that powers privacy-preserving distributed model training across telecom infrastructure.
Federated Averaging (FedAvg) is the foundational optimization algorithm for federated learning that constructs a global model by computing a weighted average of locally trained model updates from distributed clients, without ever centralizing raw data. The algorithm operates in synchronized communication rounds. In each round, a central server distributes the current global model parameters to a selected subset of clients. Each client then performs multiple steps of stochastic gradient descent (SGD) on its local private dataset, producing an updated model. The server collects these client updates and aggregates them by taking a weighted average, where each client's weight is typically proportional to the size of its local training dataset. This aggregated update becomes the new global model, and the process repeats. The key insight is that averaging model parameters is mathematically equivalent to averaging gradients when clients start from the same initialization, enabling the global model to learn from decentralized data while preserving privacy. FedAvg dramatically reduces communication rounds compared to earlier federated SGD approaches by allowing clients to perform multiple local epochs before uploading, making it practical for bandwidth-constrained telecom environments where base stations train on sensitive user data.
Enabling Efficiency, Speed & Accuracy
Intelligent Analysis, Decision & Execution
We build AI systems for teams that need search across company data, workflow automation across tools, or AI features inside products and internal software.
Talk to Us
Search across company data
Give teams answers from docs, tickets, runbooks, and product data with sources and permissions.
Useful when people spend too long searching or get different answers from different systems.

Automate internal workflows
Use AI to route work, draft outputs, trigger actions, and keep approvals and logs in place.
Useful when repetitive work moves across multiple tools and teams.

Add AI to products and internal tools
Build assistants, guided actions, or decision support into the software your team or customers already use.
Useful when AI needs to be part of the product, not a separate tool.
Related Terms
The foundational algorithm for federated learning relies on a constellation of privacy, security, and optimization techniques to function reliably in real-world, non-ideal network conditions.
Secure Aggregation
A cryptographic protocol that ensures the central server can only compute the sum of encrypted model updates. This prevents the server from inspecting any individual client's gradient, a critical defense against gradient leakage attacks that could reconstruct private user data. It is the standard privacy companion to FedAvg.
Differential Privacy
A mathematical framework that provides a quantifiable privacy guarantee by injecting calibrated statistical noise into model updates before aggregation. Key parameters include:
- Epsilon (ε): The privacy budget; a smaller value enforces stronger privacy.
- Delta (δ): The probability of a catastrophic privacy breach. This ensures the final model does not memorize individual training samples.
Gradient Clipping
A preprocessing step applied locally before FedAvg aggregation. It bounds the influence of any single data point by scaling down gradients whose L2 norm exceeds a threshold. This is mathematically essential for limiting the sensitivity of the computation, allowing for tighter differential privacy guarantees without excessive noise injection.
Non-IID Data
The primary convergence challenge for FedAvg. In telecom, data across base stations is statistically heterogeneous—usage patterns vary by time and location. This violates the IID assumption of standard SGD, causing client drift where local models diverge from the global optimum, slowing convergence or preventing it entirely.
FedProx
An enhanced federated optimization framework designed to stabilize FedAvg in heterogeneous environments. It adds a proximal term to the local objective function that penalizes large deviations from the global model. This allows for variable amounts of local computation across straggling devices without sacrificing convergence stability.
Communication Efficiency
The critical bottleneck in wireless federated learning. Transmitting full-precision model weights over bandwidth-limited backhaul links is prohibitive. Techniques paired with FedAvg include:
- Gradient Quantization: Reducing bit-precision of updates.
- Gradient Sparsification: Transmitting only the largest gradient values. These reduce the data payload per communication round.

About the author
Prasad Kumkar
CEO & MD, Inference Systems
Prasad Kumkar is the CEO & MD of Inference Systems and writes about AI systems architecture, LLM infrastructure, model serving, evaluation, and production deployment. Over 5+ years, he has worked across computer vision models, L5 autonomous vehicle systems, and LLM research, with a focus on taking complex AI ideas into real-world engineering systems.
His work and writing cover AI systems, large language models, AI agents, multimodal systems, autonomous systems, inference optimization, RAG, evaluation, and production AI engineering.
Partnered with leading AI, data, and software stack.
How We Work
Custom AI workflows for your Business
One-fit-all AI don't work for modern businesses. At Inferensys, we aim to understand your business & custom requirements; which we use to define most efficient agentic workflows, the data, and the tools for your business.
01
Review the use case
We understand the task, the users, and where AI can actually help.
Read more02
Pick the right approach
We define what needs search, automation, or product integration.
Read more03
Build the first useful version
We implement the part that proves the value first.
Read more04
Improve from there
We add the checks and visibility needed to keep it useful.
Read moreThe first call is a practical review of your use case and the right next step.
Talk to Us