Personalized Federated Learning with Hierarchical Two-Branch Aggregation for Few-Shot Scenarios

Read full text
Authors: Yifan Miao, Weishan Zhang, Yue Wang, Yi Liu, Zhen Zhang, Lingzhao Meng, Baoyu Zhang
Cited by: 1
References: 20

Abstract

Personalized federated learning (pFL) aims to address data heterogeneity by training client-specific models. However, it faces two critical challenges under few-shot conditions. First, existing methods often overlook the hierarchical structure of neural representations, limiting their ability to balance generalization and personalization. Second, recent approaches incorporate representation-level inductive biases that typically rely on rigid assumptions, such as fixed perturbation patterns or compact class clusters, making them vulnerable to distribution shifts in federated environments. To overcome these limitations, we propose pFedH2A, a novel hierarchical framework incorporating brain-inspired mechanisms, tailored for personalized federated learning in few-shot scenarios. First, we design a dual-branch hypernetwork (DHN) that employs two structurally distinct branches to generate aggregation weights. Each branch is biased toward capturing either low-level shared features or high-level personalized representations, enabling fine-grained personalization by mimicking the brain's division of perceptual and representational processing. Second, we introduce a relation-aware module that learns an adaptive similarity function for each client, supporting few-shot classification by measuring whether a pair of samples belongs to the same class without relying on rigid prototype assumptions. Extensive experiments on public image classification datasets demonstrate that pFedH2A outperforms existing pFL baselines under few-shot scenarios, validating its effectiveness.

Fields of Study & Subjects

Domain Adaptation and Few-Shot Learning Privacy-Preserving Technologies in Data Face recognition and analysis

Publication details

Journal / source
Sensors
Publisher
MDPI AG
Volume
26
Issue
3
Pages
1037–1037
Publication date
5 February 2026
Language
EN