Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning

Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that de...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chu, Shunfeng, Li, Jun, Wei, Kang, Qian, Yuwen, Wang, Kunlun, Shu, Feng, Chen, Wen
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Chu, Shunfeng
Li, Jun
Wei, Kang
Qian, Yuwen
Wang, Kunlun
Shu, Feng
Chen, Wen
description Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that devices actively participate in local training. However, there are few studies on incentive mechanism design for HFL. In this paper, we design two-level incentive mechanisms for the HFL with a two-tiered computing structure to encourage the participation of entities in each tier in the HFL training. In the lower-level game, we propose a coalition formation game to joint optimize the edge association and bandwidth allocation problem, and obtain efficient coalition partitions by the proposed preference rule, which can be proven to be stable by exact potential game. In the upper-level game, we design the Stackelberg game algorithm, which not only determines the optimal number of edge aggregations for edge servers to maximize their utility, but also optimize the unit reward provided for the edge aggregation performance to ensure the interests of cloud servers. Furthermore, numerical results indicate that the proposed algorithms can achieve better performance than the benchmark schemes.
doi_str_mv 10.48550/arxiv.2304.04162
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2304_04162</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2304_04162</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-d36f492638a08b4262df841edc7923fce7dd4dde9559c4f4b6f10387ee17eec3</originalsourceid><addsrcrecordid>eNotz71OwzAUBWAvDKjwAEz4BRL8c-M4IyqUVjJioHt0a1-3llIHOVWAt6cUhqOjsxzpY-xOihps04gHLF9prpUWUAuQRl0z90RT2mc-Rr79HCtHMw18kz3lU5qJv5I_YE7TceJxLHydqGDxh-Rx4CsK53WiwB1hySnvb9hVxGGi2_9esPfV83a5rtzby2b56Co0raqCNhE6ZbRFYXegjArRgqTg207p6KkNAUKgrmk6DxF2JkqhbUskz_F6we7_Xi-a_qOkI5bv_lfVX1T6B3BlR_4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</title><source>arXiv.org</source><creator>Chu, Shunfeng ; Li, Jun ; Wei, Kang ; Qian, Yuwen ; Wang, Kunlun ; Shu, Feng ; Chen, Wen</creator><creatorcontrib>Chu, Shunfeng ; Li, Jun ; Wei, Kang ; Qian, Yuwen ; Wang, Kunlun ; Shu, Feng ; Chen, Wen</creatorcontrib><description>Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that devices actively participate in local training. However, there are few studies on incentive mechanism design for HFL. In this paper, we design two-level incentive mechanisms for the HFL with a two-tiered computing structure to encourage the participation of entities in each tier in the HFL training. In the lower-level game, we propose a coalition formation game to joint optimize the edge association and bandwidth allocation problem, and obtain efficient coalition partitions by the proposed preference rule, which can be proven to be stable by exact potential game. In the upper-level game, we design the Stackelberg game algorithm, which not only determines the optimal number of edge aggregations for edge servers to maximize their utility, but also optimize the unit reward provided for the edge aggregation performance to ensure the interests of cloud servers. Furthermore, numerical results indicate that the proposed algorithms can achieve better performance than the benchmark schemes.</description><identifier>DOI: 10.48550/arxiv.2304.04162</identifier><language>eng</language><subject>Computer Science - Computer Science and Game Theory ; Computer Science - Distributed, Parallel, and Cluster Computing ; Computer Science - Learning</subject><creationdate>2023-04</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2304.04162$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2304.04162$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Chu, Shunfeng</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Wei, Kang</creatorcontrib><creatorcontrib>Qian, Yuwen</creatorcontrib><creatorcontrib>Wang, Kunlun</creatorcontrib><creatorcontrib>Shu, Feng</creatorcontrib><creatorcontrib>Chen, Wen</creatorcontrib><title>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</title><description>Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that devices actively participate in local training. However, there are few studies on incentive mechanism design for HFL. In this paper, we design two-level incentive mechanisms for the HFL with a two-tiered computing structure to encourage the participation of entities in each tier in the HFL training. In the lower-level game, we propose a coalition formation game to joint optimize the edge association and bandwidth allocation problem, and obtain efficient coalition partitions by the proposed preference rule, which can be proven to be stable by exact potential game. In the upper-level game, we design the Stackelberg game algorithm, which not only determines the optimal number of edge aggregations for edge servers to maximize their utility, but also optimize the unit reward provided for the edge aggregation performance to ensure the interests of cloud servers. Furthermore, numerical results indicate that the proposed algorithms can achieve better performance than the benchmark schemes.</description><subject>Computer Science - Computer Science and Game Theory</subject><subject>Computer Science - Distributed, Parallel, and Cluster Computing</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz71OwzAUBWAvDKjwAEz4BRL8c-M4IyqUVjJioHt0a1-3llIHOVWAt6cUhqOjsxzpY-xOihps04gHLF9prpUWUAuQRl0z90RT2mc-Rr79HCtHMw18kz3lU5qJv5I_YE7TceJxLHydqGDxh-Rx4CsK53WiwB1hySnvb9hVxGGi2_9esPfV83a5rtzby2b56Co0raqCNhE6ZbRFYXegjArRgqTg207p6KkNAUKgrmk6DxF2JkqhbUskz_F6we7_Xi-a_qOkI5bv_lfVX1T6B3BlR_4</recordid><startdate>20230409</startdate><enddate>20230409</enddate><creator>Chu, Shunfeng</creator><creator>Li, Jun</creator><creator>Wei, Kang</creator><creator>Qian, Yuwen</creator><creator>Wang, Kunlun</creator><creator>Shu, Feng</creator><creator>Chen, Wen</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230409</creationdate><title>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</title><author>Chu, Shunfeng ; Li, Jun ; Wei, Kang ; Qian, Yuwen ; Wang, Kunlun ; Shu, Feng ; Chen, Wen</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-d36f492638a08b4262df841edc7923fce7dd4dde9559c4f4b6f10387ee17eec3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Computer Science and Game Theory</topic><topic>Computer Science - Distributed, Parallel, and Cluster Computing</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Chu, Shunfeng</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Wei, Kang</creatorcontrib><creatorcontrib>Qian, Yuwen</creatorcontrib><creatorcontrib>Wang, Kunlun</creatorcontrib><creatorcontrib>Shu, Feng</creatorcontrib><creatorcontrib>Chen, Wen</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chu, Shunfeng</au><au>Li, Jun</au><au>Wei, Kang</au><au>Qian, Yuwen</au><au>Wang, Kunlun</au><au>Shu, Feng</au><au>Chen, Wen</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</atitle><date>2023-04-09</date><risdate>2023</risdate><abstract>Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that devices actively participate in local training. However, there are few studies on incentive mechanism design for HFL. In this paper, we design two-level incentive mechanisms for the HFL with a two-tiered computing structure to encourage the participation of entities in each tier in the HFL training. In the lower-level game, we propose a coalition formation game to joint optimize the edge association and bandwidth allocation problem, and obtain efficient coalition partitions by the proposed preference rule, which can be proven to be stable by exact potential game. In the upper-level game, we design the Stackelberg game algorithm, which not only determines the optimal number of edge aggregations for edge servers to maximize their utility, but also optimize the unit reward provided for the edge aggregation performance to ensure the interests of cloud servers. Furthermore, numerical results indicate that the proposed algorithms can achieve better performance than the benchmark schemes.</abstract><doi>10.48550/arxiv.2304.04162</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2304.04162
ispartof
issn
language eng
recordid cdi_arxiv_primary_2304_04162
source arXiv.org
subjects Computer Science - Computer Science and Game Theory
Computer Science - Distributed, Parallel, and Cluster Computing
Computer Science - Learning
title Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T09%3A38%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Design%20of%20Two-Level%20Incentive%20Mechanisms%20for%20Hierarchical%20Federated%20Learning&rft.au=Chu,%20Shunfeng&rft.date=2023-04-09&rft_id=info:doi/10.48550/arxiv.2304.04162&rft_dat=%3Carxiv_GOX%3E2304_04162%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true