Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning
Hierarchical Federated Learning (HFL) is a distributed machine learning paradigm tailored for multi-tiered computation architectures, which supports massive access of devices' models simultaneously. To enable efficient HFL, it is crucial to design suitable incentive mechanisms to ensure that de...
Gespeichert in:
Hauptverfasser: | , , , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | |
container_volume | |
creator | Chu, Shunfeng Li, Jun Wei, Kang Qian, Yuwen Wang, Kunlun Shu, Feng Chen, Wen |
description | Hierarchical Federated Learning (HFL) is a distributed machine learning
paradigm tailored for multi-tiered computation architectures, which supports
massive access of devices' models simultaneously. To enable efficient HFL, it
is crucial to design suitable incentive mechanisms to ensure that devices
actively participate in local training. However, there are few studies on
incentive mechanism design for HFL. In this paper, we design two-level
incentive mechanisms for the HFL with a two-tiered computing structure to
encourage the participation of entities in each tier in the HFL training. In
the lower-level game, we propose a coalition formation game to joint optimize
the edge association and bandwidth allocation problem, and obtain efficient
coalition partitions by the proposed preference rule, which can be proven to be
stable by exact potential game. In the upper-level game, we design the
Stackelberg game algorithm, which not only determines the optimal number of
edge aggregations for edge servers to maximize their utility, but also optimize
the unit reward provided for the edge aggregation performance to ensure the
interests of cloud servers. Furthermore, numerical results indicate that the
proposed algorithms can achieve better performance than the benchmark schemes. |
doi_str_mv | 10.48550/arxiv.2304.04162 |
format | Article |
fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2304_04162</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2304_04162</sourcerecordid><originalsourceid>FETCH-LOGICAL-a672-d36f492638a08b4262df841edc7923fce7dd4dde9559c4f4b6f10387ee17eec3</originalsourceid><addsrcrecordid>eNotz71OwzAUBWAvDKjwAEz4BRL8c-M4IyqUVjJioHt0a1-3llIHOVWAt6cUhqOjsxzpY-xOihps04gHLF9prpUWUAuQRl0z90RT2mc-Rr79HCtHMw18kz3lU5qJv5I_YE7TceJxLHydqGDxh-Rx4CsK53WiwB1hySnvb9hVxGGi2_9esPfV83a5rtzby2b56Co0raqCNhE6ZbRFYXegjArRgqTg207p6KkNAUKgrmk6DxF2JkqhbUskz_F6we7_Xi-a_qOkI5bv_lfVX1T6B3BlR_4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</title><source>arXiv.org</source><creator>Chu, Shunfeng ; Li, Jun ; Wei, Kang ; Qian, Yuwen ; Wang, Kunlun ; Shu, Feng ; Chen, Wen</creator><creatorcontrib>Chu, Shunfeng ; Li, Jun ; Wei, Kang ; Qian, Yuwen ; Wang, Kunlun ; Shu, Feng ; Chen, Wen</creatorcontrib><description>Hierarchical Federated Learning (HFL) is a distributed machine learning
paradigm tailored for multi-tiered computation architectures, which supports
massive access of devices' models simultaneously. To enable efficient HFL, it
is crucial to design suitable incentive mechanisms to ensure that devices
actively participate in local training. However, there are few studies on
incentive mechanism design for HFL. In this paper, we design two-level
incentive mechanisms for the HFL with a two-tiered computing structure to
encourage the participation of entities in each tier in the HFL training. In
the lower-level game, we propose a coalition formation game to joint optimize
the edge association and bandwidth allocation problem, and obtain efficient
coalition partitions by the proposed preference rule, which can be proven to be
stable by exact potential game. In the upper-level game, we design the
Stackelberg game algorithm, which not only determines the optimal number of
edge aggregations for edge servers to maximize their utility, but also optimize
the unit reward provided for the edge aggregation performance to ensure the
interests of cloud servers. Furthermore, numerical results indicate that the
proposed algorithms can achieve better performance than the benchmark schemes.</description><identifier>DOI: 10.48550/arxiv.2304.04162</identifier><language>eng</language><subject>Computer Science - Computer Science and Game Theory ; Computer Science - Distributed, Parallel, and Cluster Computing ; Computer Science - Learning</subject><creationdate>2023-04</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2304.04162$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2304.04162$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Chu, Shunfeng</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Wei, Kang</creatorcontrib><creatorcontrib>Qian, Yuwen</creatorcontrib><creatorcontrib>Wang, Kunlun</creatorcontrib><creatorcontrib>Shu, Feng</creatorcontrib><creatorcontrib>Chen, Wen</creatorcontrib><title>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</title><description>Hierarchical Federated Learning (HFL) is a distributed machine learning
paradigm tailored for multi-tiered computation architectures, which supports
massive access of devices' models simultaneously. To enable efficient HFL, it
is crucial to design suitable incentive mechanisms to ensure that devices
actively participate in local training. However, there are few studies on
incentive mechanism design for HFL. In this paper, we design two-level
incentive mechanisms for the HFL with a two-tiered computing structure to
encourage the participation of entities in each tier in the HFL training. In
the lower-level game, we propose a coalition formation game to joint optimize
the edge association and bandwidth allocation problem, and obtain efficient
coalition partitions by the proposed preference rule, which can be proven to be
stable by exact potential game. In the upper-level game, we design the
Stackelberg game algorithm, which not only determines the optimal number of
edge aggregations for edge servers to maximize their utility, but also optimize
the unit reward provided for the edge aggregation performance to ensure the
interests of cloud servers. Furthermore, numerical results indicate that the
proposed algorithms can achieve better performance than the benchmark schemes.</description><subject>Computer Science - Computer Science and Game Theory</subject><subject>Computer Science - Distributed, Parallel, and Cluster Computing</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz71OwzAUBWAvDKjwAEz4BRL8c-M4IyqUVjJioHt0a1-3llIHOVWAt6cUhqOjsxzpY-xOihps04gHLF9prpUWUAuQRl0z90RT2mc-Rr79HCtHMw18kz3lU5qJv5I_YE7TceJxLHydqGDxh-Rx4CsK53WiwB1hySnvb9hVxGGi2_9esPfV83a5rtzby2b56Co0raqCNhE6ZbRFYXegjArRgqTg207p6KkNAUKgrmk6DxF2JkqhbUskz_F6we7_Xi-a_qOkI5bv_lfVX1T6B3BlR_4</recordid><startdate>20230409</startdate><enddate>20230409</enddate><creator>Chu, Shunfeng</creator><creator>Li, Jun</creator><creator>Wei, Kang</creator><creator>Qian, Yuwen</creator><creator>Wang, Kunlun</creator><creator>Shu, Feng</creator><creator>Chen, Wen</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20230409</creationdate><title>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</title><author>Chu, Shunfeng ; Li, Jun ; Wei, Kang ; Qian, Yuwen ; Wang, Kunlun ; Shu, Feng ; Chen, Wen</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a672-d36f492638a08b4262df841edc7923fce7dd4dde9559c4f4b6f10387ee17eec3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Computer Science and Game Theory</topic><topic>Computer Science - Distributed, Parallel, and Cluster Computing</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Chu, Shunfeng</creatorcontrib><creatorcontrib>Li, Jun</creatorcontrib><creatorcontrib>Wei, Kang</creatorcontrib><creatorcontrib>Qian, Yuwen</creatorcontrib><creatorcontrib>Wang, Kunlun</creatorcontrib><creatorcontrib>Shu, Feng</creatorcontrib><creatorcontrib>Chen, Wen</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Chu, Shunfeng</au><au>Li, Jun</au><au>Wei, Kang</au><au>Qian, Yuwen</au><au>Wang, Kunlun</au><au>Shu, Feng</au><au>Chen, Wen</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning</atitle><date>2023-04-09</date><risdate>2023</risdate><abstract>Hierarchical Federated Learning (HFL) is a distributed machine learning
paradigm tailored for multi-tiered computation architectures, which supports
massive access of devices' models simultaneously. To enable efficient HFL, it
is crucial to design suitable incentive mechanisms to ensure that devices
actively participate in local training. However, there are few studies on
incentive mechanism design for HFL. In this paper, we design two-level
incentive mechanisms for the HFL with a two-tiered computing structure to
encourage the participation of entities in each tier in the HFL training. In
the lower-level game, we propose a coalition formation game to joint optimize
the edge association and bandwidth allocation problem, and obtain efficient
coalition partitions by the proposed preference rule, which can be proven to be
stable by exact potential game. In the upper-level game, we design the
Stackelberg game algorithm, which not only determines the optimal number of
edge aggregations for edge servers to maximize their utility, but also optimize
the unit reward provided for the edge aggregation performance to ensure the
interests of cloud servers. Furthermore, numerical results indicate that the
proposed algorithms can achieve better performance than the benchmark schemes.</abstract><doi>10.48550/arxiv.2304.04162</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | DOI: 10.48550/arxiv.2304.04162 |
ispartof | |
issn | |
language | eng |
recordid | cdi_arxiv_primary_2304_04162 |
source | arXiv.org |
subjects | Computer Science - Computer Science and Game Theory Computer Science - Distributed, Parallel, and Cluster Computing Computer Science - Learning |
title | Design of Two-Level Incentive Mechanisms for Hierarchical Federated Learning |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T09%3A38%3A23IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Design%20of%20Two-Level%20Incentive%20Mechanisms%20for%20Hierarchical%20Federated%20Learning&rft.au=Chu,%20Shunfeng&rft.date=2023-04-09&rft_id=info:doi/10.48550/arxiv.2304.04162&rft_dat=%3Carxiv_GOX%3E2304_04162%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |