HAFLO: GPU-Based Acceleration for Federated Logistic Regression

In recent years, federated learning (FL) has been widely applied for supporting decentralized collaborative learning scenarios. Among existing FL models, federated logistic regression (FLR) is a widely used statistic model and has been used in various industries. To ensure data security and user pri...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cheng, Xiaodian, Lu, Wanhang, Huang, Xinyang, Hu, Shuihai, Chen, Kai
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Cheng, Xiaodian
Lu, Wanhang
Huang, Xinyang
Hu, Shuihai
Chen, Kai
description In recent years, federated learning (FL) has been widely applied for supporting decentralized collaborative learning scenarios. Among existing FL models, federated logistic regression (FLR) is a widely used statistic model and has been used in various industries. To ensure data security and user privacy, FLR leverages homomorphic encryption (HE) to protect the exchanged data among different collaborative parties. However, HE introduces significant computational overhead (i.e., the cost of data encryption/decryption and calculation over encrypted data), which eventually becomes the performance bottleneck of the whole system. In this paper, we propose HAFLO, a GPU-based solution to improve the performance of FLR. The core idea of HAFLO is to summarize a set of performance-critical homomorphic operators (HO) used by FLR and accelerate the execution of these operators through a joint optimization of storage, IO, and computation. The preliminary results show that our acceleration on FATE, a popular FL framework, achieves a 49.9$\times$ speedup for heterogeneous LR and 88.4$\times$ for homogeneous LR.
doi_str_mv 10.48550/arxiv.2107.13797
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2107_13797</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2107_13797</sourcerecordid><originalsourceid>FETCH-LOGICAL-a677-c64182b2b5bccd6507791c3b8a5a09d33e75e7d3530e98aebf0a6565d3fe59183</originalsourceid><addsrcrecordid>eNotj81KAzEUhbNxIdUHcGVeYMZk0psfNzIWpxUGKqVdDzfJnRKojiRF9O1tq6vD4Xwc-Bi7k6KeWwDxgPk7fdWNFKaWyjhzzZ5WbdevH_nybVc9Y6HI2xDoQBmPafrg45R5R_FcT1M_7VM5psA3tM9Uyom4YVcjHgrd_ueMbbuX7WJV9evl66LtK9TGVEHPpW1848GHEDUIY5wMylsEFC4qRQbIRAVKkLNIfhSoQUNUI4GTVs3Y_d_txWD4zOkd889wNhkuJuoXxn1CLQ</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>HAFLO: GPU-Based Acceleration for Federated Logistic Regression</title><source>arXiv.org</source><creator>Cheng, Xiaodian ; Lu, Wanhang ; Huang, Xinyang ; Hu, Shuihai ; Chen, Kai</creator><creatorcontrib>Cheng, Xiaodian ; Lu, Wanhang ; Huang, Xinyang ; Hu, Shuihai ; Chen, Kai</creatorcontrib><description>In recent years, federated learning (FL) has been widely applied for supporting decentralized collaborative learning scenarios. Among existing FL models, federated logistic regression (FLR) is a widely used statistic model and has been used in various industries. To ensure data security and user privacy, FLR leverages homomorphic encryption (HE) to protect the exchanged data among different collaborative parties. However, HE introduces significant computational overhead (i.e., the cost of data encryption/decryption and calculation over encrypted data), which eventually becomes the performance bottleneck of the whole system. In this paper, we propose HAFLO, a GPU-based solution to improve the performance of FLR. The core idea of HAFLO is to summarize a set of performance-critical homomorphic operators (HO) used by FLR and accelerate the execution of these operators through a joint optimization of storage, IO, and computation. The preliminary results show that our acceleration on FATE, a popular FL framework, achieves a 49.9$\times$ speedup for heterogeneous LR and 88.4$\times$ for homogeneous LR.</description><identifier>DOI: 10.48550/arxiv.2107.13797</identifier><language>eng</language><subject>Computer Science - Learning</subject><creationdate>2021-07</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2107.13797$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2107.13797$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Cheng, Xiaodian</creatorcontrib><creatorcontrib>Lu, Wanhang</creatorcontrib><creatorcontrib>Huang, Xinyang</creatorcontrib><creatorcontrib>Hu, Shuihai</creatorcontrib><creatorcontrib>Chen, Kai</creatorcontrib><title>HAFLO: GPU-Based Acceleration for Federated Logistic Regression</title><description>In recent years, federated learning (FL) has been widely applied for supporting decentralized collaborative learning scenarios. Among existing FL models, federated logistic regression (FLR) is a widely used statistic model and has been used in various industries. To ensure data security and user privacy, FLR leverages homomorphic encryption (HE) to protect the exchanged data among different collaborative parties. However, HE introduces significant computational overhead (i.e., the cost of data encryption/decryption and calculation over encrypted data), which eventually becomes the performance bottleneck of the whole system. In this paper, we propose HAFLO, a GPU-based solution to improve the performance of FLR. The core idea of HAFLO is to summarize a set of performance-critical homomorphic operators (HO) used by FLR and accelerate the execution of these operators through a joint optimization of storage, IO, and computation. The preliminary results show that our acceleration on FATE, a popular FL framework, achieves a 49.9$\times$ speedup for heterogeneous LR and 88.4$\times$ for homogeneous LR.</description><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj81KAzEUhbNxIdUHcGVeYMZk0psfNzIWpxUGKqVdDzfJnRKojiRF9O1tq6vD4Xwc-Bi7k6KeWwDxgPk7fdWNFKaWyjhzzZ5WbdevH_nybVc9Y6HI2xDoQBmPafrg45R5R_FcT1M_7VM5psA3tM9Uyom4YVcjHgrd_ueMbbuX7WJV9evl66LtK9TGVEHPpW1848GHEDUIY5wMylsEFC4qRQbIRAVKkLNIfhSoQUNUI4GTVs3Y_d_txWD4zOkd889wNhkuJuoXxn1CLQ</recordid><startdate>20210729</startdate><enddate>20210729</enddate><creator>Cheng, Xiaodian</creator><creator>Lu, Wanhang</creator><creator>Huang, Xinyang</creator><creator>Hu, Shuihai</creator><creator>Chen, Kai</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20210729</creationdate><title>HAFLO: GPU-Based Acceleration for Federated Logistic Regression</title><author>Cheng, Xiaodian ; Lu, Wanhang ; Huang, Xinyang ; Hu, Shuihai ; Chen, Kai</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a677-c64182b2b5bccd6507791c3b8a5a09d33e75e7d3530e98aebf0a6565d3fe59183</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Cheng, Xiaodian</creatorcontrib><creatorcontrib>Lu, Wanhang</creatorcontrib><creatorcontrib>Huang, Xinyang</creatorcontrib><creatorcontrib>Hu, Shuihai</creatorcontrib><creatorcontrib>Chen, Kai</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Cheng, Xiaodian</au><au>Lu, Wanhang</au><au>Huang, Xinyang</au><au>Hu, Shuihai</au><au>Chen, Kai</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>HAFLO: GPU-Based Acceleration for Federated Logistic Regression</atitle><date>2021-07-29</date><risdate>2021</risdate><abstract>In recent years, federated learning (FL) has been widely applied for supporting decentralized collaborative learning scenarios. Among existing FL models, federated logistic regression (FLR) is a widely used statistic model and has been used in various industries. To ensure data security and user privacy, FLR leverages homomorphic encryption (HE) to protect the exchanged data among different collaborative parties. However, HE introduces significant computational overhead (i.e., the cost of data encryption/decryption and calculation over encrypted data), which eventually becomes the performance bottleneck of the whole system. In this paper, we propose HAFLO, a GPU-based solution to improve the performance of FLR. The core idea of HAFLO is to summarize a set of performance-critical homomorphic operators (HO) used by FLR and accelerate the execution of these operators through a joint optimization of storage, IO, and computation. The preliminary results show that our acceleration on FATE, a popular FL framework, achieves a 49.9$\times$ speedup for heterogeneous LR and 88.4$\times$ for homogeneous LR.</abstract><doi>10.48550/arxiv.2107.13797</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2107.13797
ispartof
issn
language eng
recordid cdi_arxiv_primary_2107_13797
source arXiv.org
subjects Computer Science - Learning
title HAFLO: GPU-Based Acceleration for Federated Logistic Regression
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-14T05%3A59%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=HAFLO:%20GPU-Based%20Acceleration%20for%20Federated%20Logistic%20Regression&rft.au=Cheng,%20Xiaodian&rft.date=2021-07-29&rft_id=info:doi/10.48550/arxiv.2107.13797&rft_dat=%3Carxiv_GOX%3E2107_13797%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true