Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving

Cooperative driving of human driver and automated system can effectively reduce the necessity of extremely accurate environment perception of highly automated vehicles, and enhance the robustness of decision-making and motion control. However, due to the two players' different intentions, sever...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on intelligent transportation systems 2022-09, Vol.23 (9), p.15980-15992
Hauptverfasser: Li, Wenyu, Li, Qingkun, Li, Shengbo Eben, Li, Renjie, Ren, Yangang, Wang, Wenjun
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 15992
container_issue 9
container_start_page 15980
container_title IEEE transactions on intelligent transportation systems
container_volume 23
creator Li, Wenyu
Li, Qingkun
Li, Shengbo Eben
Li, Renjie
Ren, Yangang
Wang, Wenjun
description Cooperative driving of human driver and automated system can effectively reduce the necessity of extremely accurate environment perception of highly automated vehicles, and enhance the robustness of decision-making and motion control. However, due to the two players' different intentions, severe conflicts may exist during the cooperation, which often result in negative consequences on driving safety and maneuverability. This paper presents an indirect shared control method to model the situation and improve the driving performance, which focus on the affine input nonlinear vehicle dynamic system for shared controller design under the framework of non-zero sum differential game. The Nash equilibria strategy indicates the best response for the automated system, which can guide the automated controller to act more safely and comfortably. Aimed to obtain fast solution for practical application, approximate dynamic programming is utilized to find the Nash equilibria, which is represented by deep neural networks and solved iteratively. Driver-in-the-loop tests on a driving simulator were conducted to verify the performance of the proposed method under highway driving scenarios. The results show that the designed controller is able to reduce the driving workload and ensure the driving safety.
doi_str_mv 10.1109/TITS.2022.3146895
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9709196</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9709196</ieee_id><sourcerecordid>2714896614</sourcerecordid><originalsourceid>FETCH-LOGICAL-c293t-c7ffc61dc8ba6cefe7aae3b5143ff24bf6f52b41c0b2e6885a1b65d83125c2a3</originalsourceid><addsrcrecordid>eNo9kEFLwzAUx4MoOKcfQLwEPHfmpU3aHMemczD0sJ68xDR92Tq2ZqbtwG9vy4an93j8f_8HP0IegU0AmHrJl_l6whnnkxgSmSlxRUYgRBYxBvJ62HkSKSbYLblrml1_TQTAiHwv67IKaFu63pqAJZ35ug1-T_Nt8N1mSz98HX1h8HTdHei8cg4D1m1l9nRhDkidDz3ijxhMW52QTrvWH0zbF81DdarqzT25cWbf4MNljkn-9prP3qPV52I5m64iy1XcRjZ1zkoobVYYadFhagzGhYAkdo4nhZNO8CIBywqOMsuEgUKKMouBC8tNPCbP59pj8D8dNq3e-S7U_UfNU0gyJWVfNSZwTtngmyag08dQHUz41cD04FEPHvXgUV889szTmakQ8T-vUqZAyfgPKXNwBQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2714896614</pqid></control><display><type>article</type><title>Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving</title><source>IEEE Electronic Library (IEL)</source><creator>Li, Wenyu ; Li, Qingkun ; Li, Shengbo Eben ; Li, Renjie ; Ren, Yangang ; Wang, Wenjun</creator><creatorcontrib>Li, Wenyu ; Li, Qingkun ; Li, Shengbo Eben ; Li, Renjie ; Ren, Yangang ; Wang, Wenjun</creatorcontrib><description>Cooperative driving of human driver and automated system can effectively reduce the necessity of extremely accurate environment perception of highly automated vehicles, and enhance the robustness of decision-making and motion control. However, due to the two players' different intentions, severe conflicts may exist during the cooperation, which often result in negative consequences on driving safety and maneuverability. This paper presents an indirect shared control method to model the situation and improve the driving performance, which focus on the affine input nonlinear vehicle dynamic system for shared controller design under the framework of non-zero sum differential game. The Nash equilibria strategy indicates the best response for the automated system, which can guide the automated controller to act more safely and comfortably. Aimed to obtain fast solution for practical application, approximate dynamic programming is utilized to find the Nash equilibria, which is represented by deep neural networks and solved iteratively. Driver-in-the-loop tests on a driving simulator were conducted to verify the performance of the proposed method under highway driving scenarios. The results show that the designed controller is able to reduce the driving workload and ensure the driving safety.</description><identifier>ISSN: 1524-9050</identifier><identifier>EISSN: 1558-0016</identifier><identifier>DOI: 10.1109/TITS.2022.3146895</identifier><identifier>CODEN: ITISFG</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>Approximate dynamic programming ; Artificial neural networks ; automated vehicle ; Automation ; Control methods ; Control systems design ; Controllers ; cooperative driving ; Decision making ; differential game ; Differential games ; Dynamic programming ; Dynamical systems ; Game theory ; Games ; Maneuverability ; Motion control ; Nonlinear dynamical systems ; Safety ; shared control ; Vehicle dynamics ; Vehicle safety ; Vehicles ; Wheels ; Zero sum games</subject><ispartof>IEEE transactions on intelligent transportation systems, 2022-09, Vol.23 (9), p.15980-15992</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c293t-c7ffc61dc8ba6cefe7aae3b5143ff24bf6f52b41c0b2e6885a1b65d83125c2a3</citedby><cites>FETCH-LOGICAL-c293t-c7ffc61dc8ba6cefe7aae3b5143ff24bf6f52b41c0b2e6885a1b65d83125c2a3</cites><orcidid>0000-0001-8846-5301 ; 0000-0003-4923-3633 ; 0000-0002-1173-7230 ; 0000-0002-1082-0630</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9709196$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9709196$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Li, Wenyu</creatorcontrib><creatorcontrib>Li, Qingkun</creatorcontrib><creatorcontrib>Li, Shengbo Eben</creatorcontrib><creatorcontrib>Li, Renjie</creatorcontrib><creatorcontrib>Ren, Yangang</creatorcontrib><creatorcontrib>Wang, Wenjun</creatorcontrib><title>Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving</title><title>IEEE transactions on intelligent transportation systems</title><addtitle>TITS</addtitle><description>Cooperative driving of human driver and automated system can effectively reduce the necessity of extremely accurate environment perception of highly automated vehicles, and enhance the robustness of decision-making and motion control. However, due to the two players' different intentions, severe conflicts may exist during the cooperation, which often result in negative consequences on driving safety and maneuverability. This paper presents an indirect shared control method to model the situation and improve the driving performance, which focus on the affine input nonlinear vehicle dynamic system for shared controller design under the framework of non-zero sum differential game. The Nash equilibria strategy indicates the best response for the automated system, which can guide the automated controller to act more safely and comfortably. Aimed to obtain fast solution for practical application, approximate dynamic programming is utilized to find the Nash equilibria, which is represented by deep neural networks and solved iteratively. Driver-in-the-loop tests on a driving simulator were conducted to verify the performance of the proposed method under highway driving scenarios. The results show that the designed controller is able to reduce the driving workload and ensure the driving safety.</description><subject>Approximate dynamic programming</subject><subject>Artificial neural networks</subject><subject>automated vehicle</subject><subject>Automation</subject><subject>Control methods</subject><subject>Control systems design</subject><subject>Controllers</subject><subject>cooperative driving</subject><subject>Decision making</subject><subject>differential game</subject><subject>Differential games</subject><subject>Dynamic programming</subject><subject>Dynamical systems</subject><subject>Game theory</subject><subject>Games</subject><subject>Maneuverability</subject><subject>Motion control</subject><subject>Nonlinear dynamical systems</subject><subject>Safety</subject><subject>shared control</subject><subject>Vehicle dynamics</subject><subject>Vehicle safety</subject><subject>Vehicles</subject><subject>Wheels</subject><subject>Zero sum games</subject><issn>1524-9050</issn><issn>1558-0016</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kEFLwzAUx4MoOKcfQLwEPHfmpU3aHMemczD0sJ68xDR92Tq2ZqbtwG9vy4an93j8f_8HP0IegU0AmHrJl_l6whnnkxgSmSlxRUYgRBYxBvJ62HkSKSbYLblrml1_TQTAiHwv67IKaFu63pqAJZ35ug1-T_Nt8N1mSz98HX1h8HTdHei8cg4D1m1l9nRhDkidDz3ijxhMW52QTrvWH0zbF81DdarqzT25cWbf4MNljkn-9prP3qPV52I5m64iy1XcRjZ1zkoobVYYadFhagzGhYAkdo4nhZNO8CIBywqOMsuEgUKKMouBC8tNPCbP59pj8D8dNq3e-S7U_UfNU0gyJWVfNSZwTtngmyag08dQHUz41cD04FEPHvXgUV889szTmakQ8T-vUqZAyfgPKXNwBQ</recordid><startdate>20220901</startdate><enddate>20220901</enddate><creator>Li, Wenyu</creator><creator>Li, Qingkun</creator><creator>Li, Shengbo Eben</creator><creator>Li, Renjie</creator><creator>Ren, Yangang</creator><creator>Wang, Wenjun</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>KR7</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-8846-5301</orcidid><orcidid>https://orcid.org/0000-0003-4923-3633</orcidid><orcidid>https://orcid.org/0000-0002-1173-7230</orcidid><orcidid>https://orcid.org/0000-0002-1082-0630</orcidid></search><sort><creationdate>20220901</creationdate><title>Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving</title><author>Li, Wenyu ; Li, Qingkun ; Li, Shengbo Eben ; Li, Renjie ; Ren, Yangang ; Wang, Wenjun</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c293t-c7ffc61dc8ba6cefe7aae3b5143ff24bf6f52b41c0b2e6885a1b65d83125c2a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Approximate dynamic programming</topic><topic>Artificial neural networks</topic><topic>automated vehicle</topic><topic>Automation</topic><topic>Control methods</topic><topic>Control systems design</topic><topic>Controllers</topic><topic>cooperative driving</topic><topic>Decision making</topic><topic>differential game</topic><topic>Differential games</topic><topic>Dynamic programming</topic><topic>Dynamical systems</topic><topic>Game theory</topic><topic>Games</topic><topic>Maneuverability</topic><topic>Motion control</topic><topic>Nonlinear dynamical systems</topic><topic>Safety</topic><topic>shared control</topic><topic>Vehicle dynamics</topic><topic>Vehicle safety</topic><topic>Vehicles</topic><topic>Wheels</topic><topic>Zero sum games</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Li, Wenyu</creatorcontrib><creatorcontrib>Li, Qingkun</creatorcontrib><creatorcontrib>Li, Shengbo Eben</creatorcontrib><creatorcontrib>Li, Renjie</creatorcontrib><creatorcontrib>Ren, Yangang</creatorcontrib><creatorcontrib>Wang, Wenjun</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on intelligent transportation systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Li, Wenyu</au><au>Li, Qingkun</au><au>Li, Shengbo Eben</au><au>Li, Renjie</au><au>Ren, Yangang</au><au>Wang, Wenjun</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving</atitle><jtitle>IEEE transactions on intelligent transportation systems</jtitle><stitle>TITS</stitle><date>2022-09-01</date><risdate>2022</risdate><volume>23</volume><issue>9</issue><spage>15980</spage><epage>15992</epage><pages>15980-15992</pages><issn>1524-9050</issn><eissn>1558-0016</eissn><coden>ITISFG</coden><abstract>Cooperative driving of human driver and automated system can effectively reduce the necessity of extremely accurate environment perception of highly automated vehicles, and enhance the robustness of decision-making and motion control. However, due to the two players' different intentions, severe conflicts may exist during the cooperation, which often result in negative consequences on driving safety and maneuverability. This paper presents an indirect shared control method to model the situation and improve the driving performance, which focus on the affine input nonlinear vehicle dynamic system for shared controller design under the framework of non-zero sum differential game. The Nash equilibria strategy indicates the best response for the automated system, which can guide the automated controller to act more safely and comfortably. Aimed to obtain fast solution for practical application, approximate dynamic programming is utilized to find the Nash equilibria, which is represented by deep neural networks and solved iteratively. Driver-in-the-loop tests on a driving simulator were conducted to verify the performance of the proposed method under highway driving scenarios. The results show that the designed controller is able to reduce the driving workload and ensure the driving safety.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TITS.2022.3146895</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-8846-5301</orcidid><orcidid>https://orcid.org/0000-0003-4923-3633</orcidid><orcidid>https://orcid.org/0000-0002-1173-7230</orcidid><orcidid>https://orcid.org/0000-0002-1082-0630</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1524-9050
ispartof IEEE transactions on intelligent transportation systems, 2022-09, Vol.23 (9), p.15980-15992
issn 1524-9050
1558-0016
language eng
recordid cdi_ieee_primary_9709196
source IEEE Electronic Library (IEL)
subjects Approximate dynamic programming
Artificial neural networks
automated vehicle
Automation
Control methods
Control systems design
Controllers
cooperative driving
Decision making
differential game
Differential games
Dynamic programming
Dynamical systems
Game theory
Games
Maneuverability
Motion control
Nonlinear dynamical systems
Safety
shared control
Vehicle dynamics
Vehicle safety
Vehicles
Wheels
Zero sum games
title Indirect Shared Control Through Non-Zero Sum Differential Game for Cooperative Automated Driving
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-03T22%3A31%3A45IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Indirect%20Shared%20Control%20Through%20Non-Zero%20Sum%20Differential%20Game%20for%20Cooperative%20Automated%20Driving&rft.jtitle=IEEE%20transactions%20on%20intelligent%20transportation%20systems&rft.au=Li,%20Wenyu&rft.date=2022-09-01&rft.volume=23&rft.issue=9&rft.spage=15980&rft.epage=15992&rft.pages=15980-15992&rft.issn=1524-9050&rft.eissn=1558-0016&rft.coden=ITISFG&rft_id=info:doi/10.1109/TITS.2022.3146895&rft_dat=%3Cproquest_RIE%3E2714896614%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2714896614&rft_id=info:pmid/&rft_ieee_id=9709196&rfr_iscdi=true