A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7

Driver fatigue detection has become crucial in vehicle safety technology. Achieving high accuracy and real-time performance in detecting driver fatigue is paramount. In this paper, we propose a novel driver fatigue detection algorithm based on dynamic tracking of Facial Eyes and Yawning using YOLOv7...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEICE Transactions on Information and Systems 2023/11/01, Vol.E106.D(11), pp.1881-1890
Hauptverfasser: LIU, Shugang, WANG, Yujie, YU, Qiangguo, ZHAN, Jie, LIU, Hongli, LIU, Jiangtao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1890
container_issue 11
container_start_page 1881
container_title IEICE Transactions on Information and Systems
container_volume E106.D
creator LIU, Shugang
WANG, Yujie
YU, Qiangguo
ZHAN, Jie
LIU, Hongli
LIU, Jiangtao
description Driver fatigue detection has become crucial in vehicle safety technology. Achieving high accuracy and real-time performance in detecting driver fatigue is paramount. In this paper, we propose a novel driver fatigue detection algorithm based on dynamic tracking of Facial Eyes and Yawning using YOLOv7, named FEY-YOLOv7. The Coordinate Attention module is inserted into YOLOv7 to enhance its dynamic tracking accuracy by focusing on coordinate information. Additionally, a small target detection head is incorporated into the network architecture to promote the feature extraction ability of small facial targets such as eyes and mouth. In terms of compution, the YOLOv7 network architecture is significantly simplified to achieve high detection speed. Using the proposed PERYAWN algorithm, driver status is labeled and detected by four classes: open_eye, closed_eye, open_mouth, and closed_mouth. Furthermore, the Guided Image Filtering algorithm is employed to enhance image details. The proposed FEY-YOLOv7 is trained and validated on RGB-infrared datasets. The results show that FEY-YOLOv7 has achieved mAP of 0.983 and FPS of 101. This indicates that FEY-YOLOv7 is superior to state-of-the-art methods in accuracy and speed, providing an effective and practical solution for image-based driver fatigue detection.
doi_str_mv 10.1587/transinf.2023EDP7093
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2901975664</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2901975664</sourcerecordid><originalsourceid>FETCH-LOGICAL-c473t-fb7cf7eab25fd761dfe9771f01cfca7a9c1b4f11bc1cd04fec21288a5b41421d3</originalsourceid><addsrcrecordid>eNpNkEtPwzAQhC0EEuXxDzhY4pzidR5OjqVpAalSkSgHTtbGsVOXNCm2i8S_J6i8TrvanW9GGkKugI0hzcVNcNh525kxZzyelY-CFfERGYFI0gjiDI7JiBWQRXka81Ny5v2GMcg5pCOiJrR09l07Osdgm72mpQ5aBdt3dNI2vbNhvaW36HVNh1P50eHWKrpyqF5t19De0Kcttu2AK4stXaFrdPD02X99X5aL5bu4ICcGW68vv-c5eZ7PVtP7aLG8e5hOFpFKRBwiUwllhMaKp6YWGdRGF0KAYaCMQoGFgioxAJUCVbPEaMWB5zmmVQIJhzo-J9cH353r3_baB7np964bIiUvGBQizbJkUCUHlXK9904buXN2i-5DApNfdcqfOuW_Ogfs6YBtfMBG_0LoglWt_oNmwDJZSoCf7Z_Lr1qt0UndxZ-mzIhy</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2901975664</pqid></control><display><type>article</type><title>A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7</title><source>J-STAGE Free</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>LIU, Shugang ; WANG, Yujie ; YU, Qiangguo ; ZHAN, Jie ; LIU, Hongli ; LIU, Jiangtao</creator><creatorcontrib>LIU, Shugang ; WANG, Yujie ; YU, Qiangguo ; ZHAN, Jie ; LIU, Hongli ; LIU, Jiangtao</creatorcontrib><description>Driver fatigue detection has become crucial in vehicle safety technology. Achieving high accuracy and real-time performance in detecting driver fatigue is paramount. In this paper, we propose a novel driver fatigue detection algorithm based on dynamic tracking of Facial Eyes and Yawning using YOLOv7, named FEY-YOLOv7. The Coordinate Attention module is inserted into YOLOv7 to enhance its dynamic tracking accuracy by focusing on coordinate information. Additionally, a small target detection head is incorporated into the network architecture to promote the feature extraction ability of small facial targets such as eyes and mouth. In terms of compution, the YOLOv7 network architecture is significantly simplified to achieve high detection speed. Using the proposed PERYAWN algorithm, driver status is labeled and detected by four classes: open_eye, closed_eye, open_mouth, and closed_mouth. Furthermore, the Guided Image Filtering algorithm is employed to enhance image details. The proposed FEY-YOLOv7 is trained and validated on RGB-infrared datasets. The results show that FEY-YOLOv7 has achieved mAP of 0.983 and FPS of 101. This indicates that FEY-YOLOv7 is superior to state-of-the-art methods in accuracy and speed, providing an effective and practical solution for image-based driver fatigue detection.</description><identifier>ISSN: 0916-8532</identifier><identifier>EISSN: 1745-1361</identifier><identifier>DOI: 10.1587/transinf.2023EDP7093</identifier><language>eng</language><publisher>Tokyo: The Institute of Electronics, Information and Communication Engineers</publisher><subject>Accuracy ; Algorithms ; attention mechanism ; deep learning ; Driver fatigue ; driver fatigue recognition ; Eye (anatomy) ; Feature extraction ; Image enhancement ; Image filters ; Target detection ; Tracking ; Vehicle safety ; YOLOv7</subject><ispartof>IEICE Transactions on Information and Systems, 2023/11/01, Vol.E106.D(11), pp.1881-1890</ispartof><rights>2023 The Institute of Electronics, Information and Communication Engineers</rights><rights>Copyright Japan Science and Technology Agency 2023</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c473t-fb7cf7eab25fd761dfe9771f01cfca7a9c1b4f11bc1cd04fec21288a5b41421d3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,1883,27924,27925</link.rule.ids></links><search><creatorcontrib>LIU, Shugang</creatorcontrib><creatorcontrib>WANG, Yujie</creatorcontrib><creatorcontrib>YU, Qiangguo</creatorcontrib><creatorcontrib>ZHAN, Jie</creatorcontrib><creatorcontrib>LIU, Hongli</creatorcontrib><creatorcontrib>LIU, Jiangtao</creatorcontrib><title>A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7</title><title>IEICE Transactions on Information and Systems</title><addtitle>IEICE Trans. Inf. &amp; Syst.</addtitle><description>Driver fatigue detection has become crucial in vehicle safety technology. Achieving high accuracy and real-time performance in detecting driver fatigue is paramount. In this paper, we propose a novel driver fatigue detection algorithm based on dynamic tracking of Facial Eyes and Yawning using YOLOv7, named FEY-YOLOv7. The Coordinate Attention module is inserted into YOLOv7 to enhance its dynamic tracking accuracy by focusing on coordinate information. Additionally, a small target detection head is incorporated into the network architecture to promote the feature extraction ability of small facial targets such as eyes and mouth. In terms of compution, the YOLOv7 network architecture is significantly simplified to achieve high detection speed. Using the proposed PERYAWN algorithm, driver status is labeled and detected by four classes: open_eye, closed_eye, open_mouth, and closed_mouth. Furthermore, the Guided Image Filtering algorithm is employed to enhance image details. The proposed FEY-YOLOv7 is trained and validated on RGB-infrared datasets. The results show that FEY-YOLOv7 has achieved mAP of 0.983 and FPS of 101. This indicates that FEY-YOLOv7 is superior to state-of-the-art methods in accuracy and speed, providing an effective and practical solution for image-based driver fatigue detection.</description><subject>Accuracy</subject><subject>Algorithms</subject><subject>attention mechanism</subject><subject>deep learning</subject><subject>Driver fatigue</subject><subject>driver fatigue recognition</subject><subject>Eye (anatomy)</subject><subject>Feature extraction</subject><subject>Image enhancement</subject><subject>Image filters</subject><subject>Target detection</subject><subject>Tracking</subject><subject>Vehicle safety</subject><subject>YOLOv7</subject><issn>0916-8532</issn><issn>1745-1361</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><recordid>eNpNkEtPwzAQhC0EEuXxDzhY4pzidR5OjqVpAalSkSgHTtbGsVOXNCm2i8S_J6i8TrvanW9GGkKugI0hzcVNcNh525kxZzyelY-CFfERGYFI0gjiDI7JiBWQRXka81Ny5v2GMcg5pCOiJrR09l07Osdgm72mpQ5aBdt3dNI2vbNhvaW36HVNh1P50eHWKrpyqF5t19De0Kcttu2AK4stXaFrdPD02X99X5aL5bu4ICcGW68vv-c5eZ7PVtP7aLG8e5hOFpFKRBwiUwllhMaKp6YWGdRGF0KAYaCMQoGFgioxAJUCVbPEaMWB5zmmVQIJhzo-J9cH353r3_baB7np964bIiUvGBQizbJkUCUHlXK9904buXN2i-5DApNfdcqfOuW_Ogfs6YBtfMBG_0LoglWt_oNmwDJZSoCf7Z_Lr1qt0UndxZ-mzIhy</recordid><startdate>20231101</startdate><enddate>20231101</enddate><creator>LIU, Shugang</creator><creator>WANG, Yujie</creator><creator>YU, Qiangguo</creator><creator>ZHAN, Jie</creator><creator>LIU, Hongli</creator><creator>LIU, Jiangtao</creator><general>The Institute of Electronics, Information and Communication Engineers</general><general>Japan Science and Technology Agency</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope></search><sort><creationdate>20231101</creationdate><title>A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7</title><author>LIU, Shugang ; WANG, Yujie ; YU, Qiangguo ; ZHAN, Jie ; LIU, Hongli ; LIU, Jiangtao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c473t-fb7cf7eab25fd761dfe9771f01cfca7a9c1b4f11bc1cd04fec21288a5b41421d3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Algorithms</topic><topic>attention mechanism</topic><topic>deep learning</topic><topic>Driver fatigue</topic><topic>driver fatigue recognition</topic><topic>Eye (anatomy)</topic><topic>Feature extraction</topic><topic>Image enhancement</topic><topic>Image filters</topic><topic>Target detection</topic><topic>Tracking</topic><topic>Vehicle safety</topic><topic>YOLOv7</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>LIU, Shugang</creatorcontrib><creatorcontrib>WANG, Yujie</creatorcontrib><creatorcontrib>YU, Qiangguo</creatorcontrib><creatorcontrib>ZHAN, Jie</creatorcontrib><creatorcontrib>LIU, Hongli</creatorcontrib><creatorcontrib>LIU, Jiangtao</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEICE Transactions on Information and Systems</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>LIU, Shugang</au><au>WANG, Yujie</au><au>YU, Qiangguo</au><au>ZHAN, Jie</au><au>LIU, Hongli</au><au>LIU, Jiangtao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7</atitle><jtitle>IEICE Transactions on Information and Systems</jtitle><addtitle>IEICE Trans. Inf. &amp; Syst.</addtitle><date>2023-11-01</date><risdate>2023</risdate><volume>E106.D</volume><issue>11</issue><spage>1881</spage><epage>1890</epage><pages>1881-1890</pages><artnum>2023EDP7093</artnum><issn>0916-8532</issn><eissn>1745-1361</eissn><abstract>Driver fatigue detection has become crucial in vehicle safety technology. Achieving high accuracy and real-time performance in detecting driver fatigue is paramount. In this paper, we propose a novel driver fatigue detection algorithm based on dynamic tracking of Facial Eyes and Yawning using YOLOv7, named FEY-YOLOv7. The Coordinate Attention module is inserted into YOLOv7 to enhance its dynamic tracking accuracy by focusing on coordinate information. Additionally, a small target detection head is incorporated into the network architecture to promote the feature extraction ability of small facial targets such as eyes and mouth. In terms of compution, the YOLOv7 network architecture is significantly simplified to achieve high detection speed. Using the proposed PERYAWN algorithm, driver status is labeled and detected by four classes: open_eye, closed_eye, open_mouth, and closed_mouth. Furthermore, the Guided Image Filtering algorithm is employed to enhance image details. The proposed FEY-YOLOv7 is trained and validated on RGB-infrared datasets. The results show that FEY-YOLOv7 has achieved mAP of 0.983 and FPS of 101. This indicates that FEY-YOLOv7 is superior to state-of-the-art methods in accuracy and speed, providing an effective and practical solution for image-based driver fatigue detection.</abstract><cop>Tokyo</cop><pub>The Institute of Electronics, Information and Communication Engineers</pub><doi>10.1587/transinf.2023EDP7093</doi><tpages>10</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0916-8532
ispartof IEICE Transactions on Information and Systems, 2023/11/01, Vol.E106.D(11), pp.1881-1890
issn 0916-8532
1745-1361
language eng
recordid cdi_proquest_journals_2901975664
source J-STAGE Free; EZB-FREE-00999 freely available EZB journals
subjects Accuracy
Algorithms
attention mechanism
deep learning
Driver fatigue
driver fatigue recognition
Eye (anatomy)
Feature extraction
Image enhancement
Image filters
Target detection
Tracking
Vehicle safety
YOLOv7
title A Driver Fatigue Detection Algorithm Based on Dynamic Tracking of Small Facial Targets Using YOLOv7
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-05T10%3A11%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20Driver%20Fatigue%20Detection%20Algorithm%20Based%20on%20Dynamic%20Tracking%20of%20Small%20Facial%20Targets%20Using%20YOLOv7&rft.jtitle=IEICE%20Transactions%20on%20Information%20and%20Systems&rft.au=LIU,%20Shugang&rft.date=2023-11-01&rft.volume=E106.D&rft.issue=11&rft.spage=1881&rft.epage=1890&rft.pages=1881-1890&rft.artnum=2023EDP7093&rft.issn=0916-8532&rft.eissn=1745-1361&rft_id=info:doi/10.1587/transinf.2023EDP7093&rft_dat=%3Cproquest_cross%3E2901975664%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2901975664&rft_id=info:pmid/&rfr_iscdi=true