Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment
For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV...
Gespeichert in:
Veröffentlicht in: | IEEE internet of things journal 2024-10, p.1-1 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1 |
---|---|
container_issue | |
container_start_page | 1 |
container_title | IEEE internet of things journal |
container_volume | |
creator | Im, Su Jin Yun, Chaeyeong Lee, Sung Jae Park, Kang Ryoung |
description | For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology. |
doi_str_mv | 10.1109/JIOT.2024.3482453 |
format | Article |
fullrecord | <record><control><sourceid>crossref_RIE</sourceid><recordid>TN_cdi_ieee_primary_10720846</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10720846</ieee_id><sourcerecordid>10_1109_JIOT_2024_3482453</sourcerecordid><originalsourceid>FETCH-LOGICAL-c636-67ff6e47302823cbe30fd316dde84502d5315ed089bb79f91173d7ae7fa411b63</originalsourceid><addsrcrecordid>eNpNkEtOwzAURS0EElXpApAYeAMp_sVOhqUKEFTUAZlHTvycGiVO5URU7ITlkqgddPSeru49g4PQIyVrSkn6_JHvizUjTKy5SJiI-Q1aMM5UJKRkt1f_PVoNwzchZJrFNJUL9LcJo7OudrrFuR-hbV0DvoboRQ9g8K4_RVNyGPGnDs4DzjvdAM78QU-lDvyIbR_wF3Taj66enmYO9eh6j53HmZna11ycdcf-BGFiz3HwMOLe4uLgfDNM3B8Xej8jHtCd1e0Aq8tdouI1K7bv0W7_lm83u6iWXEZSWStBKE5YwnhdASfWcCqNgUTEhJmY0xgMSdKqUqlNKVXcKA3KakFpJfkS0TO2Dv0wBLDlMbhOh9-SknKWW85yy1lueZE7bZ7OGwcAV33FSCIk_wffGHiY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</title><source>IEEE Electronic Library (IEL)</source><creator>Im, Su Jin ; Yun, Chaeyeong ; Lee, Sung Jae ; Park, Kang Ryoung</creator><creatorcontrib>Im, Su Jin ; Yun, Chaeyeong ; Lee, Sung Jae ; Park, Kang Ryoung</creatorcontrib><description>For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.</description><identifier>ISSN: 2327-4662</identifier><identifier>EISSN: 2327-4662</identifier><identifier>DOI: 10.1109/JIOT.2024.3482453</identifier><identifier>CODEN: IITJAU</identifier><language>eng</language><publisher>IEEE</publisher><subject>Accuracy ; Artificial intelligence ; autonomous underwater vehicle ; edge intelligence empowered internet of things ; Feature extraction ; Image color analysis ; Image edge detection ; Image enhancement ; Internet of Things ; low-light image enhancement ; Semantic segmentation ; semantic segmentation of marine animal ; Semantics ; Signal to noise ratio ; Transformers</subject><ispartof>IEEE internet of things journal, 2024-10, p.1-1</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0000-0002-1214-9510</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10720846$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10720846$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Im, Su Jin</creatorcontrib><creatorcontrib>Yun, Chaeyeong</creatorcontrib><creatorcontrib>Lee, Sung Jae</creatorcontrib><creatorcontrib>Park, Kang Ryoung</creatorcontrib><title>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</title><title>IEEE internet of things journal</title><addtitle>JIoT</addtitle><description>For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.</description><subject>Accuracy</subject><subject>Artificial intelligence</subject><subject>autonomous underwater vehicle</subject><subject>edge intelligence empowered internet of things</subject><subject>Feature extraction</subject><subject>Image color analysis</subject><subject>Image edge detection</subject><subject>Image enhancement</subject><subject>Internet of Things</subject><subject>low-light image enhancement</subject><subject>Semantic segmentation</subject><subject>semantic segmentation of marine animal</subject><subject>Semantics</subject><subject>Signal to noise ratio</subject><subject>Transformers</subject><issn>2327-4662</issn><issn>2327-4662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkEtOwzAURS0EElXpApAYeAMp_sVOhqUKEFTUAZlHTvycGiVO5URU7ITlkqgddPSeru49g4PQIyVrSkn6_JHvizUjTKy5SJiI-Q1aMM5UJKRkt1f_PVoNwzchZJrFNJUL9LcJo7OudrrFuR-hbV0DvoboRQ9g8K4_RVNyGPGnDs4DzjvdAM78QU-lDvyIbR_wF3Taj66enmYO9eh6j53HmZna11ycdcf-BGFiz3HwMOLe4uLgfDNM3B8Xej8jHtCd1e0Aq8tdouI1K7bv0W7_lm83u6iWXEZSWStBKE5YwnhdASfWcCqNgUTEhJmY0xgMSdKqUqlNKVXcKA3KakFpJfkS0TO2Dv0wBLDlMbhOh9-SknKWW85yy1lueZE7bZ7OGwcAV33FSCIk_wffGHiY</recordid><startdate>20241016</startdate><enddate>20241016</enddate><creator>Im, Su Jin</creator><creator>Yun, Chaeyeong</creator><creator>Lee, Sung Jae</creator><creator>Park, Kang Ryoung</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-1214-9510</orcidid></search><sort><creationdate>20241016</creationdate><title>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</title><author>Im, Su Jin ; Yun, Chaeyeong ; Lee, Sung Jae ; Park, Kang Ryoung</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c636-67ff6e47302823cbe30fd316dde84502d5315ed089bb79f91173d7ae7fa411b63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Artificial intelligence</topic><topic>autonomous underwater vehicle</topic><topic>edge intelligence empowered internet of things</topic><topic>Feature extraction</topic><topic>Image color analysis</topic><topic>Image edge detection</topic><topic>Image enhancement</topic><topic>Internet of Things</topic><topic>low-light image enhancement</topic><topic>Semantic segmentation</topic><topic>semantic segmentation of marine animal</topic><topic>Semantics</topic><topic>Signal to noise ratio</topic><topic>Transformers</topic><toplevel>online_resources</toplevel><creatorcontrib>Im, Su Jin</creatorcontrib><creatorcontrib>Yun, Chaeyeong</creatorcontrib><creatorcontrib>Lee, Sung Jae</creatorcontrib><creatorcontrib>Park, Kang Ryoung</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE internet of things journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Im, Su Jin</au><au>Yun, Chaeyeong</au><au>Lee, Sung Jae</au><au>Park, Kang Ryoung</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</atitle><jtitle>IEEE internet of things journal</jtitle><stitle>JIoT</stitle><date>2024-10-16</date><risdate>2024</risdate><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>2327-4662</issn><eissn>2327-4662</eissn><coden>IITJAU</coden><abstract>For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.</abstract><pub>IEEE</pub><doi>10.1109/JIOT.2024.3482453</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-1214-9510</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 2327-4662 |
ispartof | IEEE internet of things journal, 2024-10, p.1-1 |
issn | 2327-4662 2327-4662 |
language | eng |
recordid | cdi_ieee_primary_10720846 |
source | IEEE Electronic Library (IEL) |
subjects | Accuracy Artificial intelligence autonomous underwater vehicle edge intelligence empowered internet of things Feature extraction Image color analysis Image edge detection Image enhancement Internet of Things low-light image enhancement Semantic segmentation semantic segmentation of marine animal Semantics Signal to noise ratio Transformers |
title | Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-21T15%3A45%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Artificial%20Intelligence-Based%20Low-light%20Marine%20Image%20Enhancement%20for%20Semantic%20Segmentation%20in%20Edge%20Intelligence%20Empowered%20Internet%20of%20Things%20Environment&rft.jtitle=IEEE%20internet%20of%20things%20journal&rft.au=Im,%20Su%20Jin&rft.date=2024-10-16&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=2327-4662&rft.eissn=2327-4662&rft.coden=IITJAU&rft_id=info:doi/10.1109/JIOT.2024.3482453&rft_dat=%3Ccrossref_RIE%3E10_1109_JIOT_2024_3482453%3C/crossref_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10720846&rfr_iscdi=true |