Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment

For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE internet of things journal 2024-10, p.1-1
Hauptverfasser: Im, Su Jin, Yun, Chaeyeong, Lee, Sung Jae, Park, Kang Ryoung
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 1
container_issue
container_start_page 1
container_title IEEE internet of things journal
container_volume
creator Im, Su Jin
Yun, Chaeyeong
Lee, Sung Jae
Park, Kang Ryoung
description For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.
doi_str_mv 10.1109/JIOT.2024.3482453
format Article
fullrecord <record><control><sourceid>crossref_RIE</sourceid><recordid>TN_cdi_ieee_primary_10720846</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10720846</ieee_id><sourcerecordid>10_1109_JIOT_2024_3482453</sourcerecordid><originalsourceid>FETCH-LOGICAL-c636-67ff6e47302823cbe30fd316dde84502d5315ed089bb79f91173d7ae7fa411b63</originalsourceid><addsrcrecordid>eNpNkEtOwzAURS0EElXpApAYeAMp_sVOhqUKEFTUAZlHTvycGiVO5URU7ITlkqgddPSeru49g4PQIyVrSkn6_JHvizUjTKy5SJiI-Q1aMM5UJKRkt1f_PVoNwzchZJrFNJUL9LcJo7OudrrFuR-hbV0DvoboRQ9g8K4_RVNyGPGnDs4DzjvdAM78QU-lDvyIbR_wF3Taj66enmYO9eh6j53HmZna11ycdcf-BGFiz3HwMOLe4uLgfDNM3B8Xej8jHtCd1e0Aq8tdouI1K7bv0W7_lm83u6iWXEZSWStBKE5YwnhdASfWcCqNgUTEhJmY0xgMSdKqUqlNKVXcKA3KakFpJfkS0TO2Dv0wBLDlMbhOh9-SknKWW85yy1lueZE7bZ7OGwcAV33FSCIk_wffGHiY</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</title><source>IEEE Electronic Library (IEL)</source><creator>Im, Su Jin ; Yun, Chaeyeong ; Lee, Sung Jae ; Park, Kang Ryoung</creator><creatorcontrib>Im, Su Jin ; Yun, Chaeyeong ; Lee, Sung Jae ; Park, Kang Ryoung</creatorcontrib><description>For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.</description><identifier>ISSN: 2327-4662</identifier><identifier>EISSN: 2327-4662</identifier><identifier>DOI: 10.1109/JIOT.2024.3482453</identifier><identifier>CODEN: IITJAU</identifier><language>eng</language><publisher>IEEE</publisher><subject>Accuracy ; Artificial intelligence ; autonomous underwater vehicle ; edge intelligence empowered internet of things ; Feature extraction ; Image color analysis ; Image edge detection ; Image enhancement ; Internet of Things ; low-light image enhancement ; Semantic segmentation ; semantic segmentation of marine animal ; Semantics ; Signal to noise ratio ; Transformers</subject><ispartof>IEEE internet of things journal, 2024-10, p.1-1</ispartof><woscitedreferencessubscribed>false</woscitedreferencessubscribed><orcidid>0000-0002-1214-9510</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10720846$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10720846$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Im, Su Jin</creatorcontrib><creatorcontrib>Yun, Chaeyeong</creatorcontrib><creatorcontrib>Lee, Sung Jae</creatorcontrib><creatorcontrib>Park, Kang Ryoung</creatorcontrib><title>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</title><title>IEEE internet of things journal</title><addtitle>JIoT</addtitle><description>For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.</description><subject>Accuracy</subject><subject>Artificial intelligence</subject><subject>autonomous underwater vehicle</subject><subject>edge intelligence empowered internet of things</subject><subject>Feature extraction</subject><subject>Image color analysis</subject><subject>Image edge detection</subject><subject>Image enhancement</subject><subject>Internet of Things</subject><subject>low-light image enhancement</subject><subject>Semantic segmentation</subject><subject>semantic segmentation of marine animal</subject><subject>Semantics</subject><subject>Signal to noise ratio</subject><subject>Transformers</subject><issn>2327-4662</issn><issn>2327-4662</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNpNkEtOwzAURS0EElXpApAYeAMp_sVOhqUKEFTUAZlHTvycGiVO5URU7ITlkqgddPSeru49g4PQIyVrSkn6_JHvizUjTKy5SJiI-Q1aMM5UJKRkt1f_PVoNwzchZJrFNJUL9LcJo7OudrrFuR-hbV0DvoboRQ9g8K4_RVNyGPGnDs4DzjvdAM78QU-lDvyIbR_wF3Taj66enmYO9eh6j53HmZna11ycdcf-BGFiz3HwMOLe4uLgfDNM3B8Xej8jHtCd1e0Aq8tdouI1K7bv0W7_lm83u6iWXEZSWStBKE5YwnhdASfWcCqNgUTEhJmY0xgMSdKqUqlNKVXcKA3KakFpJfkS0TO2Dv0wBLDlMbhOh9-SknKWW85yy1lueZE7bZ7OGwcAV33FSCIk_wffGHiY</recordid><startdate>20241016</startdate><enddate>20241016</enddate><creator>Im, Su Jin</creator><creator>Yun, Chaeyeong</creator><creator>Lee, Sung Jae</creator><creator>Park, Kang Ryoung</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-1214-9510</orcidid></search><sort><creationdate>20241016</creationdate><title>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</title><author>Im, Su Jin ; Yun, Chaeyeong ; Lee, Sung Jae ; Park, Kang Ryoung</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c636-67ff6e47302823cbe30fd316dde84502d5315ed089bb79f91173d7ae7fa411b63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Artificial intelligence</topic><topic>autonomous underwater vehicle</topic><topic>edge intelligence empowered internet of things</topic><topic>Feature extraction</topic><topic>Image color analysis</topic><topic>Image edge detection</topic><topic>Image enhancement</topic><topic>Internet of Things</topic><topic>low-light image enhancement</topic><topic>Semantic segmentation</topic><topic>semantic segmentation of marine animal</topic><topic>Semantics</topic><topic>Signal to noise ratio</topic><topic>Transformers</topic><toplevel>online_resources</toplevel><creatorcontrib>Im, Su Jin</creatorcontrib><creatorcontrib>Yun, Chaeyeong</creatorcontrib><creatorcontrib>Lee, Sung Jae</creatorcontrib><creatorcontrib>Park, Kang Ryoung</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE internet of things journal</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Im, Su Jin</au><au>Yun, Chaeyeong</au><au>Lee, Sung Jae</au><au>Park, Kang Ryoung</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment</atitle><jtitle>IEEE internet of things journal</jtitle><stitle>JIoT</stitle><date>2024-10-16</date><risdate>2024</risdate><spage>1</spage><epage>1</epage><pages>1-1</pages><issn>2327-4662</issn><eissn>2327-4662</eissn><coden>IITJAU</coden><abstract>For accurate detection of marine life to utilize marine resources while ensuring protection of ecosystem, marine animal segmentation has been widely researched. Furthermore, development of autonomous underwater vehicle (AUV) has expanded the scope of marine ecosystem research into deep sea where AUV utilizes artificial light sources to address the problem of low-light conditions. However, these light sources can disturb the ecosystem. In addition, extremely low-light images are acquired in areas distant from AUV due to the limitations of the light sources, such as limited field of view, resulting in poor quality of underwater images. Therefore, we propose multi-scale features and residual dual attention-based low-light image enhancement network (MRLE-Net) for semantic segmentation of marine images. To preserve fine-grained information under low-light environment and reduce noise, MRLE-Net introduces dual feature extraction, multi-scale feature extraction, and residual dual attention blocks. Furthermore, to improve the semantic segmentation accuracy, it employs a discrete wavelet transform-based loss function. In experiments using two open databases of MAS3K and DeepFish, the mean intersection of union values of semantic segmentation by our method are 78.72% and 83.62%, respectively, showing superior accuracy to the state-of-the-art methods. In addition, our MRLE-Net demonstrates its ability to operate on embedded system with low computational resources as edge computing. From them, we confirm that it can be adopted to AUV in edge intelligence empowered internet of things environment by removing communication overheads caused by transmitting lots of images from AUV's camera to and receiving the segmentation result from high computing cloud by 5G technology.</abstract><pub>IEEE</pub><doi>10.1109/JIOT.2024.3482453</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-1214-9510</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 2327-4662
ispartof IEEE internet of things journal, 2024-10, p.1-1
issn 2327-4662
2327-4662
language eng
recordid cdi_ieee_primary_10720846
source IEEE Electronic Library (IEL)
subjects Accuracy
Artificial intelligence
autonomous underwater vehicle
edge intelligence empowered internet of things
Feature extraction
Image color analysis
Image edge detection
Image enhancement
Internet of Things
low-light image enhancement
Semantic segmentation
semantic segmentation of marine animal
Semantics
Signal to noise ratio
Transformers
title Artificial Intelligence-Based Low-light Marine Image Enhancement for Semantic Segmentation in Edge Intelligence Empowered Internet of Things Environment
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-21T15%3A45%3A11IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Artificial%20Intelligence-Based%20Low-light%20Marine%20Image%20Enhancement%20for%20Semantic%20Segmentation%20in%20Edge%20Intelligence%20Empowered%20Internet%20of%20Things%20Environment&rft.jtitle=IEEE%20internet%20of%20things%20journal&rft.au=Im,%20Su%20Jin&rft.date=2024-10-16&rft.spage=1&rft.epage=1&rft.pages=1-1&rft.issn=2327-4662&rft.eissn=2327-4662&rft.coden=IITJAU&rft_id=info:doi/10.1109/JIOT.2024.3482453&rft_dat=%3Ccrossref_RIE%3E10_1109_JIOT_2024_3482453%3C/crossref_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10720846&rfr_iscdi=true