Holistic multitask regression network for multiapplication shape regression segmentation
•Achieved multiapplication shape regression segmentation in a single framework.•Formulated segmentation as a multitask regression task; models task correlations.•Direct coordinate estimation of an organ's shape contour, jointly captures shape.•A multitask regression deep learning framework with...
Gespeichert in:
Veröffentlicht in: | Medical image analysis 2020-10, Vol.65, p.101783-101783, Article 101783 |
---|---|
Hauptverfasser: | , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 101783 |
---|---|
container_issue | |
container_start_page | 101783 |
container_title | Medical image analysis |
container_volume | 65 |
creator | Tam, Clara M. Zhang, Dong Chen, Bo Peters, Terry Li, Shuo |
description | •Achieved multiapplication shape regression segmentation in a single framework.•Formulated segmentation as a multitask regression task; models task correlations.•Direct coordinate estimation of an organ's shape contour, jointly captures shape.•A multitask regression deep learning framework with multiscale+fused representation.
[Display omitted]
A holistic multitask regression approach was implemented to tackle the limitations of clinical image analysis. Standard practice requires identifying multiple anatomic structures in multiple planes from multiple anatomic regions using multiple modalities. The proposed novel holistic multitask regression network (HMR-Net) formulates organ segmentation as a multitask learning problem. Multitask learning leverages the strength of joint task problem solving from capturing task correlations. HMR-Net performs multitask regression by estimating an organ’s class, regional location, and precise contour coordinates. The estimation of each coordinate point also corresponds to another regression task. HMR-Net leverages hierarchical multiscale and fused organ features to handle nonlinear relationships between image appearance and distinct organ properties. Simultaneously, holistic shape information is captured by encoding coordinate correlations. The multitask pipeline enables the capturing of holistic organ information (e.g. class, location, shape) to perform shape regression for medical image segmentation. HMR-Net was validated on eight representative datasets obtained from a total of 222 subjects. A mean average precision and dice score reaching up to 0.81 and 0.93, respectively, was achieved on the representative multiapplication database. The generalized model demonstrates comparable or superior performance compared to state-of-the-art algorithms. The high-performance accuracy demonstrates our model as an effective general framework to perform organ shape regression in multiple applications. This method was proven to provide high-contrast sensitivity to delineate even the smallest and oddly shaped organs. HMR-Net’s flexible framework holds great potential in providing a fully automatic preliminary analysis for multiple types of medical images. |
doi_str_mv | 10.1016/j.media.2020.101783 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_2427522150</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S136184152030147X</els_id><sourcerecordid>2427522150</sourcerecordid><originalsourceid>FETCH-LOGICAL-c364t-802b922b83f0805092aa56a8086e111c4ce54b7286387dceaeb8275d1103df363</originalsourceid><addsrcrecordid>eNp9kE9LxDAQxYMouK5-Ai8FL1665k-bZg8eZFFXWPCi4C2k6XRNt21qkip-e9utiHjwNMO83xtmHkLnBC8IJvyqWjRQGLWgmO4nmWAHaEYYJ7FIKDv86Ul6jE68rzDGWZLgGXpZ29r4YHTU9HUwQfld5GDrwHtj26iF8GHdLiqtmwDVdbXRKoyif1Ud_KY9bBtow149RUelqj2cfdc5er67fVqt483j_cPqZhNrxpMQC0zzJaW5YCUWOMVLqlTKlcCCAyFEJxrSJM-o4ExkhQYFuaBZWhCCWVEyzuboctrbOfvWgw-yMV5DXasWbO8lTQacUpLiAb34g1a2d-1w3UBxyrNE8HEhmyjtrPcOStk50yj3KQmWY9qykvu05Zi2nNIeXNeTC4Zf3w046bWBVg-gAx1kYc2__i9hO4mU</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2462674866</pqid></control><display><type>article</type><title>Holistic multitask regression network for multiapplication shape regression segmentation</title><source>Access via ScienceDirect (Elsevier)</source><creator>Tam, Clara M. ; Zhang, Dong ; Chen, Bo ; Peters, Terry ; Li, Shuo</creator><creatorcontrib>Tam, Clara M. ; Zhang, Dong ; Chen, Bo ; Peters, Terry ; Li, Shuo</creatorcontrib><description>•Achieved multiapplication shape regression segmentation in a single framework.•Formulated segmentation as a multitask regression task; models task correlations.•Direct coordinate estimation of an organ's shape contour, jointly captures shape.•A multitask regression deep learning framework with multiscale+fused representation.
[Display omitted]
A holistic multitask regression approach was implemented to tackle the limitations of clinical image analysis. Standard practice requires identifying multiple anatomic structures in multiple planes from multiple anatomic regions using multiple modalities. The proposed novel holistic multitask regression network (HMR-Net) formulates organ segmentation as a multitask learning problem. Multitask learning leverages the strength of joint task problem solving from capturing task correlations. HMR-Net performs multitask regression by estimating an organ’s class, regional location, and precise contour coordinates. The estimation of each coordinate point also corresponds to another regression task. HMR-Net leverages hierarchical multiscale and fused organ features to handle nonlinear relationships between image appearance and distinct organ properties. Simultaneously, holistic shape information is captured by encoding coordinate correlations. The multitask pipeline enables the capturing of holistic organ information (e.g. class, location, shape) to perform shape regression for medical image segmentation. HMR-Net was validated on eight representative datasets obtained from a total of 222 subjects. A mean average precision and dice score reaching up to 0.81 and 0.93, respectively, was achieved on the representative multiapplication database. The generalized model demonstrates comparable or superior performance compared to state-of-the-art algorithms. The high-performance accuracy demonstrates our model as an effective general framework to perform organ shape regression in multiple applications. This method was proven to provide high-contrast sensitivity to delineate even the smallest and oddly shaped organs. HMR-Net’s flexible framework holds great potential in providing a fully automatic preliminary analysis for multiple types of medical images.</description><identifier>ISSN: 1361-8415</identifier><identifier>EISSN: 1361-8423</identifier><identifier>DOI: 10.1016/j.media.2020.101783</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>Algorithms ; Cross-stitch units ; Deep learning ; Image analysis ; Image processing ; Image segmentation ; Learning ; Manifold regularization ; Medical imaging ; Model accuracy ; Multiapplication ; Multitask learning ; Organs ; Problem solving ; Regression analysis ; Shape regression segmentation</subject><ispartof>Medical image analysis, 2020-10, Vol.65, p.101783-101783, Article 101783</ispartof><rights>2020 Elsevier B.V.</rights><rights>Copyright Elsevier BV Oct 2020</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c364t-802b922b83f0805092aa56a8086e111c4ce54b7286387dceaeb8275d1103df363</citedby><cites>FETCH-LOGICAL-c364t-802b922b83f0805092aa56a8086e111c4ce54b7286387dceaeb8275d1103df363</cites><orcidid>0000-0002-5184-3230</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.media.2020.101783$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Tam, Clara M.</creatorcontrib><creatorcontrib>Zhang, Dong</creatorcontrib><creatorcontrib>Chen, Bo</creatorcontrib><creatorcontrib>Peters, Terry</creatorcontrib><creatorcontrib>Li, Shuo</creatorcontrib><title>Holistic multitask regression network for multiapplication shape regression segmentation</title><title>Medical image analysis</title><description>•Achieved multiapplication shape regression segmentation in a single framework.•Formulated segmentation as a multitask regression task; models task correlations.•Direct coordinate estimation of an organ's shape contour, jointly captures shape.•A multitask regression deep learning framework with multiscale+fused representation.
[Display omitted]
A holistic multitask regression approach was implemented to tackle the limitations of clinical image analysis. Standard practice requires identifying multiple anatomic structures in multiple planes from multiple anatomic regions using multiple modalities. The proposed novel holistic multitask regression network (HMR-Net) formulates organ segmentation as a multitask learning problem. Multitask learning leverages the strength of joint task problem solving from capturing task correlations. HMR-Net performs multitask regression by estimating an organ’s class, regional location, and precise contour coordinates. The estimation of each coordinate point also corresponds to another regression task. HMR-Net leverages hierarchical multiscale and fused organ features to handle nonlinear relationships between image appearance and distinct organ properties. Simultaneously, holistic shape information is captured by encoding coordinate correlations. The multitask pipeline enables the capturing of holistic organ information (e.g. class, location, shape) to perform shape regression for medical image segmentation. HMR-Net was validated on eight representative datasets obtained from a total of 222 subjects. A mean average precision and dice score reaching up to 0.81 and 0.93, respectively, was achieved on the representative multiapplication database. The generalized model demonstrates comparable or superior performance compared to state-of-the-art algorithms. The high-performance accuracy demonstrates our model as an effective general framework to perform organ shape regression in multiple applications. This method was proven to provide high-contrast sensitivity to delineate even the smallest and oddly shaped organs. HMR-Net’s flexible framework holds great potential in providing a fully automatic preliminary analysis for multiple types of medical images.</description><subject>Algorithms</subject><subject>Cross-stitch units</subject><subject>Deep learning</subject><subject>Image analysis</subject><subject>Image processing</subject><subject>Image segmentation</subject><subject>Learning</subject><subject>Manifold regularization</subject><subject>Medical imaging</subject><subject>Model accuracy</subject><subject>Multiapplication</subject><subject>Multitask learning</subject><subject>Organs</subject><subject>Problem solving</subject><subject>Regression analysis</subject><subject>Shape regression segmentation</subject><issn>1361-8415</issn><issn>1361-8423</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9kE9LxDAQxYMouK5-Ai8FL1665k-bZg8eZFFXWPCi4C2k6XRNt21qkip-e9utiHjwNMO83xtmHkLnBC8IJvyqWjRQGLWgmO4nmWAHaEYYJ7FIKDv86Ul6jE68rzDGWZLgGXpZ29r4YHTU9HUwQfld5GDrwHtj26iF8GHdLiqtmwDVdbXRKoyif1Ud_KY9bBtow149RUelqj2cfdc5er67fVqt483j_cPqZhNrxpMQC0zzJaW5YCUWOMVLqlTKlcCCAyFEJxrSJM-o4ExkhQYFuaBZWhCCWVEyzuboctrbOfvWgw-yMV5DXasWbO8lTQacUpLiAb34g1a2d-1w3UBxyrNE8HEhmyjtrPcOStk50yj3KQmWY9qykvu05Zi2nNIeXNeTC4Zf3w046bWBVg-gAx1kYc2__i9hO4mU</recordid><startdate>202010</startdate><enddate>202010</enddate><creator>Tam, Clara M.</creator><creator>Zhang, Dong</creator><creator>Chen, Bo</creator><creator>Peters, Terry</creator><creator>Li, Shuo</creator><general>Elsevier B.V</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7QO</scope><scope>8FD</scope><scope>FR3</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>P64</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0002-5184-3230</orcidid></search><sort><creationdate>202010</creationdate><title>Holistic multitask regression network for multiapplication shape regression segmentation</title><author>Tam, Clara M. ; Zhang, Dong ; Chen, Bo ; Peters, Terry ; Li, Shuo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c364t-802b922b83f0805092aa56a8086e111c4ce54b7286387dceaeb8275d1103df363</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Cross-stitch units</topic><topic>Deep learning</topic><topic>Image analysis</topic><topic>Image processing</topic><topic>Image segmentation</topic><topic>Learning</topic><topic>Manifold regularization</topic><topic>Medical imaging</topic><topic>Model accuracy</topic><topic>Multiapplication</topic><topic>Multitask learning</topic><topic>Organs</topic><topic>Problem solving</topic><topic>Regression analysis</topic><topic>Shape regression segmentation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Tam, Clara M.</creatorcontrib><creatorcontrib>Zhang, Dong</creatorcontrib><creatorcontrib>Chen, Bo</creatorcontrib><creatorcontrib>Peters, Terry</creatorcontrib><creatorcontrib>Li, Shuo</creatorcontrib><collection>CrossRef</collection><collection>Biotechnology Research Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Premium</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>MEDLINE - Academic</collection><jtitle>Medical image analysis</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Tam, Clara M.</au><au>Zhang, Dong</au><au>Chen, Bo</au><au>Peters, Terry</au><au>Li, Shuo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Holistic multitask regression network for multiapplication shape regression segmentation</atitle><jtitle>Medical image analysis</jtitle><date>2020-10</date><risdate>2020</risdate><volume>65</volume><spage>101783</spage><epage>101783</epage><pages>101783-101783</pages><artnum>101783</artnum><issn>1361-8415</issn><eissn>1361-8423</eissn><abstract>•Achieved multiapplication shape regression segmentation in a single framework.•Formulated segmentation as a multitask regression task; models task correlations.•Direct coordinate estimation of an organ's shape contour, jointly captures shape.•A multitask regression deep learning framework with multiscale+fused representation.
[Display omitted]
A holistic multitask regression approach was implemented to tackle the limitations of clinical image analysis. Standard practice requires identifying multiple anatomic structures in multiple planes from multiple anatomic regions using multiple modalities. The proposed novel holistic multitask regression network (HMR-Net) formulates organ segmentation as a multitask learning problem. Multitask learning leverages the strength of joint task problem solving from capturing task correlations. HMR-Net performs multitask regression by estimating an organ’s class, regional location, and precise contour coordinates. The estimation of each coordinate point also corresponds to another regression task. HMR-Net leverages hierarchical multiscale and fused organ features to handle nonlinear relationships between image appearance and distinct organ properties. Simultaneously, holistic shape information is captured by encoding coordinate correlations. The multitask pipeline enables the capturing of holistic organ information (e.g. class, location, shape) to perform shape regression for medical image segmentation. HMR-Net was validated on eight representative datasets obtained from a total of 222 subjects. A mean average precision and dice score reaching up to 0.81 and 0.93, respectively, was achieved on the representative multiapplication database. The generalized model demonstrates comparable or superior performance compared to state-of-the-art algorithms. The high-performance accuracy demonstrates our model as an effective general framework to perform organ shape regression in multiple applications. This method was proven to provide high-contrast sensitivity to delineate even the smallest and oddly shaped organs. HMR-Net’s flexible framework holds great potential in providing a fully automatic preliminary analysis for multiple types of medical images.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.media.2020.101783</doi><tpages>1</tpages><orcidid>https://orcid.org/0000-0002-5184-3230</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1361-8415 |
ispartof | Medical image analysis, 2020-10, Vol.65, p.101783-101783, Article 101783 |
issn | 1361-8415 1361-8423 |
language | eng |
recordid | cdi_proquest_miscellaneous_2427522150 |
source | Access via ScienceDirect (Elsevier) |
subjects | Algorithms Cross-stitch units Deep learning Image analysis Image processing Image segmentation Learning Manifold regularization Medical imaging Model accuracy Multiapplication Multitask learning Organs Problem solving Regression analysis Shape regression segmentation |
title | Holistic multitask regression network for multiapplication shape regression segmentation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-23T16%3A00%3A08IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Holistic%20multitask%20regression%20network%20for%20multiapplication%20shape%20regression%20segmentation&rft.jtitle=Medical%20image%20analysis&rft.au=Tam,%20Clara%20M.&rft.date=2020-10&rft.volume=65&rft.spage=101783&rft.epage=101783&rft.pages=101783-101783&rft.artnum=101783&rft.issn=1361-8415&rft.eissn=1361-8423&rft_id=info:doi/10.1016/j.media.2020.101783&rft_dat=%3Cproquest_cross%3E2427522150%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2462674866&rft_id=info:pmid/&rft_els_id=S136184152030147X&rfr_iscdi=true |