Combined 2D–3D categorization and classification for multimodal perception systems
In this article we describe an object perception system for autonomous robots performing everyday manipulation tasks in kitchen environments. The perception system gains its strengths by exploiting that the robots are to perform the same kinds of tasks with the same objects over and over again. It d...
Gespeichert in:
| Veröffentlicht in: | The International journal of robotics research 2011-09, Vol.30 (11), p.1378-1402 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 1402 |
|---|---|
| container_issue | 11 |
| container_start_page | 1378 |
| container_title | The International journal of robotics research |
| container_volume | 30 |
| creator | Marton, Zoltan-Csaba Pangercic, Dejan Blodow, Nico Beetz, Michael |
| description | In this article we describe an object perception system for autonomous robots performing everyday manipulation tasks in kitchen environments. The perception system gains its strengths by exploiting that the robots are to perform the same kinds of tasks with the same objects over and over again. It does so by learning the object representations necessary for the recognition and reconstruction in the context of pick-and-place tasks. The system employs a library of specialized perception routines that solve different, well-defined perceptual sub-tasks and can be combined into composite perceptual activities including the construction of an object model database, multimodal object classification, and object model reconstruction for grasping. We evaluate the effectiveness of our methods, and give examples of application scenarios using our personal robotic assistants acting in a human living environment. |
| doi_str_mv | 10.1177/0278364911415897 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_926331125</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sage_id>10.1177_0278364911415897</sage_id><sourcerecordid>2490067201</sourcerecordid><originalsourceid>FETCH-LOGICAL-c382t-896d4d794b8197b00aabfef50c4222015ef7899a5429bbdca52ca71b4a5ec7553</originalsourceid><addsrcrecordid>eNp1kM1KxDAUhYMoWEf3LosbV9Xc_DTNUmb8gwE347qkaTpkaJuatItx5Tv4hj6JrRWEAVcX7vnOuZeD0CXgGwAhbjERGU2ZBGDAMymOUASCQUJBpMcomuRk0k_RWQg7jDFNsYzQZumawramjMnq6-OTrmKterN13r6r3ro2Vm0Z61qFYCur51XlfNwMdW8bV6o67ozXpvtRwj70pgnn6KRSdTAXv3OBXh_uN8unZP3y-Ly8WyeaZqRPMpmWrBSSFRlIUWCsVFGZimPNCCEYuKlEJqXijMiiKLXiRCsBBVPcaME5XaDrObfz7m0woc8bG7Spa9UaN4RckpRSADKRVwfkzg2-HZ_LxwsEMCUwQniGtHcheFPlnbeN8vsccD6VnB-WPFqS2RLU1vxl_st_A-0jfMs</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>899210321</pqid></control><display><type>article</type><title>Combined 2D–3D categorization and classification for multimodal perception systems</title><source>Access via SAGE</source><creator>Marton, Zoltan-Csaba ; Pangercic, Dejan ; Blodow, Nico ; Beetz, Michael</creator><creatorcontrib>Marton, Zoltan-Csaba ; Pangercic, Dejan ; Blodow, Nico ; Beetz, Michael</creatorcontrib><description>In this article we describe an object perception system for autonomous robots performing everyday manipulation tasks in kitchen environments. The perception system gains its strengths by exploiting that the robots are to perform the same kinds of tasks with the same objects over and over again. It does so by learning the object representations necessary for the recognition and reconstruction in the context of pick-and-place tasks. The system employs a library of specialized perception routines that solve different, well-defined perceptual sub-tasks and can be combined into composite perceptual activities including the construction of an object model database, multimodal object classification, and object model reconstruction for grasping. We evaluate the effectiveness of our methods, and give examples of application scenarios using our personal robotic assistants acting in a human living environment.</description><identifier>ISSN: 0278-3649</identifier><identifier>EISSN: 1741-3176</identifier><identifier>DOI: 10.1177/0278364911415897</identifier><identifier>CODEN: IJRREL</identifier><language>eng</language><publisher>London, England: SAGE Publications</publisher><subject>3-D technology ; Artificial intelligence ; Classification ; Grasping ; Mathematical models ; Pattern recognition ; Perception ; Reconstruction ; Robotics ; Robots ; Tasks</subject><ispartof>The International journal of robotics research, 2011-09, Vol.30 (11), p.1378-1402</ispartof><rights>SAGE Publications 2011</rights><rights>Copyright SAGE PUBLICATIONS, INC. Sep 2011</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c382t-896d4d794b8197b00aabfef50c4222015ef7899a5429bbdca52ca71b4a5ec7553</citedby><cites>FETCH-LOGICAL-c382t-896d4d794b8197b00aabfef50c4222015ef7899a5429bbdca52ca71b4a5ec7553</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://journals.sagepub.com/doi/pdf/10.1177/0278364911415897$$EPDF$$P50$$Gsage$$H</linktopdf><linktohtml>$$Uhttps://journals.sagepub.com/doi/10.1177/0278364911415897$$EHTML$$P50$$Gsage$$H</linktohtml><link.rule.ids>315,781,785,21824,27929,27930,43626,43627</link.rule.ids></links><search><creatorcontrib>Marton, Zoltan-Csaba</creatorcontrib><creatorcontrib>Pangercic, Dejan</creatorcontrib><creatorcontrib>Blodow, Nico</creatorcontrib><creatorcontrib>Beetz, Michael</creatorcontrib><title>Combined 2D–3D categorization and classification for multimodal perception systems</title><title>The International journal of robotics research</title><description>In this article we describe an object perception system for autonomous robots performing everyday manipulation tasks in kitchen environments. The perception system gains its strengths by exploiting that the robots are to perform the same kinds of tasks with the same objects over and over again. It does so by learning the object representations necessary for the recognition and reconstruction in the context of pick-and-place tasks. The system employs a library of specialized perception routines that solve different, well-defined perceptual sub-tasks and can be combined into composite perceptual activities including the construction of an object model database, multimodal object classification, and object model reconstruction for grasping. We evaluate the effectiveness of our methods, and give examples of application scenarios using our personal robotic assistants acting in a human living environment.</description><subject>3-D technology</subject><subject>Artificial intelligence</subject><subject>Classification</subject><subject>Grasping</subject><subject>Mathematical models</subject><subject>Pattern recognition</subject><subject>Perception</subject><subject>Reconstruction</subject><subject>Robotics</subject><subject>Robots</subject><subject>Tasks</subject><issn>0278-3649</issn><issn>1741-3176</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2011</creationdate><recordtype>article</recordtype><recordid>eNp1kM1KxDAUhYMoWEf3LosbV9Xc_DTNUmb8gwE347qkaTpkaJuatItx5Tv4hj6JrRWEAVcX7vnOuZeD0CXgGwAhbjERGU2ZBGDAMymOUASCQUJBpMcomuRk0k_RWQg7jDFNsYzQZumawramjMnq6-OTrmKterN13r6r3ro2Vm0Z61qFYCur51XlfNwMdW8bV6o67ozXpvtRwj70pgnn6KRSdTAXv3OBXh_uN8unZP3y-Ly8WyeaZqRPMpmWrBSSFRlIUWCsVFGZimPNCCEYuKlEJqXijMiiKLXiRCsBBVPcaME5XaDrObfz7m0woc8bG7Spa9UaN4RckpRSADKRVwfkzg2-HZ_LxwsEMCUwQniGtHcheFPlnbeN8vsccD6VnB-WPFqS2RLU1vxl_st_A-0jfMs</recordid><startdate>201109</startdate><enddate>201109</enddate><creator>Marton, Zoltan-Csaba</creator><creator>Pangercic, Dejan</creator><creator>Blodow, Nico</creator><creator>Beetz, Michael</creator><general>SAGE Publications</general><general>SAGE PUBLICATIONS, INC</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>F28</scope></search><sort><creationdate>201109</creationdate><title>Combined 2D–3D categorization and classification for multimodal perception systems</title><author>Marton, Zoltan-Csaba ; Pangercic, Dejan ; Blodow, Nico ; Beetz, Michael</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c382t-896d4d794b8197b00aabfef50c4222015ef7899a5429bbdca52ca71b4a5ec7553</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2011</creationdate><topic>3-D technology</topic><topic>Artificial intelligence</topic><topic>Classification</topic><topic>Grasping</topic><topic>Mathematical models</topic><topic>Pattern recognition</topic><topic>Perception</topic><topic>Reconstruction</topic><topic>Robotics</topic><topic>Robots</topic><topic>Tasks</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Marton, Zoltan-Csaba</creatorcontrib><creatorcontrib>Pangercic, Dejan</creatorcontrib><creatorcontrib>Blodow, Nico</creatorcontrib><creatorcontrib>Beetz, Michael</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ANTE: Abstracts in New Technology & Engineering</collection><jtitle>The International journal of robotics research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Marton, Zoltan-Csaba</au><au>Pangercic, Dejan</au><au>Blodow, Nico</au><au>Beetz, Michael</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Combined 2D–3D categorization and classification for multimodal perception systems</atitle><jtitle>The International journal of robotics research</jtitle><date>2011-09</date><risdate>2011</risdate><volume>30</volume><issue>11</issue><spage>1378</spage><epage>1402</epage><pages>1378-1402</pages><issn>0278-3649</issn><eissn>1741-3176</eissn><coden>IJRREL</coden><abstract>In this article we describe an object perception system for autonomous robots performing everyday manipulation tasks in kitchen environments. The perception system gains its strengths by exploiting that the robots are to perform the same kinds of tasks with the same objects over and over again. It does so by learning the object representations necessary for the recognition and reconstruction in the context of pick-and-place tasks. The system employs a library of specialized perception routines that solve different, well-defined perceptual sub-tasks and can be combined into composite perceptual activities including the construction of an object model database, multimodal object classification, and object model reconstruction for grasping. We evaluate the effectiveness of our methods, and give examples of application scenarios using our personal robotic assistants acting in a human living environment.</abstract><cop>London, England</cop><pub>SAGE Publications</pub><doi>10.1177/0278364911415897</doi><tpages>25</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 0278-3649 |
| ispartof | The International journal of robotics research, 2011-09, Vol.30 (11), p.1378-1402 |
| issn | 0278-3649 1741-3176 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_926331125 |
| source | Access via SAGE |
| subjects | 3-D technology Artificial intelligence Classification Grasping Mathematical models Pattern recognition Perception Reconstruction Robotics Robots Tasks |
| title | Combined 2D–3D categorization and classification for multimodal perception systems |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-12T02%3A56%3A58IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Combined%202D%E2%80%933D%20categorization%20and%20classification%20for%20multimodal%20perception%20systems&rft.jtitle=The%20International%20journal%20of%20robotics%20research&rft.au=Marton,%20Zoltan-Csaba&rft.date=2011-09&rft.volume=30&rft.issue=11&rft.spage=1378&rft.epage=1402&rft.pages=1378-1402&rft.issn=0278-3649&rft.eissn=1741-3176&rft.coden=IJRREL&rft_id=info:doi/10.1177/0278364911415897&rft_dat=%3Cproquest_cross%3E2490067201%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=899210321&rft_id=info:pmid/&rft_sage_id=10.1177_0278364911415897&rfr_iscdi=true |