A novel vision-based calibration framework for industrial robotic manipulators

With the increasing involvement of industrial robots in manufacturing processes, the demand for high quality robots has increased considerably. A high-quality robot is a robot having good repeatability and accuracy. Industrial robots are known to have very good repeatability, however it is not the s...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Robotics and computer-integrated manufacturing 2022-02, Vol.73, p.102248, Article 102248
Hauptverfasser: Balanji, Hamid Majidi, Turgut, Ali Emre, Tunc, Lutfi Taner
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 102248
container_title Robotics and computer-integrated manufacturing
container_volume 73
creator Balanji, Hamid Majidi
Turgut, Ali Emre
Tunc, Lutfi Taner
description With the increasing involvement of industrial robots in manufacturing processes, the demand for high quality robots has increased considerably. A high-quality robot is a robot having good repeatability and accuracy. Industrial robots are known to have very good repeatability, however it is not the same with accuracy. Due to harsh working conditions, accuracy of robots deteriorate over time. Calibration is a practical approach to sustain accuracy. In calibration, position and orientation of the tool center point (TCP) of a robot arm should be corrected using a tracking device with higher accuracy. Different devices such as laser-trackers, optical CMMs, and stereo cameras have been used in the literature. In this paper, a novel calibration framework is proposed based on a single camera and computer vision techniques using ArUco markers. The product of exponentials method is used for kinematic modeling of the robot to avoid the singularity. The performance of the framework is tested using computer-based simulations and using a six degree of freedom (6-DOF) UR5 robotic manipulator. Position and orientation errors are used as metrics in the experiments. The position and orientation errors in real world experiments reached to 2.5 mm and 0.2°, respectively. The result shows that the method is usable in real world scenarios. [Display omitted] •Industrial robots gradually lose their pose accuracy.•Calibration is a solution to increase pose accuracy.•Laser-trackers, optical CMMs, and stereo vision systems are expensive and hard-to-use for calibration.•There is a need for some cost-effective, easy-to-use, and high-performance pose estimation tools for industrial robot calibration.•Computer vision and augmented reality-based algorithms sound promising for developing novel robot calibration methods.
doi_str_mv 10.1016/j.rcim.2021.102248
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2605307031</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0736584521001289</els_id><sourcerecordid>2605307031</sourcerecordid><originalsourceid>FETCH-LOGICAL-c258t-f2b25c8ca5a42e98d1dfacf5169f0972f68e0edece17b197a5ca8e8186ed207b3</originalsourceid><addsrcrecordid>eNp9kE1LxDAQhoMouK7-AU8Bz12TtGlS8LKIX7DoRc8hTSeQ2jbrpF3x39ulnj0NvLzPzPAQcs3ZhjNe3rYbdKHfCCb4HAhR6BOy4lpVmZC5OiUrpvIyk7qQ5-QipZYxJgqZr8jrlg7xAB09hBTikNU2QUOd7UKNdpwT6tH28B3xk_qINAzNlEYMtqMY6zgGR3s7hP3U2TFiuiRn3nYJrv7mmnw8PrzfP2e7t6eX--0uc0LqMfOiFtJpZ6UtBFS64Y23zkteVp5VSvhSA4MGHHBV80pZ6awGzXUJjWCqztfkZtm7x_g1QRpNGycc5pNGlEzmTLGczy2xtBzGlBC82WPoLf4YzszRm2nN0Zs5ejOLtxm6WyCY_z8EQJNcgMFBExDcaJoY_sN_AV6gd-U</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2605307031</pqid></control><display><type>article</type><title>A novel vision-based calibration framework for industrial robotic manipulators</title><source>Elsevier ScienceDirect Journals</source><creator>Balanji, Hamid Majidi ; Turgut, Ali Emre ; Tunc, Lutfi Taner</creator><creatorcontrib>Balanji, Hamid Majidi ; Turgut, Ali Emre ; Tunc, Lutfi Taner</creatorcontrib><description>With the increasing involvement of industrial robots in manufacturing processes, the demand for high quality robots has increased considerably. A high-quality robot is a robot having good repeatability and accuracy. Industrial robots are known to have very good repeatability, however it is not the same with accuracy. Due to harsh working conditions, accuracy of robots deteriorate over time. Calibration is a practical approach to sustain accuracy. In calibration, position and orientation of the tool center point (TCP) of a robot arm should be corrected using a tracking device with higher accuracy. Different devices such as laser-trackers, optical CMMs, and stereo cameras have been used in the literature. In this paper, a novel calibration framework is proposed based on a single camera and computer vision techniques using ArUco markers. The product of exponentials method is used for kinematic modeling of the robot to avoid the singularity. The performance of the framework is tested using computer-based simulations and using a six degree of freedom (6-DOF) UR5 robotic manipulator. Position and orientation errors are used as metrics in the experiments. The position and orientation errors in real world experiments reached to 2.5 mm and 0.2°, respectively. The result shows that the method is usable in real world scenarios. [Display omitted] •Industrial robots gradually lose their pose accuracy.•Calibration is a solution to increase pose accuracy.•Laser-trackers, optical CMMs, and stereo vision systems are expensive and hard-to-use for calibration.•There is a need for some cost-effective, easy-to-use, and high-performance pose estimation tools for industrial robot calibration.•Computer vision and augmented reality-based algorithms sound promising for developing novel robot calibration methods.</description><identifier>ISSN: 0736-5845</identifier><identifier>EISSN: 1879-2537</identifier><identifier>DOI: 10.1016/j.rcim.2021.102248</identifier><language>eng</language><publisher>Oxford: Elsevier Ltd</publisher><subject>Accuracy ; Calibration ; Cameras ; Computer vision ; Degrees of freedom ; Errors ; Fiducial marker system ; Industrial robot calibration ; Industrial robots ; Manipulators ; Orientation ; POE ; Reproducibility ; Robot arms ; Robots ; Tracking devices ; Vision-based robot calibration</subject><ispartof>Robotics and computer-integrated manufacturing, 2022-02, Vol.73, p.102248, Article 102248</ispartof><rights>2021 Elsevier Ltd</rights><rights>Copyright Elsevier BV Feb 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c258t-f2b25c8ca5a42e98d1dfacf5169f0972f68e0edece17b197a5ca8e8186ed207b3</citedby><cites>FETCH-LOGICAL-c258t-f2b25c8ca5a42e98d1dfacf5169f0972f68e0edece17b197a5ca8e8186ed207b3</cites><orcidid>0000-0001-5012-8270 ; 0000-0002-6248-1597 ; 0000-0002-9837-1007</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0736584521001289$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3537,27903,27904,65309</link.rule.ids></links><search><creatorcontrib>Balanji, Hamid Majidi</creatorcontrib><creatorcontrib>Turgut, Ali Emre</creatorcontrib><creatorcontrib>Tunc, Lutfi Taner</creatorcontrib><title>A novel vision-based calibration framework for industrial robotic manipulators</title><title>Robotics and computer-integrated manufacturing</title><description>With the increasing involvement of industrial robots in manufacturing processes, the demand for high quality robots has increased considerably. A high-quality robot is a robot having good repeatability and accuracy. Industrial robots are known to have very good repeatability, however it is not the same with accuracy. Due to harsh working conditions, accuracy of robots deteriorate over time. Calibration is a practical approach to sustain accuracy. In calibration, position and orientation of the tool center point (TCP) of a robot arm should be corrected using a tracking device with higher accuracy. Different devices such as laser-trackers, optical CMMs, and stereo cameras have been used in the literature. In this paper, a novel calibration framework is proposed based on a single camera and computer vision techniques using ArUco markers. The product of exponentials method is used for kinematic modeling of the robot to avoid the singularity. The performance of the framework is tested using computer-based simulations and using a six degree of freedom (6-DOF) UR5 robotic manipulator. Position and orientation errors are used as metrics in the experiments. The position and orientation errors in real world experiments reached to 2.5 mm and 0.2°, respectively. The result shows that the method is usable in real world scenarios. [Display omitted] •Industrial robots gradually lose their pose accuracy.•Calibration is a solution to increase pose accuracy.•Laser-trackers, optical CMMs, and stereo vision systems are expensive and hard-to-use for calibration.•There is a need for some cost-effective, easy-to-use, and high-performance pose estimation tools for industrial robot calibration.•Computer vision and augmented reality-based algorithms sound promising for developing novel robot calibration methods.</description><subject>Accuracy</subject><subject>Calibration</subject><subject>Cameras</subject><subject>Computer vision</subject><subject>Degrees of freedom</subject><subject>Errors</subject><subject>Fiducial marker system</subject><subject>Industrial robot calibration</subject><subject>Industrial robots</subject><subject>Manipulators</subject><subject>Orientation</subject><subject>POE</subject><subject>Reproducibility</subject><subject>Robot arms</subject><subject>Robots</subject><subject>Tracking devices</subject><subject>Vision-based robot calibration</subject><issn>0736-5845</issn><issn>1879-2537</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNp9kE1LxDAQhoMouK7-AU8Bz12TtGlS8LKIX7DoRc8hTSeQ2jbrpF3x39ulnj0NvLzPzPAQcs3ZhjNe3rYbdKHfCCb4HAhR6BOy4lpVmZC5OiUrpvIyk7qQ5-QipZYxJgqZr8jrlg7xAB09hBTikNU2QUOd7UKNdpwT6tH28B3xk_qINAzNlEYMtqMY6zgGR3s7hP3U2TFiuiRn3nYJrv7mmnw8PrzfP2e7t6eX--0uc0LqMfOiFtJpZ6UtBFS64Y23zkteVp5VSvhSA4MGHHBV80pZ6awGzXUJjWCqztfkZtm7x_g1QRpNGycc5pNGlEzmTLGczy2xtBzGlBC82WPoLf4YzszRm2nN0Zs5ejOLtxm6WyCY_z8EQJNcgMFBExDcaJoY_sN_AV6gd-U</recordid><startdate>202202</startdate><enddate>202202</enddate><creator>Balanji, Hamid Majidi</creator><creator>Turgut, Ali Emre</creator><creator>Tunc, Lutfi Taner</creator><general>Elsevier Ltd</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7TB</scope><scope>8FD</scope><scope>FR3</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-5012-8270</orcidid><orcidid>https://orcid.org/0000-0002-6248-1597</orcidid><orcidid>https://orcid.org/0000-0002-9837-1007</orcidid></search><sort><creationdate>202202</creationdate><title>A novel vision-based calibration framework for industrial robotic manipulators</title><author>Balanji, Hamid Majidi ; Turgut, Ali Emre ; Tunc, Lutfi Taner</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c258t-f2b25c8ca5a42e98d1dfacf5169f0972f68e0edece17b197a5ca8e8186ed207b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Accuracy</topic><topic>Calibration</topic><topic>Cameras</topic><topic>Computer vision</topic><topic>Degrees of freedom</topic><topic>Errors</topic><topic>Fiducial marker system</topic><topic>Industrial robot calibration</topic><topic>Industrial robots</topic><topic>Manipulators</topic><topic>Orientation</topic><topic>POE</topic><topic>Reproducibility</topic><topic>Robot arms</topic><topic>Robots</topic><topic>Tracking devices</topic><topic>Vision-based robot calibration</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Balanji, Hamid Majidi</creatorcontrib><creatorcontrib>Turgut, Ali Emre</creatorcontrib><creatorcontrib>Tunc, Lutfi Taner</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Robotics and computer-integrated manufacturing</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Balanji, Hamid Majidi</au><au>Turgut, Ali Emre</au><au>Tunc, Lutfi Taner</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A novel vision-based calibration framework for industrial robotic manipulators</atitle><jtitle>Robotics and computer-integrated manufacturing</jtitle><date>2022-02</date><risdate>2022</risdate><volume>73</volume><spage>102248</spage><pages>102248-</pages><artnum>102248</artnum><issn>0736-5845</issn><eissn>1879-2537</eissn><abstract>With the increasing involvement of industrial robots in manufacturing processes, the demand for high quality robots has increased considerably. A high-quality robot is a robot having good repeatability and accuracy. Industrial robots are known to have very good repeatability, however it is not the same with accuracy. Due to harsh working conditions, accuracy of robots deteriorate over time. Calibration is a practical approach to sustain accuracy. In calibration, position and orientation of the tool center point (TCP) of a robot arm should be corrected using a tracking device with higher accuracy. Different devices such as laser-trackers, optical CMMs, and stereo cameras have been used in the literature. In this paper, a novel calibration framework is proposed based on a single camera and computer vision techniques using ArUco markers. The product of exponentials method is used for kinematic modeling of the robot to avoid the singularity. The performance of the framework is tested using computer-based simulations and using a six degree of freedom (6-DOF) UR5 robotic manipulator. Position and orientation errors are used as metrics in the experiments. The position and orientation errors in real world experiments reached to 2.5 mm and 0.2°, respectively. The result shows that the method is usable in real world scenarios. [Display omitted] •Industrial robots gradually lose their pose accuracy.•Calibration is a solution to increase pose accuracy.•Laser-trackers, optical CMMs, and stereo vision systems are expensive and hard-to-use for calibration.•There is a need for some cost-effective, easy-to-use, and high-performance pose estimation tools for industrial robot calibration.•Computer vision and augmented reality-based algorithms sound promising for developing novel robot calibration methods.</abstract><cop>Oxford</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.rcim.2021.102248</doi><orcidid>https://orcid.org/0000-0001-5012-8270</orcidid><orcidid>https://orcid.org/0000-0002-6248-1597</orcidid><orcidid>https://orcid.org/0000-0002-9837-1007</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0736-5845
ispartof Robotics and computer-integrated manufacturing, 2022-02, Vol.73, p.102248, Article 102248
issn 0736-5845
1879-2537
language eng
recordid cdi_proquest_journals_2605307031
source Elsevier ScienceDirect Journals
subjects Accuracy
Calibration
Cameras
Computer vision
Degrees of freedom
Errors
Fiducial marker system
Industrial robot calibration
Industrial robots
Manipulators
Orientation
POE
Reproducibility
Robot arms
Robots
Tracking devices
Vision-based robot calibration
title A novel vision-based calibration framework for industrial robotic manipulators
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-27T23%3A22%3A56IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20novel%20vision-based%20calibration%20framework%20for%20industrial%20robotic%20manipulators&rft.jtitle=Robotics%20and%20computer-integrated%20manufacturing&rft.au=Balanji,%20Hamid%20Majidi&rft.date=2022-02&rft.volume=73&rft.spage=102248&rft.pages=102248-&rft.artnum=102248&rft.issn=0736-5845&rft.eissn=1879-2537&rft_id=info:doi/10.1016/j.rcim.2021.102248&rft_dat=%3Cproquest_cross%3E2605307031%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2605307031&rft_id=info:pmid/&rft_els_id=S0736584521001289&rfr_iscdi=true