A three-dimensional (3D)-virtual calibration and visual servo are implemented for augmented reality (AR)-assisted peg-in-hole microassembly operations. By employing 3D model and ray casting, the 3D coordinates on virtual mating rod correspondent to the two-dimensional (2D) virtual image points are extracted. The detecting and tracking of image feature points for calibration is carried out by the proposed algorithm of regional template matching (TM) and scanning with edge fitting (RTM-SEF). For achieving subpixel error between the feature points in real and virtual images, a coarse-fine virtual calibration method is proposed. In regard to the image viewed by the real and virtual cameras, a calibrated virtual camera is utilized to track the mating rod. A visual servo control law including coarse and fine tuning is proposed to ensure sub-pixel error between the most important feature point in the real and virtual images. The AR technology is mainly employed in the alignment between micropeg and mating hole for inserting a micropeg of diameter 80 μm with length 1–1.4 mm into a mating rod with 100 μm hole.
Skip Nav Destination
Article navigation
December 2018
Research-Article
Model-Based Coarse-Fine Virtual Calibration and Visual Servo for Augmented Reality-Assisted Peg-in-Hole Microassembly
Ren-Jung Chang,
Ren-Jung Chang
Mechanical Engineering Department,
National Cheng Kung University,
Tainan 701, Taiwan, China
e-mail: rjchang@mail.ncku.edu.tw
National Cheng Kung University,
Tainan 701, Taiwan, China
e-mail: rjchang@mail.ncku.edu.tw
Search for other works by this author on:
Jun-Fu Liu
Jun-Fu Liu
Mechanical Engineering Department,
National Cheng Kung University,
Tainan 701, Taiwan, China
National Cheng Kung University,
Tainan 701, Taiwan, China
Search for other works by this author on:
Ren-Jung Chang
Mechanical Engineering Department,
National Cheng Kung University,
Tainan 701, Taiwan, China
e-mail: rjchang@mail.ncku.edu.tw
National Cheng Kung University,
Tainan 701, Taiwan, China
e-mail: rjchang@mail.ncku.edu.tw
Jun-Fu Liu
Mechanical Engineering Department,
National Cheng Kung University,
Tainan 701, Taiwan, China
National Cheng Kung University,
Tainan 701, Taiwan, China
1Corresponding author.
Contributed by the Manufacturing Engineering Division of ASME for publication in the JOURNAL OF MICRO-AND NANO-MANUFACTURING. Manuscript received May 25, 2018; final manuscript received September 16, 2018; published online October 16, 2018. Assoc. Editor: Marriner Merrill.
J. Micro Nano-Manuf. Dec 2018, 6(4): 041002 (12 pages)
Published Online: October 16, 2018
Article history
Received:
May 25, 2018
Revised:
September 16, 2018
Citation
Chang, R., and Liu, J. (October 16, 2018). "Model-Based Coarse-Fine Virtual Calibration and Visual Servo for Augmented Reality-Assisted Peg-in-Hole Microassembly." ASME. J. Micro Nano-Manuf. December 2018; 6(4): 041002. https://doi.org/10.1115/1.4041531
Download citation file:
247
Views
Get Email Alerts
Cited By
Controlling Surface of Rods With Entrained Particle as Asperities
J. Micro Nano-Manuf (March 2023)
Reviewer's Recognition
J. Micro Nano-Manuf (March 2023)
Scalable Au Metal-Assisted Chemical Etch Nanopatterning Using Enhanced Metal Break Techniques
J. Micro Nano-Manuf (March 2023)
Related Articles
Visual-Based Automation of Peg-in-Hole Microassembly Process
J. Manuf. Sci. Eng (August,2011)
Integrated Real-Time Calibration of Electromagnetic Tracking of User Motions for Engineering Applications in Virtual Environments
J. Mech. Des (December,2002)
A Self-Calibration Method for Robotic Measurement System
J. Manuf. Sci. Eng (February,2000)
Autonomous Calibration of Hexapod Machine Tools
J. Manuf. Sci. Eng (February,2000)
Related Proceedings Papers
Related Chapters
A Semi-Adaptive Fractional Order PID Control Strategy for a Certain Gun Control Equipment
International Conference on Instrumentation, Measurement, Circuits and Systems (ICIMCS 2011)
Analysis the Effect of IMU Calibration Errors on SINS/GPS Integration Accuracy for Airborne Earth Observation
International Symposium on Information Engineering and Electronic Commerce, 3rd (IEEC 2011)
4-Bit Pipeline ADC for Monolithic Active Pixel Sensors
International Conference on Advanced Computer Theory and Engineering (ICACTE 2009)