Deep Convolutional Neural Network Design Approach for 3D-Object Detection for Robotic Grasping

Date

2020-12

Authors

Sharma, Purvesh

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Recognition technology has gained state-of-the-art performance with the dawn of Deep Convolutional Neural Network (DCNN), and with these achievements in computer vision, machine learning, and 3D-sensor, industries are near to start a new era of the automation. However, object detection for robotic grasping in varying environments, low illumination, occlusion, and partial images contributes to poor accuracy and slows the speed of detecting objects. In this thesis, an approach is presented to recognize an object in an industrial warehouse through a robotic vision to advance warehouse automation using a robot arm. A multimodal architecture is designed to be used as a base network/backbone network of Single Shot Detector (SSD) to address the warehouse’s challenge, such as partial images and low illumination. This architecture uses Red-Green-Blue (RGB) and Depth images as an input and provides a single output. Most of the researchers used Visual Geometry Group (VGG), Residual Network (ResNet), and MobileNet for detection purposes, but in this thesis, a new DCNN architecture is designed to perform a specific task of grasping. Here, four different Red-Green-Blue-Depth (RGB-D) deep neural network architectures are designed and compared in their training, testing, and other statistical metrics for evaluation. The Deep Convolutional Neural Network (DCNN) development motive is to recognize the input object image obtained from the depth sensor cameras in warehouses. Four objects are mainly focused on this research: <i>‘Bowl,’ ‘School glue,’ ‘Dove bar,’ ‘Soda can.’</i> Furthermore, details of the designed model, its performance, and the results are discussed in this thesis.

Description

Keywords

Deep convolutional neural network, 3D object detection

Citation

Sharma, P. (2020). <i>Deep convolutional neural network design approach for 3D-object detection for robotic grasping</i> (Unpublished thesis). Texas State University, San Marcos, Texas.

Rights

Rights Holder

Rights License

Rights URI