Stereo Vision Based Robot for Remote Monitoring with VR Support
Mohamed Fazil M. S.1, Arockia Selva Kumar A.2, Daniel Schilberg3
1Arockia Selva Kumar A, Senior Associate Professor, Design and Automation Research Group, SMBS, Vellore Institute of Technology, Chennai (Tamil Nadu), India.
2Prof. Dr. Daniel Schilberg, Dean, Mechatronics and Research, Head, Institute of Robotics and Mechatronics University of Applied Sciences Bochum, Germany.
3Mohamed Fazil M S, Pursuing Master’s, Mechatronics and Robotics, Tandon School of Engineering, New York University.
Manuscript received on 14 December 2019 | Revised Manuscript received on 22 December 2019 | Manuscript Published on 31 December 2019 | PP: 79-84 | Volume-9 Issue-1S3 December 2019 | Retrieval Number: A10161291S319/19©BEIESP | DOI: 10.35940/ijeat.A1016.1291S319
Open Access | Editorial and Publishing Policies | Cite | Mendeley | Indexing and Abstracting
© The Authors. Blue Eyes Intelligence Engineering and Sciences Publication (BEIESP). This is an open access article under the CC-BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/)
Abstract: The machine vision systems have been playing a significant role in visual monitoring systems. With the help of stereovision and machine learning, it will be able to mimic human-like visual system and behaviour towards the environment. In this paper, we present a stereo vision based 3-DOF robot which will be used to monitor places from remote using cloud server and internet devices. The 3-DOF robot will transmit human-like head movements, i.e., yaw, pitch, roll and produce 3D stereoscopic video and stream it in Real-time. This video stream is sent to the user through any generic internet devices with VR box support, i.e., smartphones giving the user a First-person real-time 3D experience and transfers the head motion of the user to the robot also in Real-time. The robot will also be able to track moving objects and faces as a target using deep neural networks which enables it to be a standalone monitoring robot. The user will be able to choose specific subjects to monitor in a space. The stereovision enables us to track the depth information of different objects detected and will be used to track human interest objects with its distances and sent to the cloud. A full working prototype is developed which showcases the capabilities of a monitoring system based on stereo vision, robotics, and machine learning.
Keywords: Cloud Server, Deep Neural Network, Internet Of Things, Machine Vision, Stereovision, Robotics, Virtual Reality.
Scope of the Article: Remote Sensing