Hand Gesture and IoT App Controlled Mobile Robot with Obstacle Detection
DOI:
https://doi.org/10.24191/jcrinn.v11i2.631Keywords:
Mobile robot, Hand gesture control, Wireless communication, IoT application, MIT App Iventor, Master-SlaveAbstract
Traditional robot systems use wired connections, RF transmission, or Bluetooth with physical controllers, which is inflexible and require operators and robot to stay close to each other. In this work, a mobile platform for an arm robot is developed using a gyro-based system integrated with IoT application. The mobile robot is built with WiFi connectivity and an obstacle detection algorithm to avoid collision. The robot can be navigated by using two masters i.e. user hand gestures measured by a gyroscope module or via an IoT mobile application designed by using MIT App Inventor. The master-slave system architecture consists of the master that sends the control’s reference commands to a real-time cloud database and the slave robot’s controller that uses the commands from the cloud to move the robot. The results of the indoor floor test showed that the robot moved according to the instructions given by the masters in the forward, backward, left and right directions at two different speeds and stopped the navigation when moving closer to an obstacle at a predetermined distance limit. The successful results proved the practicality of the master-slave control, the established wireless communication, software and hardware interfaces and the IoT integration.
Downloads
References
Buthelezi, N. M., Malele, V., Owolawi, P. A., & Mapayi, T. (2022). IoT Based health monitor for remote patient. In 5th International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/icABCD54961.2022.9856318.
Bhala, T., Aggarwal, A., Aggarwal, S., Garg, K., & Gupta, A. (2023). Home automation system using Internet-of-Things & Blynk App. In 2023 IEEE Pune Section International Conference, PuneCon 2023. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/PuneCon58714.2023.10450120.
De Sant Ana, P. M., Marchenko, N., Soret, B., & Popovski, P. (2023). Goal-oriented wireless communication for a remotely controlled autonomous guided vehicle. IEEE Wireless Communications Letters, 12(4), 605–609. https://doi.org/10.1109/LWC.2023.3235759.
Gore, R. N., Kour, H., Gandhi, M., Tandur, D., & Varghese, A. (2019). Bluetooth based Sensor Monitoring in Industrial IoT Plants. In 2019 International Conference on Data Science and Communication, IconDSC 2019. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/IconDSC.2019.8816906.
Hisam, Z. H. (2025). Master mechanism design and control for a master-slave arm robot [Unpublished Undergraduate Thesis, Faculty of Electrical Engineering, Universiti Teknologi MARA]. UiTM Institutional Repository.
Jing, Y., An, T., Wang, T., Li, Y., & Dong, B. (2022). A decentralized robust impedance control method of modular robot manipulators with physical human robot interaction. In Proceedings of the 34th Chinese Control and Decision Conference, CCDC 2022 (pp. 5490–5495). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/CCDC55256.2022.10033849.
Kale, P., & Sakhare, N. (2020). gesture based automation of a robot car. International Journal of Scientific Research in Science, Engineering and Technology, 7(2), 508–513. https://doi.org/10.32628/ijsrset207296.
Koh, Y., Chang, E., & Choi, M. E. (2023). Collision prevention strategy using sparse 2D spatial information for indoor mobile robots. In IEEE International Conference on Intelligent Robots and Systems (pp. 11249–11256). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/IROS55552.2023.10341443.
Lee, H., Yoon, J., Jeong, Y., & Yi, K. (2021). Moving object detection and tracking based on interaction of static obstacle map and geometric model-free approach for urban autonomous driving. IEEE Transactions on Intelligent Transportation Systems, 22(6), 3275–3284. https://doi.org/10.1109/TITS.2020.2981938.
Mhetre, M., Mohekar, N., Mhatre, R., Barhate, Prof. Mi., Modhave, P., Mishra, A., & Senapati, M. (2023). Gesture controlled robot car. International Journal for Research in Applied Science and Engineering Technology, 11(10), 1545–1549. https://doi.org/10.22214/ijraset.2023.56184.
Mujeeb Rahman, K. K., Mohamed, N. N., Zidan, R., Alsarraj, I., & Hasan, B. (2023). iot-based wireless patient monitor using ESP32 microcontroller. In 2023 24th International Arab Conference on Information Technology, ACIT 2023. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/ACIT58888.2023.10453847.
Munasinghe, T., Patton, E. W., & Seneviratne, O. (2019). IoT application development using MIT app inventor to collect and analyze sensor data. In Proceedings - 2019 IEEE International Conference on Big Data, Big Data 2019 (pp. 6157–6159). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/BigData47090.2019.9006203.
Roy, A., Basu, A., Saha, D., Ali, S. S., & Sain, C. (2024). Cloud server enabled iot integrated smart wrist band for women’s protection remotely. In 2024 IEEE Region 10 Symposium, TENSYMP 2024. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/TENSYMP61132.2024.10752277.
Song, Y., Li, L., Tian, Y., Li, Z., & Yin, X. (2023). A novel master–slave interventional surgery robot with force feedback and collaborative operation. Sensors, 23, 3584. https://doi.org/10.3390/s23073584.
Sriram, K. N. V., & Palaniswamy, S. (2019). Mobile robot assistance for disabled and senior citizens using hand gestures. In 1st International Conference on Power Electronics Applications and Technology in Present Energy Scenario, PETPES 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/PETPES47060.2019.9003821.
Ullah, S., Mumtaz, Z., Liu, S., Abubaqr, M., Mahboob, A., & Madni, H. A. (2019). Single-equipment with multiple-application for an automated robot-car control system. Sensors, 19, 662. https://doi.org/10.3390/s19030662.
Xiang, W., Yu, K., Han, F., Fang, L., He, D., & Han, Q. L. (2024). Advanced manufacturing in industry 5.0: A survey of key enabling technologies and future trends. IEEE Transactions on Industrial Informatics, 20(2), 1055–1068. https://doi.org/10.1109/TII.2023.3274224.
Yamamoto, Y., Wakimoto, S., Kanda, T., & Yamaguchi, D. (2021). A soft robot arm with flexible sensors for master–slave operation. Engineering Proceedings, 10, 34. https://doi.org/10.3390/ecsa-8-11311.
Younis, M. F., & Alwan, Z. S. (2023). Monitoring the performance of cloud real-time databases: A firebase case study. In AICCIT 2023 - Al-Sadiq International Conference on Communication and Information Technology (pp. 240–245). Institute of Electrical and Electronics Engineers Inc. https://doi.org/10.1109/AICCIT57614.2023.10217953.
Yunus, M. S. M. (2022). Wireless controlled mobile robot based on hand gestures [Unpublished Undergraduate thesis, Faculty of Electrical Engineering, Universiti Teknologi MARA]. UiTM Institutional Repository.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Muhammad Arif Abd Shukor, Ruhizan Liza Ahmad Shauri, Zainul Haziman Hisam (Author)
This work is licensed under a Creative Commons Attribution 4.0 International License.
