Assistive Intelligence Sensing Device With Python Intergration
Main Article Content
Abstract
An assistive intelligence sensor device is a comprehensive solution aimed at improving the mobility and independence of people with visual or hearing impairments. It integrates an array of advanced hardware components including Node MCU and Arduino board for data processing, GPS module with antenna for accurate location tracking, emergency key switch for instant warning activation, and time of flight sensor for accurate obstacle detection. A vibrator for haptic feedback, a Wi-Fi module for seamless connectivity and a display for visual feedback. Additionally, the device includes a laptop with a Python-coded program for real-time object detection using a camera, which helps identify and classify objects in the user's environment. Leveraging the Blynk IoT app, the device facilitates instant communication with caregivers or emergency responders, ensuring peace of mind and timely assistance when needed. Also, apart from detecting nearby obstacles and providing haptic feedback, the device uses a GPS module to live track the user's location, ensuring safety and security during outdoor navigation. The integration of intelligent software algorithms further enhances the functionality of the device, enabling it to adapt to various environments and user needs. This manuscript provides a comprehensive overview of the device's design, functionality, and potential applications to improve the quality of life of individuals with disabilities. By integrating state-of-the-art hardware components with intelligent software solutions, the Assistive Intelligence sensor device represents a significant advance in assistive technology, empowering users to navigate their surroundings with confidence and
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Karmel, A & Sharma, Anushka & pandya, Muktak & Garg, Diksha. (2019). IoT based Assistive Device for Deaf, Dumb and Blind People. Procedia Computer Science. 165. 259-269. 10.1016/j.procs.2020.01.080.
Marion Hersh, "Wearable Travel Aids for Blind and Partially Sighted People: A Review with a Focus on Design Issues", Sensors, vol.22, no.14, pp.5454, 2022.
Shravya Dasu, Manali M. Ranade, Shravasti Sarkar, Anala M R, "Computer Vision based Tools and Technologies for Navigational Assistance for the Visually Impaired", 2022 International Conference on Augmented Intelligence and Sustainable Systems (ICAISS), pp.802-808, 2022.
Anwesha Chakravarty, Ayesha Choudhary, "Mobility Assistance for the Visually Impaired in Unstructured Environment", 2023 IEEE International Conference on Service Operations and Logistics, and Informatics (SOLI), pp.1-8, 2023.
Guoxin Li, Zhijun Li, Haisheng Xia, Ying Feng, "Multi-Sensory Visual-Auditory Fusion of Wearable Navigation Assistance for People with Impaired Vision", 2023 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp.955-960, 2023.
Johan Isaksson-Daun, Tomas Jansson, Johan Nilsson, "Using Portable Virtual Reality to Assess Mobility of Blind and Low-Vision Individuals With the Audomni Sensory Supplementation Feedback", IEEE Access, vol.12, pp.26222-26241, 2024.
Qingquan Na, Hui Zhou, Hailei Yuan, Mengfan Gui, Hongjing Teng, "Improving Walking Path Generation Through Biped Constraint in Indoor Navigation System for Visually Impaired Individuals", IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol.32, pp.1221-1232, 2024.
Abdul Muhsin M, Farah F. Alkhalid, Bashra Kadhim Oleiwi, “Online Blind Assistive System using Object Recognition”, International Research Journal of Innovations in Engineering and Technology (IRJIET) ,Volume 3, Issue 12, pp 47-51, December – 2019.
Aishwarya Sarkale, Kaiwant Shah, Anandji Chaudhary, Tatwadarshi P. N., “A Literature Survey: Neural Networks for Object Detection”, VIVA-Tech International Journal for Research and Innovation Volume 1, Issue 1 (2018) ISSN (Online): 2581-7280 Article No. 9.
Bhumika Gupta, Ashish Chaube, Ashish Negi, Umang Goel, “Study on Object Detection using Open CV Python”, International Journal of Computer Applications Foundation of Computer Science (FCS), NY, USA, Volume 162, Number 8, 2017.
Geethapriya. S, N. Duraimurugan, S.P. Chokkalingam, “Real-Time Object Detection with Yolo”, International Journal of Engineering and Advanced Technology (IJEAT) ISSN: 2249 – 8958, Volume-8, Issue-3S, February 2019.
Karanbir Chahal1 and Kuntal Dey, “A Survey of Modern Object Detection Literature using Deep Learning”, International Research Journal of Engineering and Technology (IRJET), Volume 8, Issue 9, 2018.
Kartik Umesh Sharma and Nileshsingh V. Thakur, “A Review and an Approach for Object Detection in Images”, International Journal of Computational Vision and Robotics, Volume 7, Number 1/2, 2017.
Mukesh Tiwari, Dr. Rakesh Singhai, “A Review of Detection and Tracking of Object from Image and Video Sequences”, International Journal of Computational Intelligence Research, Volume 13, Number 5 (2017).
R. Sujeetha, Vaibhav Mishra , “Object Detection and Tracking using Tensor Flow”, International Journal of Recent Technology and Engineering (IJRTE) ISSN: 2277-3878, Volume-8, Issue-1, May 2019.
Richard Socher, Brody Huval, Bharath Bhat, Christopher D. Manning, Andrew Y. Ng, “Convolutional-Recursive Deep Learning for 3D Object Classification”, International Conference on Computational Intelligence and Communication Networks, 2018.
Yordanka Karayaneva and Diana Hintea, “Object Recognition in Python and MNIST Dataset Modification and Recognition with Five Machine Learning Classifiers”, Journal of Image and Graphics, Volume 6, Number 1, June 2018.