Integrated Speech and Gesture-Based Human–Machine Interaction Framework for Robotic Vehicles
Pages:14-23
Dr. Ankush Kadu, Tanuja Abhang, Adityaraj Deokar, Divyansh Singh, Shubham Dhavane
Human–Machine Interaction (HMI) has significantly contributed to developing intelligent robotic systems capable of responding to multimodal commands. The paper presents an Integrated Speech and Gesture-Based HMI Framework designed for robotic vehicle control, enabling natural, intuitive, and contactless interaction between humans and machines. The proposed system combines speech recognition and hand gesture detection modules to enhance flexibility and operational efficiency in dynamic environments. Speech commands are processed using real-time voice recognition techniques, while gestures are captured through motion sensors or vision-based systems. The integration of both modalities ensures robust performance even under noisy or ambiguous conditions, offering improved accuracy and user convenience. Experimental results demonstrate that the framework achieves reliable command execution, low response latency, and adaptability across various scenarios. The approach holds potential for applications in assistive robotics, industrial automation, and defense operations, where hands-free and efficient communication with robotic systems is essential.
Human–Machine Interaction (HMI), Speech Recognition, Gesture Control, Robotic Vehicle, Multimodal Interface, Real-Time System