• Version
• Download 10
• File Size 765.77 KB
• File Count 1
• Create Date 23 June 2023
• Last Updated 23 June 2023

Silent Speech Mobile Interaction

Shilpa Sonawane, Aman Shahid Pathan, Soham Sopan Haran, Rutveej Rajendra Jadhav

Department of Electronics & Telecommunication,

JSPM’s Rajarshi Shahu College Of Engineering,

Pune, India

Abstract:

We have developed a module called Silent Speech that enables users to control their smartphone with their lip movements. Our module analyzes the user’s lip images and matches them with a predefined dataset to produce an output. Our system supports 26 commands for various tasks such as launching apps, adjusting settings and handling popups. We evaluated the performance of Silent Speech with user tests and measured its recognition accuracy. We also compared it with voice and gesture commands in terms of privacy and usability. We found that Lip-Interact can help users interact with their phone discreetly, communicate with others without disturbing them, and free their hands for other activities.

Keywords: Silent Speech, Data collection, Lip-reading