CT Group of Institutions, Maqsudan, Jalandhar has developed an innovative AI-powered gesture recognition system to facilitate communication for individuals with speech and hearing impairments. The intelligent solution recognises hand gestures in real time and instantly converts them into both text and speech, enabling users to communicate more effectively in everyday situations.
Built using modern Artificial Intelligence and Computer Vision technologies, the system leverages TensorFlow, OpenCV, MediaPipe, Random Forest, NumPy, Pillow, Pandas, Joblib, PiCamera2 and Socket Programming to accurately detect and classify hand gestures. Live video captured through the camera is processed to extract hand landmarks, which are then analysed by a trained machine learning model to generate the corresponding text and voice output within seconds.
Designed for real-time performance, the solution provides a simple and user-friendly interface with minimal response time. The integrated text-to-speech functionality ensures that recognised gestures are immediately converted into audible speech, making conversations more natural and efficient.
The system has wide-ranging applications in healthcare, educational institutions, government offices, customer service centres, public spaces, and homes, where effective communication with hearing and speech-impaired individuals is essential.
The project demonstrates how AI can be applied to solve real-world social challenges through affordable and practical technological solutions. By combining machine learning, computer vision and real-time processing, the system aims to reduce communication barriers and empower individuals with speech and hearing disabilities. Appreciating the efforts of the team, Charanjit Singh Channi, Chairman, CT Group of Institutions, said that technology should always be used to create meaningful social impact. He congratulated the faculty members and students for developing an innovative solution that reflects the institution’s commitment to research, innovation, and community welfare.
Dr Manbir Singh, Managing Director, CT Group of Institutions, said that the institution continuously encourages students and faculty members to work on research projects that address real-life challenges. He added that such innovations not only enhance technical expertise but also contribute towards building a more inclusive society.
