An intelligent sign language learning platform

This intelligent sign language learning platform comprised three sections: 3D Sign Language Courses, AI-Driven Asessments, and Sign Language Exercises, creating a comprehensive educational loop of learning, ongoing assessment, and practice reinforcement. The platform has been applied in schools and organizations for the deaf, earning us the China Software Copyright Certification and five provincial/national awards. As the team leader on this project, my responsibilities included the development of 3D courses and the AI-Driven Assessment module.

3D sign language animation courses

Guideline for 3D courses

Our users can select courses of their interest from the home page for learning. Upon entering the course interface, they can choose the corresponding chapters to browse the 3D video lessons and view explanations of the corresponding sign language movements.

AI-driven assessment

Guideline for AI-driven assessment

Upon entering the AI-driven assessment page, the system will access the phone camera to record the user's sign language practice process. The deep learning-based AI analysis module will capture the key points of the hand and provide corresponding practice scores.

Sign language exercises

Guideline for sign language exercises

After completing a lesson, users can do corresponding exercises, mainly choosing the meaning of words based on sign language actions. The system will automatically score the exercises and provide a collection of wrong answers to help users collect incorrect vocabulary.