Sign Language Interpreter App

Domain - AI/ ML Open Innovation

Team name - TeraByte

Video Link - https://youtu.be/juKOzNMbz5s?feature=shared

PPT link - https://docs.google.com/presentation/d/1UipNVD-FM-BM6mwP6YshXj1M5dBoh88w/edit?usp=sharing&ouid=102599192083314509245&rtpof=true&sd=true

Problem Statement -

Develop a comprehensive sign language interpreter application that leverages machine learning and computer vision technologies to bridge communication gaps between individuals who use sign language and those who may not be familiar with it. The application will empower users to communicate effectively, breaking down barriers and fostering inclusivity. Key Features:

• Develop a machine learning model capable of accurately recognizing and interpreting sign language gestures.
• Implement real-time sign language interpretation using the trained model, allowing users to receive immediate translations of signed messages into text.
• Design an intuitive and user-friendly mobile application interface that enables seamless communication.
• Provide interactive lessons, quizzes, and feedback to enhance user learning and proficiency in sign language.

Prerequisites

• Python https://www.python.org/
• Jupyter Notebook https://jupyter.org/install
• Flutter SDK
  • A few resources to get you started if this is your first Flutter project:
    • Lab: Write your first Flutter app
    • Cookbook: Useful Flutter samples
    • For help getting started with Flutter development, view the online documentation, which offers tutorials, samples, guidance on mobile development, and a full API reference.
• Android Studio https://developer.android.com/studio

Downloading modules

Run commands in cmd terminal

Tensorflow

pip install tensorflow

MediaPipe

pip install mediapipe

Code Implementation

BackEnd using tensorflow, mediapipe, openCV

Testing of ISL Alphabets

testing.mp4

Testing of ISL phrases

testing.phrases.mp4

FrontEnd using Flutter, Dart