Bahasa Isyarat Malaysia (BIM) simulator based on mask R-CNN

Due to the shortage of signal language interpreters, society frequently faces verbal exchange obstacles with deaf-mute communities. Sign language is a frame language that uses gestures to speak among regular and deaf humans. However, the cutting-edge manner of gaining knowledge of the signal language is useless and inconvenient. Bahasa Isyarat Malaysia (BIM), or Malaysian Sign Language, is a principal language of the Malaysian deaf community. BIM Simulator consists of an image detection mechanism utilized by Mask C-RNN to come across and interpret Malay sign language for users. The application program used on this project is OpenCV and PyCharm. This project makes an improvement that consists of 4 important stages; records set acquisition, records set trainer, form classification, and image recognition. The simulator is made to recognize hand gestures based on brightness and the shade of a shadow with 80% of accuracy. The simulator is straightforward to apply and no longer requires a web connection; thus, users without problems directly translate the hand gesture easily.