Classification of hand held shapes and locations in continuous signing
Department of Biomedical Engineering
Master of Science
Foulds, Richard A.
Sign language for the deaf and hearing impaired replaces speech with manually produced signs. Each sign has been categorized as being combinations of handshape, movement, orientation, location, and facial expressions. Of the five sign parameters, this thesis focuses on classification of two of the main parameters, the hand shapes and locations, in continuous signing.
Since the nature of hand shapes is transient and not static, neural networks was used as a classifier for hand shapes. And since locations in sign language are defined by linguistic variables rather than by hard core position values, fuzzy logic was used as a classifier for locations. Two models have been developed using neural networks and fuzzy logic toolboxes in Matlab that showed the possibility of classification of hand shapes and locations, in continuous signing.
Results show that neural network was able to classify hand shapes accurately at every instant when tested with the trained data and reasonably well with testing data. The proposed model for classification of locations was able to classify locations accurately.
njit-etd2008-093 (78 pages ~ 16,298 KB pdf)
Please complete this Feedback Form to inform us about your experience using this website. It will assist us in better serving your information needs in the future. Thank You!
Created October 31, 2008