A Facial Expression Recognition Application Development Using Deep Convolutional Neural Network For Children With Autism Spectrum Disorder To Help Identify Human Emotions

dc.contributor.advisorValles, Damian
dc.contributor.authorHaque, Md Inzamam Ul
dc.contributor.committeeMemberResendiz, Maria
dc.contributor.committeeMemberKoutitas, George
dc.date.accessioned2019-08-06T13:49:03Z
dc.date.available2019-08-06T13:49:03Z
dc.date.issued2019-08
dc.description.abstract<p>In this thesis, a novel idea is presented, which is to teach young children with Autism Spectrum Disorder (ASD) to recognize human facial expressions through the help of computer vision and image processing. Universally, there are seven facial expressions categories: angry, disgust, happy, sad, fear, surprised and neutral. To recognize all these facial expressions and to predict the current mood of a person is a difficult task for a child. For a child with ASD, this problem presents itself in a more complex manner due to the nature of the disorder. The main goal of the thesis was to develop a deep Convolutional Neural Network (DCNN) for facial expression recognition, which can help young children with ASD to recognize facial expressions, using mobile devices. Previously, different neural network models and classifiers have been presented to achieve state of the art accuracy in this sector. Separately, different studies have been performed in studying the ability and performance of children with ASD for recognizing facial expressions. In this thesis, additional features have been added to the DCNN model such that it can correctly classify facial expressions in different lighting conditions and from different viewpoints as the model is trained to do so. Upon developing the DCNN model, an iOS app has been developed implementing this deep learning model as a byproduct and as a medium to use this model in clinical trials for children with autism as a medium of enhancing their communication abilities. The implementation of this proposed idea started with finding datasets containing images of faces with different expressions from different angles.</p> <p>Further datasets were produced from the original dataset with images of different contrast and brightness with the help of image processing. The performance of the DCNN model was evaluated using these datasets. Once an optimal accuracy is achieved with good generalizability, an app suitable for iOS platform was developed for running both the DCNN model and image processing algorithms. The function of the app is to open the camera of the device, detect a face, classify the facial expression, and show the expression with an emoticon on the screen. As a product of this work, the app can be used by speech-language pathologies, teacher, care-takers, and parents as a technological tool when working with children with ASD. The design of the model and application is targeted to children with ASD to recognize and identify facial expressions in real-time to practice social skills during everyday social interaction.</p>
dc.description.departmentEngineering
dc.formatText
dc.format.extent100 pages
dc.format.medium1 file (.pdf)
dc.identifier.citationHaque, M. I. U. (2019). <i>A facial expression recognition application development using deep convolutional neural network for children with Autism Spectrum Disorder to help identify human emotions</i> (Unpublished thesis). Texas State University, San Marcos, Texas.
dc.identifier.urihttps://hdl.handle.net/10877/8457
dc.language.isoen
dc.subjectDeep convolutional neural network
dc.subjectAutism spectrum disorder
dc.subjectDeep learning
dc.subject.lcshHuman face recognition (Computer science)
dc.subject.lcshFace--Identification
dc.subject.lcshAutism
dc.titleA Facial Expression Recognition Application Development Using Deep Convolutional Neural Network For Children With Autism Spectrum Disorder To Help Identify Human Emotions
dc.typeThesis
thesis.degree.departmentEngineering
thesis.degree.disciplineEngineering
thesis.degree.grantorTexas State University
thesis.degree.levelMasters
thesis.degree.nameMaster of Science

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
HAQUE-THESIS-2019.pdf
Size:
3.29 MB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
4.53 KB
Format:
Plain Text
Description:
No Thumbnail Available
Name:
LICENSE.txt
Size:
2.13 KB
Format:
Plain Text
Description: