AR masks for teaching emotions to preschoolers

MSc dissertation, AR, research
Context
AR masks popularity has grown tremendously on Instagram and Snapchat as these companies made AR accessible for everyone and built a creative community around new ways of self-expression. People started to use such face filters every day, emphasising their curiosity about this emerging technology. Users loyalty to AR forced me as a designer and explorer to consider AR experiments in the fields different from entertainment.
Tasks
My academic interest involves the research of how AR masks can make us more empathetic and help to understand emotions better. I am going to categorise various emotions and visualise them in AR masks. Those masks will serve as triggers for emotional awareness conversations between children and adults. The effectiveness of teaching and learning empathy via AR apps will be compared with the traditional methods through a series of interviews and tests with teachers, parents and preschoolers.
Overview
MSc dissertation
at the University of Edinburgh
May 2020 - Present
This project aims to integrate augmented reality (AR) advancement into the education process, focusing on teaching emotions to preschoolers. The novelty of this research is emphasised by AR masks adoption, as there are no other studies conducted around this AR implication. Thus, the thesis investigates AR masks possibilities and practical approaches to designing them. It also showcases diverse ways to visualise emotions in AR in context of ‘‘All emotions are OK’’ set of masks.

As my hypothesis of AR effectiveness requires several waves of user tests, the main goal was to suggest a solution that is easy to modify and fast to implement. Thus, it will facilitate the process of integration and will allow testing many different ideas at once.

Due to tight deadlines, a target group was narrowed down to preschoolers 2-6 years old and their parents. Age influenced significantly many design decisions, such as a simple style of illustrations and masks.
AR mask examples v1
All masks have two possible AR visualisation. With the need for various users tests in mind, I chose the Spark AR tool that allows me to publish and change the concept quickly.
My thoughts board
There are numerous questions that I will strive to answer in my research. They are my motivators so that I created a particular space to save and manage them.
Implementation plan
Due to time limitations, I have to create the first basic prototypes in advance. It allowed me to receive feedback on my ideas and enhance AR masks before the final dissertation submission.
Inspirations
1. Inside Out, a 3D computer-animated comedy film →Inside Out personifies the five major emotions — Joy, Sadness, Fear, Anger and Disgust — residing in the mind of a preteen girl named Riley. Throughout the film, the five embodied emotions all work to guide and protect her.

After my film review, I discover many visually interesting concepts: from the use of colour for emotions' diversity to the memories storage based on emotions. However, the most valuable outcome is a visualisation of how emotions unite together to make more feelings.
Possible emotional overlap.
Source and idea: Vox.
Emotions begin to blend together into newer, more complicated feelings. All the rights are owned by Disney/Pixar.
2. Apple ARKit overlay features →I have tested many ways of digital layering on the top of reality. It helps me to feel and understand the benefits of various AR modes. For example, I used Chevening Awards poster as a trigger for AR experience.
3. Instagram filters test →With the need for various users tests in mind, I chose the AR mask design tool that allows me to publish and change the concept quickly.There are several tools to consider for anyone interested in AR masks: Spark AR by Facebook, Lens Studio by Snap Inc, ARKit by Apple and Unity. My test sessions form an opinion that the most advanced and diverse possibilities for face filters are implemented only in Lens Studio and Spark AR.
Instagram AR masks test.
All the rights are owned by their creators
Literature
1. Augmented Human: How technology is shaping the new reality →Dr. Helen Papagiannis has been working with AR for 15 years as a researcher, designer, and technology evangelist. Her book enormously resonates with my views and research because the author believes that AR technology can make us more human. She dreams of seeing how AR will create more ways of meaningful human-to-human interactions.
2. The Oxford companion to the mind →This dictionary approach to the human mind comprises definitions and discussions by over 100 authorities and scholars. Richard L. Gregory, the author, was a British psychologist and Professor of Neuropsychology at the University of Bristol. Gregory's main contribution to the discipline was in the development of cognitive psychology, in particular that of "Perception as hypotheses", an approach which had its origin in the work of Hermann von Helmholtz (1821–1894) and his student Wilhelm Wundt (1832–1920). Helmholtz and Wundt laid the basis of investigating how the senses work, especially sight and hearing.

According to Gregory, Helmholtz should take the credit for realising that perception is not just a passive acceptance of stimuli, but an active process involving memory and other internal processes.
Similar works
Most of the case studies describe only marker-based augmented reality content. Moreover, my research revealed that there are no AR masks case studies in education, despite the extensive AR masks use on social media platforms.
A great example of the game designed to help children with special needs to identify emotions.
Empathy
Empathy is a fundamental part of emotional and social education. Research has shown that empathy is essential to building healthy and happy relationships with family and friends (Helen Riess, MD. The Science of Empathy, 2017). Empathic children tend to perform better in school, various social situations and their adult careers. Children and teenagers who have the most considerable amount of skill at empathy are viewed as leaders by their peers.

Empathy can also be a crucial factor in teaching kids what bullying is and how not to engage in bullying behaviour. Empathy lessons are thus an important foundation in preventing bullying in school (Dodaj A. The effect of empathy on involving in bullying behaviour, 2013).
Explore my iterations timeline →