Table of Contents
“Mirroring” refers to the unconscious mimicry of another person’s behaviors, such as their facial expressions. Mirroring has many positive effects, such as enhancing closeness and improving the flow of a conversation, which enriches the quality of communication.
Our study set out to devise a means of evoking the positive effects of mirroring in a video chat without any conscious effort of participants. We constructed a videochat system, called “FaceShare”, which can transform the user’s face into a smile in response to their partner’s smiling. That is, our system generates mirroring by producing a pseudo-smile through image processing.
The facial expressions are transformed in real time by means of 3D deformation using the feature points of the face including the contours, eyes, nose, and mouth.
We conducted an experiment in which pairs of participants had brief conversations via FaceShare. The results implied that mirroring using the pseudo-smile lets the mimicker, whose face is deformed according to the expressions of their partner, feel a closeness, and improves the flow of the conversation for both the mimicker and the mimickee, who sees the mimicker’s deformed face.
(Ja) Keita Suzuki, Masanori Yokoyama, Shigeo Yoshida, Takayoshi Mochizuki, Tadashi Nunobiki, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. Augmentation of Remote Communication Using Congruent Facial Deformation Technique. Transactions of Information Processing Society of Japan, Vol.59 No.1 pp.52-60. http://id.nii.ac.jp/1001/00185265/
Keita Suzuki, Masanori Yokoyama, Shigeo Yoshida, Takayoshi Mochizuki, Tomohiro Yamada, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5313–5317. https://doi.org/10.1145/3025453.3025574