Skip to main content
  1. Works/

FaceShare

Emotion Embodied Cognition Video Chat Computer Mediated Communication CHI 2017
Table of Contents
Mirroring with Pseudo-smile Enriches Video Chat Communications
About>

About #

“Mirroring” refers to the unconscious mimicry of another person’s behaviors, such as their facial expressions. Mirroring has many positive effects, such as enhancing closeness and improving the flow of a conversation, which enriches the quality of communication.

Our study set out to devise a means of evoking the positive effects of mirroring in a video chat without any conscious effort of participants. We constructed a videochat system, called “FaceShare”, which can transform the user’s face into a smile in response to their partner’s smiling. That is, our system generates mirroring by producing a pseudo-smile through image processing.

The facial expressions are transformed in real time by means of 3D deformation using the feature points of the face including the contours, eyes, nose, and mouth.

We conducted an experiment in which pairs of participants had brief conversations via FaceShare. The results implied that mirroring using the pseudo-smile lets the mimicker, whose face is deformed according to the expressions of their partner, feel a closeness, and improves the flow of the conversation for both the mimicker and the mimickee, who sees the mimicker’s deformed face.

Publications>

Publications #

  • (Ja) Keita Suzuki, Masanori Yokoyama, Shigeo Yoshida, Takayoshi Mochizuki, Tadashi Nunobiki, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. Augmentation of Remote Communication Using Congruent Facial Deformation Technique. Transactions of Information Processing Society of Japan, Vol.59 No.1 pp.52-60. http://id.nii.ac.jp/1001/00185265/

  • Keita Suzuki, Masanori Yokoyama, Shigeo Yoshida, Takayoshi Mochizuki, Tomohiro Yamada, Takuji Narumi, Tomohiro Tanikawa, and Michitaka Hirose. 2017. FaceShare: Mirroring with Pseudo-Smile Enriches Video Chat Communications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). Association for Computing Machinery, New York, NY, USA, 5313–5317. https://doi.org/10.1145/3025453.3025574

Related Projects #

Teardrop Glasses
Emotion Embodied Cognition Design CHI 2021
Divided Presence
Decision Making Video Chat Computer Mediated Communication HAI 2018
Smart Face
Emotion Embodied Cognition Video Chat Computer Mediated Communication CSCW 2014
Incendiary Reflection
Emotion Embodied Cognition Design AH SIGGRAPH 2013