REPRESENTATION OF NONVERBAL COMMUNICATIVE SIGNALS IN AI-MEDIATED COMMUNICATION
Keywords:
Keywords: AI-mediated communication, nonverbal communication, embodied conversational agent, virtual human, social robot, gaze, gesture, social presence.Abstract
Abstract. This article examines the representation of nonverbal signals in AI-mediated communication, focusing on gaze, facial expression, gesture, posture, and body movement. It analyses how these signals are modelled and interpreted in conversational agents, virtual humans, avatars, and social robots. The study shows that effective nonverbal communication depends on contextual appropriateness, temporal coordination, behavioural consistency, and social presence.
References
1.Bickmore, T.W. Relational Agents: Effecting Change through Human-Computer Relationships : PhD thesis / Bickmore, T.W. – Cambridge, MA : Massachusetts Institute of Technology, 2003. – 284 p.. – URL: https://www.media.mit.edu/publications/relational-agents-effecting-change-through-human-computer-relationships/.
2.Churamani, N. Continual Learning for Affective Robotics : PhD thesis / Churamani, N. – Cambridge : University of Cambridge, 2022. – URL: https://www.repository.cam.ac.uk/handle/1810/349218.
3.Dalzel-Job, S. Social Interaction in Virtual Environments: The Relationship between Mutual Gaze, Task Performance and Social Presence : PhD thesis / Dalzel-Job, S. – Edinburgh : The University of Edinburgh, 2014. – 176 PDF pages. – URL: http://hdl.handle.net/1842/15792.
4.Devin, V. An Interactive Talking Head : PhD thesis / Devin, V. – Leeds : University of Leeds, 2002. – 117 PDF pages. – URL: https://etheses.whiterose.ac.uk/id/eprint/1310/.
5.Garau, M. The Impact of Avatar Fidelity on Social Interaction in Virtual Environments : PhD thesis / Garau, M. – London : University College London, 2003. – URL: https://discovery.ucl.ac.uk/id/eprint/10103871/.
6.Moorlag, F.N. The Effects of a Social Robot’s Gestures on Learning Outcomes : Master thesis / Moorlag, F.N. – Delft : Delft University of Technology, 2021. – URL: https://resolver.tudelft.nl/uuid:ae1edd23-aeeb-4d36-a7b7-8ec4524bf56d.
7.Pan, X. Experimental Studies of the Interaction between People and Virtual Humans with a Focus on Social Anxiety : PhD thesis / Pan, X. – London : University College London, 2010. – 204 PDF pages. – URL: https://discovery.ucl.ac.uk/id/eprint/19763/.
8.Simmons, C.B. Usability Design of Embodied Conversational Agents on Handheld Devices : thesis / Simmons, C.B. – Edinburgh : The University of Edinburgh, 2014. – URL: http://hdl.handle.net/1842/17962.
9.Steptoe, W.A.H. Eye Tracking and Avatar-Mediated Communication in Immersive Collaborative Virtual Environments : Doctoral thesis / Steptoe, W.A.H. – London : University College London, 2010. – URL: https://discovery.ucl.ac.uk/id/eprint/549351/.
10.Wilson, J.J. What Co-Speech Gestures Do: Investigating the Communicative Role of Visual Behaviour Accompanying Language Use during Reference in Interaction : PhD thesis / Wilson, J.J. – Leeds : University of Leeds, 2016. – 518 PDF pages. – URL: https://etheses.whiterose.ac.uk/id/eprint/17319/.
11.Xu, J. Affective Body Language of Humanoid Robots: Perception and Effects in Human Robot Interaction : Doctoral thesis / Xu, J. – Delft : Delft University of Technology, 2015. – URL: https://doi.org/10.4233/uuid:c5802c94-a984-474c-8703-698e056086ad.
12.Zamani, F.N. Communication Strategies in the Digital Age : PhD thesis / Zamani, F.N. – Sheffield : University of Sheffield, 2021. – 360 PDF pages. – URL: https://etheses.whiterose.ac.uk/id/eprint/30881/.
