Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications

Sahar Aseeri; Sebastian Marin; Richard N. Landers; Victoria Interrante; Evan S. Rosenberg

doi:10.1109/VRW50115.2020.00141

Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications

Sahar Aseeri
, Sebastian Marin
, Richard N. Landers
, Victoria Interrante
, Evan S. Rosenberg

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

9 Scopus citations

Abstract

Providing effective communication in virtual reality (VR) applications requires body language and facial expressions to transmit users' thoughts and behavior. Embodied VR is an effective way to realistically render users' movements onto a virtual avatar in a virtual environment in real time. There are many VR applications that utilize this technique; however, most of them have limitations in photorealistic realism, body motion, and facial expressions. In this work, we introduce a novel VR communication system that mimics users' movements, facial expressions, and speech in order to render these capture data into different types of avatar representations in real-time. This system could be beneficial for any type of VR application that requires avatar-based communication in a 3D immersive virtual environment.

Original language	English (US)
Title of host publication	Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	581-582
Number of pages	2
ISBN (Electronic)	9781728165325
DOIs	https://doi.org/10.1109/VRW50115.2020.00141
State	Published - Mar 2020
Event	2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020 - Atlanta, United States Duration: Mar 22 2020 → Mar 26 2020

Publication series

Name	Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020

Conference

Conference	2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020
Country/Territory	United States
City	Atlanta
Period	3/22/20 → 3/26/20

Bibliographical note

Publisher Copyright:
© 2020 IEEE.

Keywords

H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems - Artificial
I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism - Virtual reality
augmented and virtual realities

Publisher link

10.1109/VRW50115.2020.00141

Find It

Find It at U of M Libraries

Cite this

Aseeri, S., Marin, S., Landers, R. N., Interrante, V., & Rosenberg, E. S. (2020). Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications. In Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020 (pp. 581-582). Article 9090630 (Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VRW50115.2020.00141

Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications. / Aseeri, Sahar; Marin, Sebastian; Landers, Richard N. et al.
Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020. Institute of Electrical and Electronics Engineers Inc., 2020. p. 581-582 9090630 (Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Aseeri, S, Marin, S, Landers, RN , Interrante, V & Rosenberg, ES 2020, Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications. in Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020., 9090630, Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020, Institute of Electrical and Electronics Engineers Inc., pp. 581-582, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020, Atlanta, United States, 3/22/20. https://doi.org/10.1109/VRW50115.2020.00141

Aseeri S, Marin S, Landers RN , Interrante V , Rosenberg ES. Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications. In Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020. Institute of Electrical and Electronics Engineers Inc. 2020. p. 581-582. 9090630. (Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020). doi: 10.1109/VRW50115.2020.00141

Aseeri, Sahar ; Marin, Sebastian ; Landers, Richard N. et al. / Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications. Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020. Institute of Electrical and Electronics Engineers Inc., 2020. pp. 581-582 (Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020).

@inproceedings{2c02ec8df26740feb206ce1918ba6ca4,

title = "Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications",

abstract = "Providing effective communication in virtual reality (VR) applications requires body language and facial expressions to transmit users' thoughts and behavior. Embodied VR is an effective way to realistically render users' movements onto a virtual avatar in a virtual environment in real time. There are many VR applications that utilize this technique; however, most of them have limitations in photorealistic realism, body motion, and facial expressions. In this work, we introduce a novel VR communication system that mimics users' movements, facial expressions, and speech in order to render these capture data into different types of avatar representations in real-time. This system could be beneficial for any type of VR application that requires avatar-based communication in a 3D immersive virtual environment.",

keywords = "H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems - Artificial, I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism - Virtual reality, augmented and virtual realities",

author = "Sahar Aseeri and Sebastian Marin and Landers, \{Richard N.\} and Victoria Interrante and Rosenberg, \{Evan S.\}",

note = "Publisher Copyright: {\textcopyright} 2020 IEEE.; 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020 ; Conference date: 22-03-2020 Through 26-03-2020",

year = "2020",

month = mar,

doi = "10.1109/VRW50115.2020.00141",

language = "English (US)",

series = "Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "581--582",

booktitle = "Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020",

}

TY - GEN

T1 - Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications

AU - Aseeri, Sahar

AU - Marin, Sebastian

AU - Landers, Richard N.

AU - Interrante, Victoria

AU - Rosenberg, Evan S.

PY - 2020/3

Y1 - 2020/3

N2 - Providing effective communication in virtual reality (VR) applications requires body language and facial expressions to transmit users' thoughts and behavior. Embodied VR is an effective way to realistically render users' movements onto a virtual avatar in a virtual environment in real time. There are many VR applications that utilize this technique; however, most of them have limitations in photorealistic realism, body motion, and facial expressions. In this work, we introduce a novel VR communication system that mimics users' movements, facial expressions, and speech in order to render these capture data into different types of avatar representations in real-time. This system could be beneficial for any type of VR application that requires avatar-based communication in a 3D immersive virtual environment.

AB - Providing effective communication in virtual reality (VR) applications requires body language and facial expressions to transmit users' thoughts and behavior. Embodied VR is an effective way to realistically render users' movements onto a virtual avatar in a virtual environment in real time. There are many VR applications that utilize this technique; however, most of them have limitations in photorealistic realism, body motion, and facial expressions. In this work, we introduce a novel VR communication system that mimics users' movements, facial expressions, and speech in order to render these capture data into different types of avatar representations in real-time. This system could be beneficial for any type of VR application that requires avatar-based communication in a 3D immersive virtual environment.

KW - H.5.1 [Information Interfaces and Presentation]: Multimedia Information Systems - Artificial

KW - I.3.7 [Computer Graphics]: Three-Dimensional Graphics and Realism - Virtual reality

KW - augmented and virtual realities

UR - https://www.scopus.com/pages/publications/85085366402

UR - https://www.scopus.com/pages/publications/85085366402#tab=citedBy

U2 - 10.1109/VRW50115.2020.00141

DO - 10.1109/VRW50115.2020.00141

M3 - Conference contribution

AN - SCOPUS:85085366402

T3 - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020

SP - 581

EP - 582

BT - Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VRW 2020

Y2 - 22 March 2020 through 26 March 2020

ER -

Embodied Realistic Avatar System with Body Motions and Facial Expressions for Communication in Virtual Reality Applications

Abstract

Publication series

Conference

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this