Posts by Collection

Portfolio item number 1

Short description of portfolio item number 1

Portfolio item number 2

Short description of portfolio item number 2

Preserving gaze direction in teleconferencing using a camera array and a spherical display

Published in 2012 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), 2012

Recommended citation: Pan, Y., & Steed, A. (2012). Preserving gaze direction in teleconferencing using a camera array and a spherical display. In 2012 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON).
Download Paper

Comparing flat and spherical displays in a trust scenario in avatar-mediated interaction

Published in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2014

Recommended citation: Pan, Y., Steptoe, W., & Steed, A. (2014, April). Comparing flat and spherical displays in a trust scenario in avatar-mediated interaction. In Proceedings of the SIGCHI conference on human factors in computing systems (pp. 1397-1406).
Download Paper

A gaze-preserving situated multiview telepresence system

Published in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 2014

Recommended citation: Pan, Y., & Steed, A. (2014, April). A gaze-preserving situated multiview telepresence system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2173-2176).
Download Paper

A surround video capture and presentation system for preservation of eye-gaze in teleconferencing applications

Published in Presence, 2015

Recommended citation: Pan, Y., Oyekoya, O., & Steed, A. (2015). A surround video capture and presentation system for preservation of eye-gaze in teleconferencing applications. Presence, 24(1), 24-43.
Download Paper

Symmetric telepresence using robotic humanoid surrogates

Published in Computer Animation and Virtual Worlds, 2015

Recommended citation: Nagendran, A., Steed, A., Kelly, B., & Pan, Y. (2015). Symmetric telepresence using robotic humanoid surrogates. Computer Animation and Virtual Worlds, 26(3-4), 271-280.
Download Paper

An empirical study on display ad impression viewability measurements

Published in arXiv preprint arXiv:1505.05788, 2015

Recommended citation: Zhang, W., Pan, Y., Zhou, T., & Wang, J. (2015). An empirical study on display ad impression viewability measurements. arXiv preprint arXiv:1505.05788.
Download Paper

An ‘in the wild’experiment on presence and embodiment using consumer virtual reality equipment

Published in IEEE transactions on visualization and computer graphics, 2016

Recommended citation: Steed, A., Frlston, S., Lopez, M. M., Drummond, J., Pan, Y., & Swapp, D. (2016). An ‘in the wild’experiment on presence and embodiment using consumer virtual reality equipment. IEEE transactions on visualization and computer graphics, 22(4), 1406-1414.
Download Paper

Effects of 3D perspective on head gaze estimation with a multiview autostereoscopic display

Published in International Journal of Human-Computer Studies, 2016

Recommended citation: Pan, Y., & Steed, A. (2016). Effects of 3D perspective on head gaze estimation with a multiview autostereoscopic display. International Journal of Human-Computer Studies, 86, 138-148.
Download Paper

The impact of a self-avatar on cognitive load in immersive virtual reality

Published in 2016 IEEE virtual reality (VR), 2016

Recommended citation: Steed, A., Pan, Y., Zisch, F., & Steptoe, W. (2016, March). The impact of a self-avatar on cognitive load in immersive virtual reality. In 2016 IEEE virtual reality (VR) (pp. 67-76). IEEE.
Download Paper

A comparison of avatar-, Video-, and robot-Mediated interaction on Users’ Trust in expertise

Published in Frontiers in Robotics and AI, 2016

Recommended citation: Pan, Y., & Steed, A. (2016). A comparison of avatar-, video-, and robot-mediated interaction on users’ trust in expertise. Frontiers in Robotics and AI, 3, 12.
Download Paper

The impact of self-avatars on trust and collaboration in shared virtual environments

Published in PloS one, 2017

Recommended citation: Pan, Y., & Steed, A. (2017). The impact of self-avatars on trust and collaboration in shared virtual environments. PloS one, 12(12), e0189078.
Download Paper

Empowerment and embodiment for collaborative mixed reality systems

Published in Computer Animation and Virtual Worlds, 2018

Recommended citation: Pan, Y., Sinclair, D., & Mitchell, K. (2018). Empowerment and embodiment for collaborative mixed reality systems. Computer Animation and Virtual Worlds, 29(3-4), e1838.
Download Paper

“We wait”—the impact of character responsiveness and self embodiment on presence and interest in an immersive news experience

Published in Frontiers in Robotics and AI, 2018

Recommended citation: Steed, A., Pan, Y., Watson, Z., & Slater, M. (2018). “We wait”—the impact of character responsiveness and self embodiment on presence and interest in an immersive news experience. Frontiers in Robotics and AI, 5, 112.
Download Paper

Enabling grasp action: Generalized quality evaluation of grasp stability via contact stiffness from contact mechanics insight

Published in Mechanism and Machine Theory, 2019

Recommended citation: Dong, H., Qiu, C., Prasad, D. K., Pan, Y., Dai, J., & Chen, I. M. (2019). Enabling grasp action: Generalized quality evaluation of grasp stability via contact stiffness from contact mechanics insight. Mechanism and Machine Theory, 134, 625-644.
Download Paper

Accurate and fast classification of foot gestures for virtual locomotion

Published in 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2019

Recommended citation: Shi, X., Pan, J., Hu, Z., Lin, J., Guo, S., Liao, M., ... & Liu, L. (2019, October). Accurate and fast classification of foot gestures for virtual locomotion. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (pp. 178-189). IEEE.
Download Paper

JUNGLE: an interactive visual platform for collaborative creation and consumption of nonlinear transmedia stories

Published in Interactive Storytelling: 12th International Conference on Interactive Digital Storytelling, ICIDS 2019, Little Cottonwood Canyon, UT, USA, November 19–22, 2019, Proceedings 12, 2019

Recommended citation: Kapadia, M., Muniz, C. M., Sohn, S. S., Pan, Y., Schriber, S., Mitchell, K., & Gross, M. (2019). JUNGLE: an interactive visual platform for collaborative creation and consumption of nonlinear transmedia stories. In Interactive Storytelling: 12th International Conference on Interactive Digital Storytelling, ICIDS 2019, Little Cottonwood Canyon, UT, USA, November 19–22, 2019, Proceedings 12 (pp. 250-266). Springer International Publishing.
Download Paper

How foot tracking matters: The impact of an animated self-avatar on interaction, embodiment and presence in shared virtual environments

Published in Frontiers in Robotics and AI, 2019

Recommended citation: Pan, Y., & Steed, A. (2019). How foot tracking matters: The impact of an animated self-avatar on interaction, embodiment and presence in shared virtual environments. Frontiers in Robotics and AI, 6, 104.
Download Paper

Avatar type affects performance of cognitive tasks in virtual reality

Published in Proceedings of the 25th ACM symposium on virtual reality software and technology, 2019

Recommended citation: Pan, Y., & Steed, A. (2019, November). Avatar type affects performance of cognitive tasks in virtual reality. In Proceedings of the 25th ACM symposium on virtual reality software and technology (pp. 1-4).
Download Paper

Group-Based Expert Walkthroughs: How Immersive Technologies Can Facilitate the Collaborative Authoring of Character Animation

Published in 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2020

Recommended citation: Pan, Y., & Mitchell, K. (2020, March). Group-Based Expert Walkthroughs: How Immersive Technologies Can Facilitate the Collaborative Authoring of Character Animation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 188-195). IEEE.
Download Paper

PoseMMR: A Collaborative Mixed Reality Authoring Tool for Character Animation

Published in 2020 IEEE Virtual Reality (VR), 2020

Recommended citation: Pan, Y., & Mitchell, K. (2020, March). PoseMMR: a collaborative mixed reality authoring tool for character animation. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 758-759). IEEE.
Download Paper

Pose-guided person image synthesis in the non-iconic views

Published in IEEE Transactions on Image Processing, 2020

Recommended citation: Xu, C., Fu, Y., Wen, C., Pan, Y., Jiang, Y. G., & Xue, X. (2020). Pose-guided person image synthesis in the non-iconic views. IEEE Transactions on Image Processing, 29, 9060-9072.
Download Paper

Improving VIP viewer gaze estimation and engagement using adaptive dynamic anamorphosis

Published in International Journal of Human-Computer Studies, 2020

Recommended citation: Pan, Y., & Mitchell, K. (2021). Improving VIP viewer gaze estimation and engagement using adaptive dynamic anamorphosis. International Journal of Human-Computer Studies, 147, 102563.
Download Paper

The rocketbox library and the utility of freely available rigged avatars

Published in Frontiers in virtual reality, 2020

Recommended citation: Gonzalez-Franco, M., Ofek, E., Pan, Y., Antley, A., Steed, A., Spanlang, B., ... & Lanier, J. (2020). The rocketbox library and the utility of freely available rigged avatars. Frontiers in virtual reality, 1, 561558.
Download Paper

Foreward to the Special Section on the Reality-Virtuality Continuum and its Applications (RVCA)

Published in Computers & Graphics, 2021

Recommended citation: Glencross, M., Mitchell, K., Mark, B., & Pan, Y. (2021). Foreward to the Special Section on the Reality-Virtuality Continuum and its Applications (RVCA). Computers & Graphics.
Download Paper

HPOF: 3d human pose recovery from monocular video with optical flow

Published in Proceedings of the 2021 International Conference on Multimedia Retrieval, 2021

Recommended citation: Ji, B., Yang, C., Shunyu, Y., & Pan, Y. (2021, August). HPOF: 3d human pose recovery from monocular video with optical flow. In Proceedings of the 2021 International Conference on Multimedia Retrieval (pp. 144-154).
Download Paper

MienCap: Performance-based facial animation with live mood dynamics

Published in 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022

Recommended citation: Pan, Y., Zhang, R., Wang, J., Chen, N., Qiu, Y., Ding, Y., & Mitchell, K. (2022, March). MienCap: Performance-based facial animation with live mood dynamics. In 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW) (pp. 654-655). IEEE.
Download Paper

Stylized Avatar Animation Based on Deep Learning

Published in Journal of Computer-Aided Design & Computer Graphics, 2022

Recommended citation: Zhang, R., & Pan, Y. (2022). Stylized Avatar Animation Based on Deep Learning. Journal of Computer-Aided Design & Computer Graphics, 34(5), 675-682.
Download Paper

State of the art in telepresence

Published in ACM SIGGRAPH 2022 Courses, 2022

Recommended citation: Lawrence, J., Pan, Y., Goldman, D. B., McDonnell, R., Robillard, J., O. Sullivan, C., ... & Saragih, J. (2022). State of the art in telepresence. In ACM SIGGRAPH 2022 Courses (pp. 1-74).
Download Paper

3DBrushVR: From Virtual Reality Primitives to Complex Manifold Objects

Published in 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2022

Recommended citation: Zhu, Y., Tang, X., Zhang, J., Pan, Y., Shen, J., & Jin, X. (2022, October). 3DBrushVR: From Virtual Reality Primitives to Complex Manifold Objects. In 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct) (pp. 423-428). IEEE.
Download Paper

Enabling massage actions: An interactive parallel robot with compliant joints

Published in 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2022

Recommended citation: Dong, H., Feng, Y., Qiu, C., Pan, Y., He, M., & Chen, I. M. (2022, October). Enabling massage actions: An interactive parallel robot with compliant joints. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 4632-4637). IEEE.
Download Paper

Emotional voice puppetry

Published in IEEE Transactions on Visualization and Computer Graphics, 2023

Recommended citation: Pan, Y., Zhang, R., Cheng, S., Tan, S., Ding, Y., Mitchell, K., & Yang, X. (2023). Emotional voice puppetry. IEEE Transactions on Visualization and Computer Graphics, 29(5), 2527-2535.
Download Paper

Stylevr: Stylizing character animations with normalizing flows

Published in IEEE Transactions on Visualization and Computer Graphics, 2023

Recommended citation: Ji, B., Pan, Y., Yan, Y., Chen, R., & Yang, X. (2023). Stylevr: Stylizing character animations with normalizing flows. IEEE Transactions on Visualization and Computer Graphics.
Download Paper

Fully Automatic Blendshape Generation for Stylized Characters

Published in 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 2023

Recommended citation: Wang, J., Qiu, Y., Chen, K., Ding, Y., & Pan, Y. (2023, March). Fully Automatic Blendshape Generation for Stylized Characters. In 2023 IEEE Conference Virtual Reality and 3D User Interfaces (VR) (pp. 347-355). IEEE.
Download Paper

Rendering and Reconstruction Based 3D Portrait Stylization

Published in 2023 IEEE International Conference on Multimedia and Expo (ICME), 2023

Recommended citation: Li, S., & Pan, Y. (2023, July). Rendering and Reconstruction Based 3D Portrait Stylization. In 2023 IEEE International Conference on Multimedia and Expo (ICME) (pp. 912-917). IEEE.
Download Paper

State of the Art in Telepresence (Part 1)

Published in ACM SIGGRAPH 2023 Courses, 2023

Recommended citation: Lawrence, J., Pan, Y., Goldman, D. B., McDonnell, R., O Sullivan, C., Luebke, D., ... & Saragih, J. (2023). State of the Art in Telepresence (Part 1). ACM SIGGRAPH 2023 Courses, 1-132.
Download Paper

Emmn: Emotional motion memory network for audio-driven emotional talking face generation

Published in Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023

Recommended citation: Tan, S., Ji, B., & Pan, Y. (2023). Emmn: Emotional motion memory network for audio-driven emotional talking face generation. In Proceedings of the IEEE/CVF International Conference on Computer Vision (pp. 22146-22156).
Download Paper

Real-time facial animation for 3d stylized character with emotion dynamics

Published in Proceedings of the 31st ACM International Conference on Multimedia, 2023

Recommended citation: Pan, Y., Zhang, R., Wang, J., Ding, Y., & Mitchell, K. (2023, October). Real-time facial animation for 3d stylized character with emotion dynamics. In Proceedings of the 31st ACM International Conference on Multimedia (pp. 6851-6859).
Download Paper

Double Doodles: Sketching Animation in Immersive Environment With 3+ 6 DOFs Motion Gestures

Published in Proceedings of the 31st ACM International Conference on Multimedia, 2023

Recommended citation: Chen, R., Pan, Y., Deng, Z., Wang, L., & Ma, L. (2023, October). Double Doodles: Sketching Animation in Immersive Environment With 3+ 6 DOFs Motion Gestures. In Proceedings of the 31st ACM International Conference on Multimedia (pp. 6998-7006).
Download Paper

Expressive talking avatars

Published in IEEE transactions on visualization and computer graphics, 2024

Recommended citation: Pan, Y., Tan, S., Cheng, S., Lin, Q., Zeng, Z., & Mitchell, K. (2024). Expressive talking avatars. IEEE Transactions on Visualization and Computer Graphics.
Download Paper

Head3D: complete 3D head generation via tri-plane feature distillation

Published in ACM Transactions on Multimedia Computing, Communications and Applications, 2024

Recommended citation: Cheng, Y., Yan, Y., Zhu, W., Pan, Y., Pan, B., & Yang, X. (2024). Head3D: complete 3D head generation via tri-plane feature distillation. ACM Transactions on Multimedia Computing, Communications and Applications, 20(6), 1-20.
Download Paper

EmoFace: Audio-driven Emotional 3D Face Animation

Published in 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR), 2024

Recommended citation: Liu, C., Lin, Q., Zeng, Z., & Pan, Y. (2024, March). EmoFace: Audio-driven Emotional 3D Face Animation. In 2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR) (pp. 387-397). IEEE.
Download Paper

Say anything with any style

Published in Proceedings of the AAAI Conference on Artificial Intelligence, 2024

Recommended citation: Tan, S., Ji, B., Ding, Y., & Pan, Y. (2024, March). Say anything with any style. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 38, No. 5, pp. 5088-5096).
Download Paper

Style2talker: High-resolution talking head generation with emotion style and art style

Published in Proceedings of the AAAI Conference on Artificial Intelligence, 2024

Recommended citation: Tan, S., Ji, B., & Pan, Y. (2024, March). Style2talker: High-resolution talking head generation with emotion style and art style. In Proceedings of the AAAI Conference on Artificial Intelligence (Vol. 38, No. 5, pp. 5079-5087).
Download Paper

EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis

Published in European Conference on Computer Vision (ECCV), 2024

Recommended citation: Tan, S., Ji, B., Bi, M., & Pan, Y. (2024). EDTalk: Efficient Disentanglement for Emotional Talking Head Synthesis. arXiv preprint arXiv:2404.01647.
Download Paper

Instant Photorealistic Neural Radiance Fields Stylization

Published in ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2024

Recommended citation: Li, S., & Pan, Y. (2024, April). Instant Photorealistic Neural Radiance Fields Stylization. In ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) (pp. 2980-2984). IEEE.
Download Paper

Hyperstyle3d: Text-guided 3d portrait stylization via hypernetworks

Published in IEEE Transactions on Circuits and Systems for Video Technology, 2024

Recommended citation: Chen, Z., Xu, X., Yan, Y., Pan, Y., Zhu, W., Wu, W., ... & Yang, X. (2024). Hyperstyle3d: Text-guided 3d portrait stylization via hypernetworks. IEEE Transactions on Circuits and Systems for Video Technology.
Download Paper

FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization

Published in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024

Recommended citation: Tan, S., Ji, B., & Pan, Y. (2024). FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (pp. 26317-26327).
Download Paper

Talk 1 on Relevant Topic in Your Field

Published: March 01, 2012

This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!

Tutorial 1 on Relevant Topic in Your Field

Published: March 01, 2013

More information here

Talk 2 on Relevant Topic in Your Field

Published: February 01, 2014

More information here

Conference Proceeding talk 3 on Relevant Topic in Your Field

Published: March 01, 2014

This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.

Computer Animation Design And Data Visualization

Postgraduate course, Shanghai Jiao Tong University, 2021

2021-09 ~ 2022-01, CS7306

Computer Animation Design And Data Visualization

Postgraduate course, Shanghai Jiao Tong University, 2023

2023-09 ~ 2024-01, CS7306