Publications

Modulating Olfactory Perception through Localized Nasal Thermal Stimulation

Rui Zhang, Yitian Ding, Ningchang Xiong, and Shaoyu Cai

Proceedings of the 2026 Designing Interactive Systems Conference (DIS 2026), pp. 931-946. 2026.

Signals of Aggression: Modelling Multimodal Cues and Perceptual Effects in Virtual Agents

Shaun Jing Heng Ong, Aiden Tat Yang Koh, Shaoyu Cai, Felicia Fang-Yi Tan, Patrick Chia, and Eng Tat Khoo

Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI 2026), April 13-17, 2026, Barcelona, Spain.

EgoPoseVR: Spatiotemporal Multi-Modal Reasoning for Egocentric Full-Body Pose in Virtual Reality

Haojie Cheng, Shaun Jing Heng Ong, Shaoyu Cai, Aiden Tat Yang Koh, Fuxi Ouyang, and Eng Tat Khoo

IEEE Transactions on Visualization & Computer Graphics (IEEE VR 2026).

AromaCanvas: A Wearable Olfactory Display for Chinese Painting Appreciation and Learning in Virtual Reality

Tao Lin, Quanhao Gan, Fuxi Ouyang, Yiming Luo, Yushan Pan, Yushi Li, and Shaoyu Cai

Computers & Education: X Reality 7 (2025): 100109.

Metaheuristic Color Scheme Strategies for Enhanced Visual Inspection of 3D IC Layouts

Jie Zhang, Zhansen Shi, Hanchen Wang, Zhuoyang Zhang, Lucas Lum, Quanhao Gan, Shaoyu Cai, Eng Tat Khoo, and Yeow Kheng Lim

IEEE International Conference on Physical Assurance and Inspection of Electronics (PAINE 2025).

🏆 Best Paper Award — PAINE 2025

Interactive Multimodal Storytelling Installation for Dementia Awareness and Engagement: Somewhere in This Fog of Memory

Zhansen Shi, Nicolette Jia Yi Tan, Kate Sangwon Lee, Shaoyu Cai, and Eng Tat Khoo

Proceedings of the 2025 International Conference on Information Technology for Social Good (GoodIT 2025). ACM New York, USA, 79-89.

From Beeping Machines to Caring Companions: Redesigning Social Robots Through Reflective Ethnography in Elderly Care Work

Xinpeng Liu, Haosu Xu, Yiming Luo, and Shaoyu Cai

Proceedings of the ACM on Human-Computer Interaction 9(7), 1-29. CSCW 2025.

🏆 Best Paper Honorable Mentions — CSCW 2025

From Routes to Ratings: Challenges and Strategies in Food Delivery Work

Haosu Xu, Yiming Luo, Yihong Wang, Ding Wang, Yushan Pan, and Shaoyu Cai

Computer Supported Cooperative Work (CSCW) 34, no. 3 (2025): 911-948.

VirCHEW Reality: On-Face Kinesthetic Feedback for Enhancing Food-Intake Experience in Virtual Reality

Qingqin Liu, Ziqi Fang, Jiayi Wu, Shaoyu Cai, Jianhui Yan, Tiande Mo, Shuk Ching Chan, and Kening Zhu

SIGGRAPH 2025 Conference Papers, pp. 1-12. 2025.

🏆 Top 10 Technical Papers Fast Forward — SIGGRAPH 2025

HawkerVerse: Crafting Immersive Singapore Hawker Heritage Experiences through Multisensory Virtual Reality and Large Language Models

Quanhao Gan, Tao Lin, Eng Tat Khoo, Natalie Pang, and Shaoyu Cai

Adjunct Proceedings of the 2025 International Conference on Human-Engaged Computing, pp. 1-4. 2025.

🏆 Best Demo Honorable Mentioned Award — ICHEC 2025

ChewBit: Enhancing Haptic Feedback with an On-Face Pneumatic Interface for Realistic Food Texture in VR

Qingqin Liu, Ziqi Fang, Jiayi Wu, Shaoyu Cai, Jianhui Yan, Tiande Mo, Shuk Ching Chan, and Kening Zhu

Proceedings of the SIGGRAPH Asia 2025 Emerging Technologies, pp. 1-3. 2025.

🏆 Best Audience Choice Award — SIGGRAPH Asia 2025 Emerging Technologies

Wearable Haptic Devices for Modulating Perceived Roughness of Physical Surfaces in Real-Time Simulation in Mixed Reality Environments

Kening Zhu, Xinge Yu, Shaoyu Cai, Haichen Gao, and Qi Zhang

U.S. Patent No. 12,282,600. 22 April 2025.

ThermOuch: A Wearable Thermo-Haptic Device for Inducing Pain Sensation in Virtual Reality through Thermal Grill Illusion

Haichen Gao, Shaoyu Cai, Yuhong Wu, and Kening Zhu

SIGGRAPH Asia 2024 Conference Papers, pp. 1-12. 2024.

ViboPneumo: A Vibratory-Pneumatic Finger-Worn Haptic Device for Altering Perceived Texture Roughness in Mixed Reality

Shaoyu Cai, Zhenlin Chen, Haichen Gao, Ya Huang, Qi Zhang, Xinge Yu, and Kening Zhu

IEEE Transactions on Visualization & Computer Graphics. 2024.

Skin-integrated Multimodal Haptic Interface for Immersive Tactile Feedback

Ya Huang, Jingkun Zhou, Pingchuan Ke, Xu Guo, Chunki Yiu, Kuanming Yao, Shaoyu Cai, ..., Zhaoqian Xie, Kening Zhu, and Xinge Yu

Nature Electronics 6, no. 12 (2023): 1020-1031.

Comparing Perceptual Thresholds of Size Perception under Different Distances in Augmented Reality

Liwen Wang and Shaoyu Cai

2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

Perceptual Thresholds of Visual Size Discrimination in Augmented and Virtual Reality

Liwen Wang, Shaoyu Cai, and Christian Sandor

Computers & Graphics, vol. 117, pp. 105-113, Dec. 2023.

Leg-Based Wearable System with Propeller-Based Force Feedback for Walking in Fluids in VR

Kening Zhu, Pingchuan Ke, Shaoyu Cai, and Haichen Gao

U.S. Patent No. 11,662,825. 30 May 2023.

PropelWalker: A Leg-based Wearable System with Propeller-based Force Feedback for Walking in Fluids in VR

Pingchuan Ke, Shaoyu Cai, Haichen Gao, and Kening Zhu

IEEE Transactions on Visualization and Computer Graphics, 29(12), 5149-5164. 2022.

Multi-modal Transformer-based Tactile Signal Generation for Haptic Texture Simulation of Materials in Virtual and Augmented Reality

Shaoyu Cai and Kening Zhu

2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct).

GAN-based Image-to-Friction Generation for Tactile Simulation of Fabric Material

Shaoyu Cai, Lu Zhao, Yuki Ban, Takuji Narumi, Yue Liu, and Kening Zhu

Computers & Graphics, vol. 102, pp. 460-473, Feb. 2022.

Visual-Tactile Cross-Modal Data Generation using Residue-Fusion GAN with Feature-Matching and Perceptual Losses

Shaoyu Cai, Kening Zhu, Yuki Ban, and Takuji Narumi

IEEE Robotics and Automation Letters (RA-L), vol. 6, no. 4, pp. 7525-7532.

Weighted Walking: Propeller-based On-leg Force Simulation of Walking in Fluid Materials in VR

Pingchuan Ke, Shaoyu Cai, Lantian Xu, and Kening Zhu

SIGGRAPH Asia 2021 Emerging Technologies. ACM, New York, NY, USA, Article 19, pp. 1-2. 2021.

FrictGAN: Frictional Signal Generation from Fabric Texture Images using Generative Adversarial Network

Shaoyu Cai, Yuki Ban, Takuji Narumi, and Kening Zhu

International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments, pp. 11-15. The Eurographics Association, 2020.

🏆 Best Paper Audience Choice Award — ICAT-EGVE 2020

ThermAirGlove: A Pneumatic Glove for Thermal Perception and Material Identification in Virtual Reality

Shaoyu Cai, Pingchuan Ke, Takuji Narumi, and Kening Zhu

2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 248-257. IEEE VR, 2020.

A Sense of Ice and Fire: Exploring Thermal Feedback with Multiple Thermoelectric-Cooling Elements on a Smart Ring

Kening Zhu, Simon Perrault, Taizhou Chen, Shaoyu Cai, and Roshan Lalintha Peiris

International Journal of Human-Computer Studies 130 (2019): 234-247.

Demonstration of ThermAirGlove: A Pneumatic Glove for Material Perception in Virtual Reality through Thermal and Force Feedback

Shaoyu Cai, Pingchuan Ke, Shanshan Jiang, Takuji Narumi, and Kening Zhu

SIGGRAPH Asia 2019 Emerging Technologies, pp. 11-12. 2019.

Embodied Weather: Promoting Public Understanding of Extreme Weather Through Immersive Multi-Sensory Virtual Reality

Pingchuan Ke, Kai-Ning Keng, Shanshan Jiang, Shaoyu Cai, Zhiyi Rong, and Kening Zhu

The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, pp. 1-2. 2019.

HapTwist: Creating Interactive Haptic Proxies in Virtual Reality Using Low-cost Twistable Artefacts

Kening Zhu, Taizhou Chen, Shaoyu Cai, Feng Han, and Yi-Shiun Wu

SIGGRAPH Asia 2018 Virtual & Augmented Reality, pp. 1-2. 2018.