Shaoyu Cai

I am a researcher in Human-computer Interaction(HCI)

About

Shaoyu Cai 蔡紹禹

I am currently a Ph.D student from School of Creative Media, City University of Hong Kong, as well as a member of Multimodal and Embodied Interaction (MEI) lab supervised by Prof. Kening Zhu. My research interest lies in the field of Human-Computer Interaction (HCI), especially for cross-modal generation (e.g., from vision to touch) and deep-learning-based tactile texture modelling and rendering. I am also interested in haptic interface design and psychophysical perception for virtual reality and augmented reality.

[CV] [Google Scholar] [dblp][ResearchGate]

Latest News

[2021.07] One paper was accepted by IEEE Robotics and Automation Letters with IROS 2021!

[2020.12] FrictGAN received Best Paper Audience Choice Award!

More...

Publications

Visual-Tactile Cross-Modal Data Generation using Residue-Fusion GAN with Feature-Matching and Perceptual Losses

Shaoyu Cai, Kening Zhu, Yuki Ban, and Takuji Narumi

In IEEE Robotics and Automation Letters (RA-L) with IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2021).

[Paper] [Code]

FrictGAN: Frictional Signal Generation from Fabric Texture Images using Generative Adversarial Network ( Best Paper Audience Choice Award)

Shaoyu Cai, Yuki Ban, Takuji Narumi, and Kening Zhu

In ICAT-EGVE2020: International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments, pp. 11-15. The Eurographics Association, 2020.

[Paper] [Code]

ThermAirGlove: A pneumatic glove for thermal perception and material identification in virtual reality

Shaoyu Cai, Pingchuan Ke, Takuji Narumi, and Kening Zhu

In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), pp. 248-257. IEEE, 2020.

[Paper] [Video]

Demonstration of thermairglove: A pneumatic glove for material perception in virtual reality through thermal and force feedback

Shaoyu Cai, Pingchuan Ke, Shanshan Jiang, Takuji Narumi, and Kening Zhu

In SIGGRAPH Asia 2019 Emerging Technologies, pp. 11-12. 2019.

[Paper] [Video]

A sense of ice and fire: Exploring thermal feedback with multiple thermoelectric-cooling elements on a smart ring

Kening Zhu, Simon Perrault, Taizhou Chen, Shaoyu Cai, and Roshan Lalintha Peiris

International Journal of Human-Computer Studies 130 (2019): 234-247.

[Paper] [Video]

Embodied Weather: Promoting Public Understanding of Extreme Weather Through Immersive Multi-Sensory Virtual Reality

Pingchuan Ke, Kai-Ning Keng, Shanshan Jiang, Shaoyu Cai, Zhiyi Rong, and Kening Zhu

In The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry, pp. 1-2. 2019.

[Paper] [Video]

HapTwist: creating interactive haptic proxies in virtual reality using low-cost twistable artefacts

Kening Zhu, Taizhou Chen, Shaoyu Cai, Feng Han, and Yi-Shiun Wu

In SIGGRAPH Asia 2018 Virtual & Augmented Reality, pp. 1-2. 2018.

[Paper] [Video]

Research Experience

Education

PhD in Creative Media

2019.9 - present

School of Creative Media, City University of Hong Kong, Hong Kong SAR, China

Supervisor: Prof. Kening Zhu

Reseach topics: Cross-modal Interaction, Tactile Rendering, Virtual/Augmentated Reality

Bachelor of Engineering

2014.9 - 2018.6

College of Engineering and Technology, Huazhong Agricultural University, Wuhan, China

Bachelor in Engineering

Professional Experience

Visiting student

2020.1 - 2020.3

Graduate of Information Science and Technology, The University of Tokyo, Tokyo, Japan

Supervisors: Prof. Takuji Narumi and Prof. Yuki Ban

Research assistant

2018.8 - 2019.8

School of Creative Media, City University of Hong Kong, Hong Kong SAR, China

Supervisor: Prof. Kening Zhu

Visiting student

2016.9 - 2017.2

Department of Electrical Engineering, National Taipei University, Taiwan, China

Supervisor: Prof. Hooman Samani

Projects

  • ALL
  • VR/AR
  • Cross-modal
  • Haptic Interface

FrictGAN

ICAT-EGVE 2020

ThermAirGlove

IEEE VR 2020 & Siggraph Asia 2019

Thermal Ring

INT J of Human-Computer Studies

Embodied Weather

VRCAI 2019

HapTwist

Siggraph Asia 2018

More News

[2020.12] FrictGAN received Best Paper Audience Choice Award!

[2020.10] One paper was accepted by ICAT-EGVE 2020!

[2020.03] One paper was accepted by IEEE VR 2020!

Contact

Location:

Run Run Shaw Creative Media Centre, 18 Tat Hong Avenue, Kowloon Tong, Hong Kong

Loading
Your message has been sent. Thank you!