TacTransformer

TacTransformer explores multi-modal transformer-based tactile signal generation for haptic texture simulation in virtual and augmented reality. The project uses transformer models to learn relationships across visual, tactile, and material-related signals for generating haptic feedback.

The work advances data-driven haptic rendering by investigating how modern sequence models can synthesize tactile signals that support more scalable and realistic material experiences in immersive environments under differnet applied forces and scanning directions on different material surfaces through tool-based interaction.