3D Gaze Tracking for Studying Collaborative Interactions in Mixed-Reality Environments

Davalos, Eduardo; Zhang, Yike; Ashwin, T.S.; Fonteles, Joyce Horn; Timalsina, Umesh; Biswas, Gautam. “3D Gaze Tracking for Studying Collaborative Interactions in Mixed-Reality Environments”. ACM International Conference Proceeding Series, 2024, pp. 175-183. DOI: 10.1145/3686215.3688380. 

 

This study presents a new method for tracking where people are looking in 3D space, designed for mixed-reality environments, to improve teamwork and collaboration. Traditional gaze tracking struggles when trying to track multiple people at once, especially in group settings. Our method uses advanced computer vision and machine learning to track gaze accurately in 3D without needing special equipment. It combines facial recognition and deep learning to follow gaze patterns in real-time, fixing common problems and keeping data consistent. This approach could help improve behavior analysis and interactions in settings like education and job training. To support further development and transparency, we’ve shared the code online at https://github.com/edavalosanaya/3DGazeTracking_ICMIW2024. 

Explore Story Topics