Eye-Tracking Data Analysis in Augmented Reality: A Future Perspective
In the heart of Italy's Marche Region, a groundbreaking study was conducted at the National Gallery of Urbino, shedding light on the potential of eye-tracking technology in optimising Augmented Reality (AR) applications within the realm of Cultural Heritage.
The study aimed to understand the visual behaviour of museum visitors, using eye-tracking technology, to optimise an existing AR application. Three renowned paintings from the gallery—"The Annunciation" by Piero della Francesca, Fra Angelico, and Sassetta—were chosen as stimuli for the research.
Recent advancements in eye-tracking technology are significantly enhancing our understanding of art perception and the optimisation of AR applications in the field of Cultural Heritage. By combining eye-tracking with facial expression recognition, museums can now gain real-time feedback on how visitors engage with artworks, enabling them to design more immersive and tailored experiences based on viewers’ gaze patterns and emotional responses.
In the context of AR, eye-tracking is increasingly integrated into Extended Reality (XR) systems, used in museums and heritage sites to create interactive, immersive experiences. Eye-tracking data informs the system about user attention and focus, enabling more natural and adaptive interactions within AR environments. This helps optimise the presentation of digital content overlaid on physical artifacts, making augmented experiences more intuitive and engaging.
Moreover, eye-tracking contributes to preserving and transmitting intangible cultural heritage by providing insights into attention and engagement patterns during immersive experiences, which supports the design of effective storytelling and educational AR/VR applications.
The study's preliminary results were presented, indicating that eye-tracking technology can provide valuable insights into people's visual behaviour when observing art in a museum setting. The findings suggest that subjects spent more time looking at digital contents compared to the paintings themselves when using the AR application. This discovery underscores the need to improve the Augmented Reality application to better integrate digital contents with the paintings, encouraging a more balanced viewing experience.
The convergence of AI, eye-tracking, and XR technologies is leading to real-time dynamic feedback to adapt exhibits and AR content, deeper insight into viewers’ cognitive and emotional reactions to art, enhanced immersive storytelling that preserves cultural narratives, and more precise and personalised augmented reality experiences in cultural heritage contexts.
These developments highlight a growing trend to leverage eye-tracking not only as a passive measurement tool but as an active input modality that improves both the research of art perception and the usability of AR in cultural heritage preservation and presentation. As eye-tracking technology becomes more accessible and affordable, we can expect to see its increased use in various research fields, revolutionising the way we interact with and understand our cultural heritage.
Artificial Intelligence, combined with eye-tracking technology, is being used to create more immersive and tailored experiences in cultural heritage museums. By analyzing gaze patterns and emotional responses, museums can design AR applications that optimize digital content overlay on physical artifacts.
Medical-conditions related to visual attention can be studied further with the increasing use of eye-tracking technology in AR/XR systems. This technology could potentially help researchers understand how different medical conditions may influence art perception and engagement, contributing to a deeper understanding of visual cognition.
