This thesis explores how Mixed Reality (MR) technologies and natural hand interactions can be enhanced using haptic feedback to improve human performance in simulated tasks. Modern MR devices, such as Microsoft HoloLens 2 and Meta Quest 3, enable spatial awareness and 3D environment reconstruction. We developed a series of applications demonstrating that integrating simple haptic feedback—such as vibrotactile notifications—significantly reduces user confusion, increases task precision, and enhances depth perception during virtual manipulation. Specifically, applications ranged from spatial positioning of complex medical and industrial equipment (like the Da Vinci surgical robot) and virtual knee fracture reduction to advanced computer vision tracking using ArUco markers for force-feedback gloves. Results indicate that proper haptic feedback and spatial awareness improve interaction fluidity, user confidence, and overall effectiveness in mixed reality environments.

Leveraging and improving interactions with the environment and hands in mixed reality experiences.

HAMAD, JAFAR
2026

Abstract

This thesis explores how Mixed Reality (MR) technologies and natural hand interactions can be enhanced using haptic feedback to improve human performance in simulated tasks. Modern MR devices, such as Microsoft HoloLens 2 and Meta Quest 3, enable spatial awareness and 3D environment reconstruction. We developed a series of applications demonstrating that integrating simple haptic feedback—such as vibrotactile notifications—significantly reduces user confusion, increases task precision, and enhances depth perception during virtual manipulation. Specifically, applications ranged from spatial positioning of complex medical and industrial equipment (like the Da Vinci surgical robot) and virtual knee fracture reduction to advanced computer vision tracking using ArUco markers for force-feedback gloves. Results indicate that proper haptic feedback and spatial awareness improve interaction fluidity, user confidence, and overall effectiveness in mixed reality environments.
15-nov-2026
Inglese
Haptic feedback
Hololens 2
Mixed Reality
Ferrari, Vincenzo
Bianchi, Matteo
File in questo prodotto:
File Dimensione Formato  
PHD_Thesis_Jafar_Hamad.pdf

accesso aperto

Licenza: Creative Commons
Dimensione 51.85 MB
Formato Adobe PDF
51.85 MB Adobe PDF Visualizza/Apri

I documenti in UNITESI sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.14242/385756
Il codice NBN di questa tesi è URN:NBN:IT:UNIPI-385756