This thesis explores how Mixed Reality (MR) technologies and natural hand interactions can be enhanced using haptic feedback to improve human performance in simulated tasks. Modern MR devices, such as Microsoft HoloLens 2 and Meta Quest 3, enable spatial awareness and 3D environment reconstruction. We developed a series of applications demonstrating that integrating simple haptic feedback—such as vibrotactile notifications—significantly reduces user confusion, increases task precision, and enhances depth perception during virtual manipulation. Specifically, applications ranged from spatial positioning of complex medical and industrial equipment (like the Da Vinci surgical robot) and virtual knee fracture reduction to advanced computer vision tracking using ArUco markers for force-feedback gloves. Results indicate that proper haptic feedback and spatial awareness improve interaction fluidity, user confidence, and overall effectiveness in mixed reality environments.
Leveraging and improving interactions with the environment and hands in mixed reality experiences.
HAMAD, JAFAR
2026
Abstract
This thesis explores how Mixed Reality (MR) technologies and natural hand interactions can be enhanced using haptic feedback to improve human performance in simulated tasks. Modern MR devices, such as Microsoft HoloLens 2 and Meta Quest 3, enable spatial awareness and 3D environment reconstruction. We developed a series of applications demonstrating that integrating simple haptic feedback—such as vibrotactile notifications—significantly reduces user confusion, increases task precision, and enhances depth perception during virtual manipulation. Specifically, applications ranged from spatial positioning of complex medical and industrial equipment (like the Da Vinci surgical robot) and virtual knee fracture reduction to advanced computer vision tracking using ArUco markers for force-feedback gloves. Results indicate that proper haptic feedback and spatial awareness improve interaction fluidity, user confidence, and overall effectiveness in mixed reality environments.| File | Dimensione | Formato | |
|---|---|---|---|
|
PHD_Thesis_Jafar_Hamad.pdf
accesso aperto
Licenza:
Creative Commons
Dimensione
51.85 MB
Formato
Adobe PDF
|
51.85 MB | Adobe PDF | Visualizza/Apri |
I documenti in UNITESI sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.
https://hdl.handle.net/20.500.14242/385756
URN:NBN:IT:UNIPI-385756