Haptic-Visual Training System HaptiVisT: Photo of Surgical Staff Diagnosing a Hand Fracture

PROJECT

HaptiVisT

FUNDING CONTEXT

Federal Ministry of Education and Research (BMBF)

AREAS OF APPLICATION

Surgery / Surgical Planning / Serious Games / Medical Education and Training

Haptic-visual Training System for Surgery

Client Requirements

Performing complex surgical procedures requires the highest degree of precision, experience, and anatomical understanding. In particular, surgeries on sensitive structures such as the hand or in the area of cochlear implantation place high demands on surgical professionals.

Traditional training and continuing education methods are often based on theoretical instruction, clinical observations, or exercises using physical models. These approaches offer only limited opportunities to practice on individual patient cases in a realistic manner or to repeat challenging procedures as often as needed. At the same time, there is a desire to minimize risks to patients and to improve the quality of surgical procedures in the long term.

OUR SOLUTION

Haptic-Visual Training System for Realistic Surgical Simulations
Together with five partners from research, medicine, and industry, SZENARIS developed a haptic-visual training system for surgical continuing education and training as part of the HaptiVisT research project (in German). The BMBF-funded project combines medical image data and haptic feedback to create an immersive training environment for complex surgical procedures.

Patient-Specific Surgical Models Based on CT and MRI Data
The training system is based on real medical image data from CT and MRI scans. This data is automatically processed and converted into highly detailed 3D models. This allows surgeons to virtually explore individual patient anatomies and perform procedures in advance under realistic conditions.

Haptic Feedback for a Realistic Surgical Experience
By connecting a haptic arm, touch and resistance can be physically experienced during the simulation. Combined with stereoscopic visualization, this creates an immersive training environment that allows surgical procedures to be experienced not only visually but also tactilely.

Serious Game Approach for Sustainable Learning
The training system includes various difficulty levels and learning stages for different surgical procedures. Surgeons can gradually build their skills and use an evaluation system to compare their results with the reference solutions of experienced specialists. This makes learning progress measurable and allows for targeted improvement.

Haptic-Visual Training System HaptiVisT: Full Setup with Haptic Arm and Stereoscopic Display

RESULTS & BENEFITS

Surgical training without risk to real patients

Realistic surgical simulation through a combination of 3D visualization and haptic feedback

Nutzung patientenspezifischer CT- und MRT-Daten für individuelle Trainingsszenarien

Use of patient-specific CT and MRI data for individualized training scenarios

A “serious game” approach to boost motivation and learning success

Support for medical training and continuing education in the field of complex surgical procedures

Interested in a similar solution?

SZENARIS develops innovative XR and simulation solutions for medicine,
surgical training, and continuing medical education.

GET IN TOUCH