PROJECT
HaptiVisT
FUNDING CONTEXT
Federal Ministry of Education and Research (BMBF)
AREAS OF APPLICATION
Surgery / Surgical Planning / Serious Games / Medical Education and Training
Haptic-visual Training System for Surgery
Client Requirements
Performing complex surgical procedures requires the highest degree of precision, experience, and anatomical understanding. In particular, surgeries on sensitive structures such as the hand or in the area of cochlear implantation place high demands on surgical professionals.
Traditional training and continuing education methods are often based on theoretical instruction, clinical observations, or exercises using physical models. These approaches offer only limited opportunities to practice on individual patient cases in a realistic manner or to repeat challenging procedures as often as needed. At the same time, there is a desire to minimize risks to patients and to improve the quality of surgical procedures in the long term.
OUR SOLUTION
Haptic-Visual Training System for Realistic Surgical Simulations
Together with five partners from research, medicine, and industry, SZENARIS developed a haptic-visual training system for surgical continuing education and training as part of the HaptiVisT research project (in German). The BMBF-funded project combines medical image data and haptic feedback to create an immersive training environment for complex surgical procedures.
Patient-Specific Surgical Models Based on CT and MRI Data
The training system is based on real medical image data from CT and MRI scans. This data is automatically processed and converted into highly detailed 3D models. This allows surgeons to virtually explore individual patient anatomies and perform procedures in advance under realistic conditions.
Haptic Feedback for a Realistic Surgical Experience
By connecting a haptic arm, touch and resistance can be physically experienced during the simulation. Combined with stereoscopic visualization, this creates an immersive training environment that allows surgical procedures to be experienced not only visually but also tactilely.
Serious Game Approach for Sustainable Learning
The training system includes various difficulty levels and learning stages for different surgical procedures. Surgeons can gradually build their skills and use an evaluation system to compare their results with the reference solutions of experienced specialists. This makes learning progress measurable and allows for targeted improvement.
RESULTS & BENEFITS
Surgical training without risk to real patients
Realistic surgical simulation through a combination of 3D visualization and haptic feedback
Nutzung patientenspezifischer CT- und MRT-Daten für individuelle Trainingsszenarien
Use of patient-specific CT and MRI data for individualized training scenarios
A “serious game” approach to boost motivation and learning success
Support for medical training and continuing education in the field of complex surgical procedures
Interested in a similar solution?
SZENARIS develops innovative XR and simulation solutions for medicine,
surgical training, and continuing medical education.