PROJECT
#MOIN FrakturOpt
FUNDING CONTEXT
Federal Ministry of Research, Technology, and Space (BMFTR)
AREAS OF APPLICATION
Surgery / Surgical Planning / Artificial Intelligence / Industrial Mathematics
AI-Powered Training Simulator for Hand Surgery and Surgical Planning
Client Requirements
Wrist fractures are among the most common types of bone fractures. During surgical treatment, surgical staff face a particular challenge: Due to the minimally invasive approach, there is no direct view of the bone fragments. „Correctly aligning and setting the fragments, a process known as reduction, requires a high degree of spatial visualization and surgical experience. Errors during reduction can lead to malalignment, loss of function, or complications such as nerve irritation.
At the same time, there is currently a lack of practical digital tools that specifically support both surgical training and individualized surgical planning. In the BMFTR-funded project T!Raum – MOIN – FrakturOpt: Training, Simulation & Optimization in Hand Surgery (grant number 03TR07W21A), SZENARIS, in collaboration with the Fraunhofer Institute for Digital Medicine MEVIS, is addressing precisely this gap: with an AI-powered training simulator and a demonstrator for the preoperative planning of distal radius fractures based on individual patient data.
OUR SOLUTION
AI-Supported Segmentation Based on Clinical CT Data
In this research project, Fraunhofer MEVIS is developing deep learning models that automatically segment bones and bone fragments from CT data of real clinical cases. This creates a realistic digital foundation for the training simulator and surgical planning based on individual patient data.
Solving the Fracture Puzzle Algorithmically
In addition, Fraunhofer MEVIS incorporates mathematical optimization methods that can automatically align bone fragments with one another, thereby algorithmically solving the fracture puzzle. These algorithms support surgical staff both during training and in the preparation for real surgeries.
Training Simulator and Surgical Planning Demonstrator
SZENARIS integrates the AI and mathematical components into two coordinated systems. The training and surgical planning system for the reduction of bone fragments enables surgical staff to practice the anatomically correct realignment of fragments without risk to the patient and to plan preoperatively. In addition, a training system with haptic feedback for drilling into bone is being developed. It provides a realistic experience of performing minimally invasive procedures manually. In doing so, SZENARIS builds on the experience gained from the predecessor project, HaptiVisT.
RESULTS & BENEFITS
A realistic training simulator for surgical practice without risk to the patient
Support for preoperative planning through individualized, patient-specific data
AI-assisted segmentation of CT data for realistic training scenarios
Mathematical optimization for the automated alignment of bone fragments
Transferability of the approaches to other fracture types and surgical applications
Interested in a similar solution?
SZENARIS develops training simulations and digital planning tools
for medicine, surgery, and health technologies.