AI-Based Training Simulator for Hand Surgery FrakturOpt: Photo of an Operation

PROJECT

#MOIN FrakturOpt

FUNDING CONTEXT

Federal Ministry of Research, Technology, and Space (BMFTR)

AREAS OF APPLICATION

Surgery / Surgical Planning / Artificial Intelligence / Industrial Mathematics

AI-Powered Training Simulator for Hand Surgery and Surgical Planning

Client Requirements

Wrist fractures are among the most common types of bone fractures. During surgical treatment, surgical staff face a particular challenge: Due to the minimally invasive approach, there is no direct view of the bone fragments. „Correctly aligning and setting the fragments, a process known as reduction, requires a high degree of spatial visualization and surgical experience. Errors during reduction can lead to malalignment, loss of function, or complications such as nerve irritation.

At the same time, there is currently a lack of practical digital tools that specifically support both surgical training and individualized surgical planning. In the BMFTR-funded project T!Raum – MOIN – FrakturOpt: Training, Simulation & Optimization in Hand Surgery (grant number 03TR07W21A), SZENARIS, in collaboration with the Fraunhofer Institute for Digital Medicine MEVIS, is addressing precisely this gap: with an AI-powered training simulator and a demonstrator for the preoperative planning of distal radius fractures based on individual patient data.

OUR SOLUTION

AI-Supported Segmentation Based on Clinical CT Data
In this research project, Fraunhofer MEVIS is developing deep learning models that automatically segment bones and bone fragments from CT data of real clinical cases. This creates a realistic digital foundation for the training simulator and surgical planning based on individual patient data.

Solving the Fracture Puzzle Algorithmically
In addition, Fraunhofer MEVIS incorporates mathematical optimization methods that can automatically align bone fragments with one another, thereby algorithmically solving the fracture puzzle. These algorithms support surgical staff both during training and in the preparation for real surgeries.

Training Simulator and Surgical Planning Demonstrator
SZENARIS integrates the AI and mathematical components into two coordinated systems. The training and surgical planning system for the reduction of bone fragments enables surgical staff to practice the anatomically correct realignment of fragments without risk to the patient and to plan preoperatively. In addition, a training system with haptic feedback for drilling into bone is being developed. It provides a realistic experience of performing minimally invasive procedures manually. In doing so, SZENARIS builds on the experience gained from the predecessor project, HaptiVisT.

Logos of the Research Initiative, Funding Background, and Project Partners for FrakturOpt

RESULTS & BENEFITS

A realistic training simulator for surgical practice without risk to the patient

Support for preoperative planning through individualized, patient-specific data

AI-assisted segmentation of CT data for realistic training scenarios

Mathematical optimization for the automated alignment of bone fragments

Transferability of the approaches to other fracture types and surgical applications

Interested in a similar solution?

SZENARIS develops training simulations and digital planning tools
for medicine, surgery, and health technologies.

GET IN TOUCH