Introduction
DOCTOR TRAINING
Is a new concept in medical education. The Project consists of a multidisciplinary team of research and development, based in Montevideo, Uruguay, where we have developed training applications (“serious games”) to learn video-assisted surgery. DOCTOR TRAINING uses recognition technology and image tracking with a camera integrated in any smart device (mobiles, tablets) running on iOS and Android platforms.
The solution consists
of the following components
Two kinds of user friendly applications
There are two kinds of user friendly and simple applications, for massive use. They consist on a web application run from a mobile device and a data base where all related data are kept.
Mobile Application
Smart devices
(IOs and Android platforms)
Database
All the data registered or displayed in the smart device application
Web application
Performance of TRAINING users in order to procure further data analysis
These applications
have two modes: TRAINING and SIMULATION
Training
(serious games)
It is users’ first contact with the application aiming at the acquisition and development of the non-intuitive motor skills which allow medical doctors to be better prepared for video-assisted procedures, such as microsurgery. There are abstract exercises where users face the challenge of "resolving a 3D situation, guided by a bidimentional image". At the same time, their performance is assessed by means of pre-defined variables. This assessment is stored so that users can keep track of their progress and promote additional practice with gaming strategies.
The following list shows some Training goals:
• Fine motor skills
• 3D Orientation
• Hand-eye coordination (triangulation)
• Reaction and perception speed
Simulation
It is an application that SIMULATIONs real life scenarios (video-assisted operations) which are used as a complement to tutorials, pre-courses, or training processes with advanced simulators.
The objective is to review, remember and repeat the key steps of an operation, by playing exercises which reproduce the movement, the correct identification of anatomic structures, and the correct use of the surgical instruments, which are appropriate for the operation being performed, among others.
Doctor Training Applications
This chapter describes the main features of TRAINING and SIMULATION in terms of concepts and definitions.
Training
Simulation
Exercices :
They are interactive exercises based on abstract models where the user performs an assigned activity. During exercises, specific skills are measured (estimators) and their values are displayed at the end of the exercise.
Components :
• Mobile App: The application runs on smart devices (IOs and Android platforms) with user profile, scenarios and history/background.
• Backend application and data Model: backend application running in the cloud, which contains all the data registered or displayed in the smart device application. When there is Internet available, both systems are communicating in order to exchange data.
• Research Web Access: A web access could be provided to specific users (Researchers) that allow seeing the performance of TRAINING users in order to procure further data analysis.
Estimators :
Estimators are the specific skills to be measured performing each exercise, as follows:
ESTIMATOR
CONCEPT
MEASUREMENT
Simulation :
This chapter describes the main features of the SIMULATION in terms of concepts and definitions:
Scenarios :
They are interactive environments, where users perform specific movements in order to re-create a defined protocol or procedure. These scenarios provide a realistic environment (blood, bones, texture, etc).
Targets :
They are specific actions that users do to complete a process. For instance:
• recognition of specific structure touch, move an instrument from one point to another, transport objects, cut, among others.
3 Steps to start using the App
The use of DOCTOR TRAINING requires an Augmented Reality (AR) Target
and a tablet or smartphone with the application installed.
Here are the 3 steps to start using the App.
1
Download AR Target
2
Build the trackeable instrument
3
Download the App and start training
1
Download the AR Target
Our technology requires recognizing a specific image in order to detect and simulate the instrument that will be used in different scenarios.
This image is in the following file. You need to download, print and then crop the image.
2
Build the trackeable instrument
To complete the construction of the marker, it is necessary to have the printed and cropped image (step 1) and a wooden stick (for example a tongue depressor).
The image should be pasted on the wooden stick as shown in the pictures.
3
Download the App and start training
From your mobile device access the store, locate the "Doctor Training" application and downloading it.
For the first time, user data and password will be requested.
You can access your profile to see the progress of the practices.