wei-highimmersive-2018.pdf (2.31 MB)
A high-immersive medical training platform using direct intraoperative data
journal contribution
posted on 2018-10-31, 00:00 authored by Y Tai, Lei WeiLei Wei, M Xiao, Hailing Zhou, Q Li, J Shi, Saeid NahavandiThe virtual training of primitive surgical procedures has been widely recognized as immersive and effective to medical education. Virtual basic surgical training framework integrated with multi-sensations rendering has been recognized as one of the most immersive implementations in medical education. Yet, compared with the original intraoperative data, there has always been an argument on the lower fidelity these data are represented in virtual surgical training. In this paper, a solution is proposed to achieve better training immersion by incorporating multiple higher-fidelity factors toward a trainee's sensations (vision, touch, and hearing) during virtual training sessions. This was based on the proposal of a three-tier model to classify reasons leading to fidelity issues. This include: haptic factors, such as high-quality fitting of force models based on surgical data acquisition, the use of actual surgical instrument linked to desktop haptic devices; visual factors, such as patient-specific CT images segmentation and reconstruction from the original medical data; and hearing factors, such as variations of the sound of monitoring systems in the theatre under different surgical conditions. Twenty seven urologists comprising 18 novices and 9 professors were invited to test a virtual training system based on the proposed solution. Post-test values from both professors' and novices' groups demonstrated obvious improvements in comparison with pre-test values under both the subjective and objective criteria, the fitting rate of the whole puncture processing is 99.93%. Both the subjective and objective results demonstrated a higher performance than the existing benchmark training platform. Combining these in a systematic approach, tuned with specific fidelity requirements, haptically enabled training simulation systems would be able to provide a more immersive and effective training environment.
History
Journal
IEEE accessVolume
6Pagination
69438 - 69452Publisher
Institute of Electrical and Electronics EngineersLocation
Piscataway, N.J.Publisher DOI
Link to full text
eISSN
2169-3536Language
engPublication classification
C1 Refereed article in a scholarly journalCopyright notice
2018, IEEEUsage metrics
Categories
Keywords
Surgical trainingPercutaneousIntraoperativeHapticClinical trialsScience & TechnologyTechnologyComputer Science, Information SystemsEngineering, Electrical & ElectronicTelecommunicationsComputer ScienceEngineeringREALITYSIMULATIONSYSTEMArtificial Intelligence and Image ProcessingComputation Theory and Mathematics
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC