Recoding low-level simulator data into a record of meaningful task performance: the integrated task modeling environment (ITME)

The Integrated Task Modeling Environment (ITME) is a user-friendly software tool that has been developed to automatically recode low-level data into an empirical record of meaningful task performance. The present research investigated and validated the performance of the ITME software package by conducting complex simulation missions and comparing the task analyses produced by ITME with task analyses produced by experienced video analysts. A very high interrater reliability (≥0.94) existed between experienced video analysts and the ITME for the task analyses produced for each mission. The mean session timeianalysis time ratio was 1:24 using video analysis techniques and 1:5 using the ITME. It was concluded that the ITME produced task analyses that were as reliable as those produced by experienced video analysts, and significantly reduced the time cost associated with these analyses.