Evaluation of a mobile learning platform for clinical supervision

Context: This report details a formative evaluation of the Clinical Supervision Online (CSO) course, a fee-paying, fully online ‘light touch’ program of study for clinical supervisors offered by the Melbourne Medical School, which was developed in conjunction with the University’s Mobile Learning Unit. The course requires between six to ten hours of self-directed study and is designed for any clinicians who teach. Methods: Evaluation of the course was guided by Rossi, Lipsey and Freeman’s (2004) approach to program evaluation, addressing the need for the course, its design, implementation, impact, and return on investment. Data were collected through interviews with key informants, document analysis, an embedded student survey, learning analytics data, financial data, and an audit against ‘best practice’ standards for online course design. Findings: The findings suggest that course development was driven by both a financial imperative and genuine concern to meet training needs of clinical supervisors. Two hundred and four students enrolled on the course in its first 18 months. This has been enough to cover its developmental costs. In relation to 64 quality standards for online course design, the level of performance was rated as ‘meets’ for 44 items; ‘exceeds’ for one item; ‘developing for 13 items’; and, ‘non-existent’ for six items. An additional 33 items were identified as ‘not applicable’ for the ‘light touch’ course design. Significance: From a learning design perspective there is much to like about the CSO course and the outcome of assessing it against the standards for ‘best practice’ online course design suggests that an evolutionary approach - making incremental changes - could improve the course whilst retaining its existing ‘light touch’ format. The CSO course on its own is unlikely to realise the depth of achievement implied in the course aims and learning outcomes. The CSO course may best be seen as an entrée into the art of clinical supervision.