File(s) under permanent embargo
Multiple mini-interview : how long is long enough?
journal contribution
posted on 2009-01-01, 00:00 authored by Michael Dodson, Brendan CrottyBrendan Crotty, David Prideaux, Ross CarneRoss Carne, Alister WardAlister Ward, E de LeeuwObjectives The multiple mini-interview (MMI) overcomes the limitations of the traditional panel interview by multiple sampling to provide improved objectivity and reliability. Reliability of the MMI is affected by number of stations; however, there are few data reporting the influence of interview duration on MMI outcome and reliability. We aimed to determine whether MMI stations can be shortened without affecting applicant rankings or compromising test reliability.
Methods A total of 175 applicants were interviewed and assessed at 10 8-minute stations. Applicants were scored once after 8 minutes at five control stations and twice after 5 minutes and 8 minutes at five experimental stations. Scores at 5 and 8 minutes were compared using t-tests and correlation coefficients. Rankings of applicants based on 5- and 8-minute scores were compared using Spearman's rank order coefficient. The reliability of the MMI was examined for 5- and 8-minute scores using generalisability theory.
Results Mean scores at 5 minutes were lower than mean scores at 8 minutes. Cumulative scores at 5 minutes were also lower. There were highly significant correlations between 5- and 8-minute scores at all experimental stations (0.82–0.91; P < 0.01) and between the cumulative scores at 5 and 8 minutes (0.92; P < 0.01). There was a strong correlation between applicant rankings based on cumulative 5- and 8-minute scores (Spearman's rank order coefficient 0.92). Reliability was not affected.
Conclusions Reducing the duration of MMI stations from 8 to 5 minutes conserves resources with minimal effect on applicant ranking and test reliability.
Methods A total of 175 applicants were interviewed and assessed at 10 8-minute stations. Applicants were scored once after 8 minutes at five control stations and twice after 5 minutes and 8 minutes at five experimental stations. Scores at 5 and 8 minutes were compared using t-tests and correlation coefficients. Rankings of applicants based on 5- and 8-minute scores were compared using Spearman's rank order coefficient. The reliability of the MMI was examined for 5- and 8-minute scores using generalisability theory.
Results Mean scores at 5 minutes were lower than mean scores at 8 minutes. Cumulative scores at 5 minutes were also lower. There were highly significant correlations between 5- and 8-minute scores at all experimental stations (0.82–0.91; P < 0.01) and between the cumulative scores at 5 and 8 minutes (0.92; P < 0.01). There was a strong correlation between applicant rankings based on cumulative 5- and 8-minute scores (Spearman's rank order coefficient 0.92). Reliability was not affected.
Conclusions Reducing the duration of MMI stations from 8 to 5 minutes conserves resources with minimal effect on applicant ranking and test reliability.
History
Journal
Medical educationVolume
43Issue
2Pagination
168 - 174Publisher
Blackwell Publishing LtdLocation
Oxford, EnglandPublisher DOI
ISSN
0308-0110eISSN
1365-2923Language
engPublication classification
C1 Refereed article in a scholarly journalCopyright notice
2009, Blackwell Publishing Ltd.Usage metrics
Read the peer-reviewed publication
Categories
Keywords
interviewpsychologicalclinical competence\/*standardseducational measurement\/methods*educationmedicalundergraduateVictoriaSocial SciencesScience & TechnologyLife Sciences & BiomedicineEducation, Scientific DisciplinesHealth Care Sciences & ServicesEducation & Educational Research*interviewclinical competence*standardseducational measurementmethodsgraduateOSCE