The quality of medical record review studies in the international emergency medicine literature

STUDY OBJECTIVE: We assess the methodologic quality of studies using medical record review methodology in 4 international emergency medicine journals. A secondary aim was to compare methodology quality among these journals and across years. METHODS: This was an observational study of articles whose main methodology was medical record review published in Academic Emergency Medicine (AEM) , Annals of Emergency Medicine (Annals) , Emergency Medicine Journal (EMJ) , and Emergency Medicine Australasia (EMA) between January 2002 and May 2004. Eligible articles were reviewed for reporting of a clear hypothesis or objective, training of abstractors, defined inclusion and exclusion criteria, use of a standard abstraction form, definition of important variables, monitoring of abstractor performance, blinding of abstractors to study hypothesis, reporting of interrater reliability, sample size or power calculation, reporting of ethics approval or waiver, and disclosure of funding source. The primary outcome was the proportion of articles meeting each criterion. Secondary outcomes were comparison of the proportions of articles meeting each criterion among journals and by years. RESULTS: One hundred seven articles were analyzed; 31 were published in AEM, 29 in Annals, 29 in EMJ, and 18 in EMA . A clear aim was reported in 93% of articles, standardized abstraction forms were reported in 51%, interrater reliability was reported in 25%, ethics approval or waiver was reported in 68%, and sample size or power calculation was reported in 10%. CONCLUSION: Adherence to the quality criteria for medical record reviews was suboptimal, and there were significant differences among journals in overall methodologic quality.