Deakin University
Browse

The diagnostic validity and reliability of an internet-based clinical assessment program for mental disorders

Download (586.93 kB)
Version 3 2024-06-17, 15:56
Version 2 2024-06-06, 02:44
Version 1 2016-02-19, 14:38
journal contribution
posted on 2024-06-17, 15:56 authored by DP Nguyen, B Klein, D Meyer, David AustinDavid Austin, JA Abbott
BACKGROUND: Internet-based assessment has the potential to assist with the diagnosis of mental health disorders and overcome the barriers associated with traditional services (eg, cost, stigma, distance). Further to existing online screening programs available, there is an opportunity to deliver more comprehensive and accurate diagnostic tools to supplement the assessment and treatment of mental health disorders. OBJECTIVE: The aim was to evaluate the diagnostic criterion validity and test-retest reliability of the electronic Psychological Assessment System (e-PASS), an online, self-report, multidisorder, clinical assessment and referral system. METHODS: Participants were 616 adults residing in Australia, recruited online, and representing prospective e-PASS users. Following e-PASS completion, 158 participants underwent a telephone-administered structured clinical interview and 39 participants repeated the e-PASS within 25 days of initial completion. RESULTS: With structured clinical interview results serving as the gold standard, diagnostic agreement with the e-PASS varied considerably from fair (eg, generalized anxiety disorder: κ=.37) to strong (eg, panic disorder: κ=.62). Although the e-PASS' sensitivity also varied (0.43-0.86) the specificity was generally high (0.68-1.00). The e-PASS sensitivity generally improved when reducing the e-PASS threshold to a subclinical result. Test-retest reliability ranged from moderate (eg, specific phobia: κ=.54) to substantial (eg, bulimia nervosa: κ=.87). CONCLUSIONS: The e-PASS produces reliable diagnostic results and performs generally well in excluding mental disorders, although at the expense of sensitivity. For screening purposes, the e-PASS subclinical result generally appears better than a clinical result as a diagnostic indicator. Further development and evaluation is needed to support the use of online diagnostic assessment programs for mental disorders. TRIAL REGISTRATION: Australian and New Zealand Clinical Trials Registry ACTRN121611000704998; http://www.anzctr.org.au/trial_view.aspx?ID=336143 (Archived by WebCite at http://www.webcitation.org/618r3wvOG).

History

Journal

Journal of medical internet research

Volume

17

Article number

e218

Pagination

1-14

Location

Toronto, Ont.

Open access

  • Yes

eISSN

1438-8871

Language

eng

Publication classification

C Journal article, C1 Refereed article in a scholarly journal

Copyright notice

2015, The Authors

Issue

9 (2015)

Publisher

JMIR Publications