beliakov-automatedattentionflags-2001.pdf (582.05 kB)
Automated attention flags in chronic disease care planning
journal contribution
posted on 2001-09-17, 00:00 authored by J Warren, J Noone, B Smith, R Ruffin, P Frith, B van der Zwaag, Gleb BeliakovGleb Beliakov, H Frankel, H McElroyObjectives: To assess the value of computerised decision support in the management of chronic respiratory disease by comparing agreement between three respiratory specialists, general practitioners (care coordinators), and decision support software.
Methods: Care guidelines for two chronic obstructive pulmonary disease projects of the SA HealthPlus Coordinated Care Trial were formulated. Decision support software, Care Plan On-Line (CPOL), was created to represent the intent of these guidelines via automated attention flags to appear in patients' electronic medical records. For a random sample of 20 patients with care plans, decisions about the use of nine additional services (eg,.smoking cessation, pneumococcal vaccination) were compared between the respiratory specialists, the patients' GPs and the CPOL attention flags.
Results: Agreement among the specialists was at the lower end of moderate (intraclass correlation coefficient [ICC], 0.48; 95% CI, 0.39-0.56), with a 20% rate of contradictory decisions. Agreement with recommendations of specialists was moderate to poor for GPs (le, 0.49; 95% CI, 0.33-0.66) and moderate to good for CPOL (K, 0.72; 95% CI, 0.55-0.90). CPOL agreement with GPs was moderate to poor (le, 0.41; 95% CI, 0.24-0.58). GPs were less likely than specialists or CPOL to decide in favour of an additional service (P< 0.001). CPOL was 87% accurate as an indicator of specialist decisions. It gave a 16% false-positive rate according to specialist decisions, and flagged 61% of decisions where GPs said No and specialists said Yes.
Conclusions: Automated decision support may provide GPs with improved access to the intent of guidelines; however, further investigation is required.
Methods: Care guidelines for two chronic obstructive pulmonary disease projects of the SA HealthPlus Coordinated Care Trial were formulated. Decision support software, Care Plan On-Line (CPOL), was created to represent the intent of these guidelines via automated attention flags to appear in patients' electronic medical records. For a random sample of 20 patients with care plans, decisions about the use of nine additional services (eg,.smoking cessation, pneumococcal vaccination) were compared between the respiratory specialists, the patients' GPs and the CPOL attention flags.
Results: Agreement among the specialists was at the lower end of moderate (intraclass correlation coefficient [ICC], 0.48; 95% CI, 0.39-0.56), with a 20% rate of contradictory decisions. Agreement with recommendations of specialists was moderate to poor for GPs (le, 0.49; 95% CI, 0.33-0.66) and moderate to good for CPOL (K, 0.72; 95% CI, 0.55-0.90). CPOL agreement with GPs was moderate to poor (le, 0.41; 95% CI, 0.24-0.58). GPs were less likely than specialists or CPOL to decide in favour of an additional service (P< 0.001). CPOL was 87% accurate as an indicator of specialist decisions. It gave a 16% false-positive rate according to specialist decisions, and flagged 61% of decisions where GPs said No and specialists said Yes.
Conclusions: Automated decision support may provide GPs with improved access to the intent of guidelines; however, further investigation is required.
History
Journal
Medical journal of AustraliaVolume
175Issue
6Pagination
308 - 312Publisher
Australasian Medical Pub. CoLocation
Sydney, N.S.W.ISSN
0025-729XeISSN
1326-5377Language
engNotes
Reproduced with the specific permission of the copyright owner.Publication classification
C1 Refereed article in a scholarly journalCopyright notice
2001, Australasian Medical Pub. CoUsage metrics
Categories
No categories selectedKeywords
Licence
Exports
RefWorks
BibTeX
Ref. manager
Endnote
DataCite
NLM
DC