Tests examining skill outcomes in sport: A systematic review of measurement properties and feasibility

Robertson, Samuel J., Burnett, Angus F. and Cochrane, Jodie 2013, Tests examining skill outcomes in sport: A systematic review of measurement properties and feasibility, Sports medicine, vol. 44, no. 4, pp. 1-18.

Attached Files
Name Description MIMEType Size Downloads

Title Tests examining skill outcomes in sport: A systematic review of measurement properties and feasibility
Author(s) Robertson, Samuel J.
Burnett, Angus F.
Cochrane, Jodie
Journal name Sports medicine
Volume number 44
Issue number 4
Start page 1
End page 18
Total pages 18
Publisher ADIS Press
Place of publication Auckland, N.Z.
Publication date 2013-11
ISSN 0112-1642
1179-2035
Summary Background
A high level of participant skill is influential in determining the outcome of many sports. Thus, tests assessing skill outcomes in sport are commonly used by coaches and researchers to estimate an athlete’s ability level, to evaluate the effectiveness of interventions or for the purpose of talent identification.

Objective

The objective of this systematic review was to examine the methodological quality, measurement properties and feasibility characteristics of sporting skill outcome tests reported in the peer-reviewed literature.

Data Sources
A search of both SPORTDiscus and MEDLINE databases was undertaken.

Study Selection

Studies that examined tests of sporting skill outcomes were reviewed. Only studies that investigated measurement properties of the test (reliability or validity) were included. A total of 22 studies met the inclusion/exclusion criteria.

Study Appraisal and Synthesis Methods
A customised checklist of assessment criteria, based on previous research, was utilised for the purpose of this review.

Results

A range of sports were the subject of the 22 studies included in this review, with considerations relating to methodological quality being generally well addressed by authors. A range of methods and statistical procedures were used by researchers to determine the measurement properties of their skill outcome tests. The majority (95 %) of the reviewed studies investigated test–retest reliability, and where relevant, inter and intra-rater reliability was also determined. Content validity was examined in 68 % of the studies, with most tests investigating multiple skill domains relevant to the sport. Only 18 % of studies assessed all three reviewed forms of validity (content, construct and criterion), with just 14 % investigating the predictive validity of the test. Test responsiveness was reported in only 9 % of studies, whilst feasibility received varying levels of attention.

Limitations

In organised sport, further tests may exist which have not been investigated in this review. This could be due to such tests firstly not being published in the peer-review literature and secondly, not having their measurement properties (i.e., reliability or validity) examined formally.

Conclusions

Of the 22 studies included in this review, items relating to test methodological quality were, on the whole, well addressed. Test–retest reliability was determined in all but one of the reviewed studies, whilst most studies investigated at least two aspects of validity (i.e., content, construct or criterion-related validity). Few studies examined predictive validity or responsiveness. While feasibility was addressed in over half of the studies, practicality and test limitations were rarely addressed. Consideration of study quality, measurement properties and feasibility components assessed in this review can assist future researchers when developing or modifying tests of sporting skill outcomes.
Language eng
Field of Research 110604 Sports Medicine
Socio Economic Objective 970111 Expanding Knowledge in the Medical and Health Sciences
HERDC Research category C1 Refereed article in a scholarly journal
Copyright notice ©2013, ADIS Press
Persistent URL http://hdl.handle.net/10536/DRO/DU:30058952

Document type: Journal Article
Collection: School of Exercise and Nutrition Sciences
Connect to link resolver
 
Unless expressly stated otherwise, the copyright for items in DRO is owned by the author, with all rights reserved.

Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 0 times in TR Web of Science
Google Scholar Search Google Scholar
Access Statistics: 50 Abstract Views, 2 File Downloads  -  Detailed Statistics
Created: Thu, 12 Dec 2013, 13:21:25 EST by Jane Moschetti

Every reasonable effort has been made to ensure that permission has been obtained for items included in DRO. If you believe that your rights have been infringed by this repository, please contact drosupport@deakin.edu.au.