Reliability procedures for categorical data in performance analysis.

James, Nic and Taylor, Joseph B. and Stanley, Simon (2007) Reliability procedures for categorical data in performance analysis. International Journal of Performance Analysis in Sport, 7 (1). pp. 1-11. ISSN 1474-8185

Full text is not in this repository.

Abstract

A number of papers have discussed reliability assessment techniques but none have previously limited themselves to methods appropriate to the collection of categorical data on the nominal scale i.e. where events are recorded within defined categories, as in many instances for performance analysis. This paper makes a number of recommendations including the use of a gold standard coding to compare the typical analyst's codes against. Reliability measures should reflect the way in which the notation data is analysed so that assessments can be made regarding the extent to which each variable presented in the results was coded accurately. The Yule's Q statistic, based on the odds ratio, is recommended as the reliability statistic of choice for categorical data due to the intuitiveness of the measure, its ease of calculation and its apparent applicability to the decision making of performance analysts. Furthermore a value of 0.95 or above should be deemed an acceptable value to determine confidence in the analyst's ability to place an event into a category reliably.

Item Type: Article
Research Areas: A. > School of Science and Technology > London Sport Institute
A. > School of Science and Technology > London Sport Institute > Performance Analysis at the London Sport Institute
Item ID: 7310
Useful Links:
Depositing User: Devika Mohan
Date Deposited: 17 Mar 2011 07:05
Last Modified: 13 Oct 2016 14:22
URI: http://eprints.mdx.ac.uk/id/eprint/7310

Actions (login required)

Edit Item Edit Item