Reliability procedures for categorical data in performance analysis.

James, Nicolas and Taylor, Joseph B. and Stanley, Simon (2007) Reliability procedures for categorical data in performance analysis. International Journal of Performance Analysis in Sport, 7 (1). pp. 1-11. ISSN 1474-8185

Full text is not in this repository.

Abstract

A number of papers have discussed reliability assessment techniques but none have previously limited themselves to methods appropriate to the collection of categorical data on the nominal scale i.e. where events are recorded within defined categories, as in many instances for performance analysis. This paper makes a number of recommendations including the use of a gold standard coding to compare the typical analyst's codes against. Reliability measures should reflect the way in which the notation data is analysed so that assessments can be made regarding the extent to which each variable presented in the results was coded accurately. The Yule's Q statistic, based on the odds ratio, is recommended as the reliability statistic of choice for categorical data due to the intuitiveness of the measure, its ease of calculation and its apparent applicability to the decision making of performance analysts. Furthermore a value of 0.95 or above should be deemed an acceptable value to determine confidence in the analyst's ability to place an event into a category reliably.

Item Type:Article
Research Areas:School of Science and Technology > London Sport Institute
ID Code:7310
Useful Links:
Deposited On:17 Mar 2011 07:05
Last Modified:06 Feb 2013 12:34

Repository staff only: item control page

Full text downloads (NB count will be zero if no full text documents are attached to the record)

Downloads per month over the past year