Reliability procedures for categorical data in performance analysis.
James, Nic 
ORCID: https://orcid.org/0000-0002-4181-9501, Taylor, Joseph B. and Stanley, Simon
(2007)
Reliability procedures for categorical data in performance analysis.
International Journal of Performance Analysis in Sport, 7
(1)
.
pp. 1-11.
ISSN 1474-8185
[Article]
Abstract
A number of papers have discussed reliability assessment techniques but none have previously limited themselves to methods appropriate to the collection of categorical data on the nominal scale i.e. where events are recorded within defined categories, as in many instances for performance analysis. This paper makes a number of recommendations including the use of a gold standard coding to compare the typical analyst's codes against. Reliability measures should reflect the way in which the notation data is analysed so that assessments can be made regarding the extent to which each variable presented in the results was coded accurately. The Yule's Q statistic, based on the odds ratio, is recommended as the reliability statistic of choice for categorical data due to the intuitiveness of the measure, its ease of calculation and its apparent applicability to the decision making of performance analysts. Furthermore a value of 0.95 or above should be deemed an acceptable value to determine confidence in the analyst's ability to place an event into a category reliably.
| Item Type: | Article |
|---|---|
| Research Areas: | A. > School of Science and Technology > London Sport Institute A. > School of Science and Technology > London Sport Institute > Performance Analysis at the London Sport Institute |
| Item ID: | 7310 |
| Useful Links: | |
| Depositing User: | Devika Mohan |
| Date Deposited: | 17 Mar 2011 07:05 |
| Last Modified: | 13 Oct 2016 14:22 |
| URI: | https://eprints.mdx.ac.uk/id/eprint/7310 |
Actions (login required)
 |
View Item |
Statistics
Additional statistics are available via IRStats2.
CORE (COnnecting REpositories)
CORE (COnnecting REpositories)