Report

Interrater reliability of the new sport-specific evidence-based classification system for Para Va'a.

Para Va'a athletes would be expected to be allocated to the same class regardless of which classifier team conducts the classification in the new evidence-based classification system for Para Va'a.

Lead academic:
Johanna Ros茅n, Vicky Tolfrey
Additional academics:
Keith Tolfrey, Anton Arndt, Anna Bjerkefors
Funder:
Peter Harrison Centre

Introduction:

Para Va'a is a canoeing sport performed in a Polynesian outrigger canoe, propelled by a single-blade paddle on flat or open water, by athletes with physical impairments.

The Para Va'a classification involves a medical and a technical assessment performed by a classifier team including a medical and a technical classifier. It is important that the classification systems are reliable and currently, two sports have examined the interrater reliability (IRR) of tests used in their classification: wheelchair rugby and Nordic sit-skiing.

Although the new Para Va'a classification tests have been developed using the recommendations by Tweedy et al. (2010), the tests and the system are new, and their reliability must be examined.

Study aim: To examine the interrater reliability of a new evidence-based classification system for Para Va'a.

Methods:

Twelve Para Va'a athletes were classified by three classifier teams each consisting of a medical and a technical classifier.

Interrater reliability was assessed by calculating intraclass correlation for the overall class allocation and total scores of trunk, leg, and on-water test batteries and by calculating Fleiss's kappa and percentage of total agreement in the individual tests of each test battery.

Main findings:

  • All classifier teams agreed with the overall class allocation of all athletes, and all three test batteries exhibited excellent interrater reliability.
  • At a test level, agreement between classifiers was almost perfect in 14 tests, substantial in four tests, moderate in four tests, and fair in one test.
  • The results suggest that a Para Va'a athlete can expect to be allocated to the same class regardless of which classifier team conducts the classification.

Reference:

Rosén JS, Goosey-Tolfrey VL, Tolfrey K, Arndt A, Bjerkefors A. Interrater Reliability of the New Sport-Specific Evidence-Based Classification System for Para Va'a. Adapt Phys Activ Q. 2020 Jul 1;37(3):241-252. DOI: 10.1123/apaq.2019-0141. Epub 2020 Mar 6. PMID: 32143189.

 

Image credit: © Paralympics GB