Validity and Reliability of the Clinical Competency Evaluation Instrument for Use among Physiotherapy Students : Pilot study

Zailani Muhamad, Ayiesah Ramli, Salleh Amat

Abstract


Objectives: The aim of this study was to determine the content validity, internal consistency, testretest reliability and inter-rater reliability of the Clinical Competency Evaluation Instrument (CCEVI) in assessing the clinical performance of physiotherapy students. Methods: This study was carried out between June and September 2013 at University Kebangsaan Malaysia (UKM), Kuala Lumpur, Malaysia. A panel of 10 experts were identified to establish content validity by evaluating and rating each of the items used in the CCEVI with regards to their relevance in measuring students’ clinical competency. A total of 50 UKM undergraduate physiotherapy students were assessed throughout their clinical placement to determine the construct validity of these items. The instrument’s reliability was determined through a cross-sectional study involving a clinical performance assessment of 14 final-year undergraduate physiotherapy students. Results: The content validity index of the entire CCEVI was 0.91, while the proportion of agreement on the content validity indices ranged from 0.83–1.00. The CCEVI construct validity was established with factor loading of ≥0.6, while internal consistency (Cronbach’s alpha) overall was 0.97. Test-retest reliability of the CCEVI was confirmed with a Pearson’s correlation range of 0.91–0.97 and an intraclass coefficient correlation range of 0.95–0.98. Inter-rater reliability of the CCEVI domains ranged from 0.59 to 0.97 on initial and subsequent assessments. Conclusion: This pilot study confirmed the content validity of the CCEVI. It showed high internal consistency, thereby providing evidence that the CCEVI has moderate to excellent inter-rater reliability. However, additional refinement in the wording of the CCEVI items, particularly in the domains of safety and documentation, is recommended to further improve the validity and reliability of the instrument.



Keywords


Clinical Competence; Physiotherapy Speciality; Validity and Reliability; Malaysia.

Full Text:

PDF

Refbacks

  • There are currently no refbacks.




Creative Commons License
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.

Sultan Qaboos University Medical Journal, College of Medicine and Health Sciences, Sultan Qaboos University, PO Box 35, Postal Code 123, Al-Khod, Muscat, Oman

ISSN (Print edition): 2075-051X ISSN (Internet edition): 2075-0528

Copyright SQUMJ 2019. This journal and its content is licensed under a Creative Commons Attribution No Derivatives 4.0 International license.

Flag Counter