Loading...
A Comparison of Two Methods for Measuring Procedural Fidelity: A Checklist and Rating Scale Implemented by Teachers
Cole, Anna Ferguson
Cole, Anna Ferguson
Citations
Altmetric:
Abstract
Many previous studies have assessed, discussed, and advocated for the measurement and reporting of procedural fidelity in both practice and research. Few studies have compared the reliability and preference of the use of different methods of measuring procedural fidelity. The current study aimed to compare the reliability of, and implementor preference for, two procedural fidelity measurement methods when used by teachers. Teachers serving as implementor participants were given a brief instruction-only training on procedural fidelity and how to use the two given measurement tools. A checklist and a rating scale that included similar components were used to score brief one-to-one intervention session videos sourced from YouTube. Implementor preference was assessed at the end of the study. Six videos were viewed and scored twice, once using each measurement method, by all four participants. Video 7 was only viewed and scored once using the method that each participant preferred to use. The percentage of correspondence was measured by comparing experimenter master score values with participant values using a point-to-point correspondence agreement method. The results indicated that the checklist was the slightly more reliable method for measuring procedural fidelity. Implementor preference for measurement method was mixed; half of the participants preferred the checklist, and the other half preferred the rating scale.
Description
Date
2024-08-31
Journal Title
Journal ISSN
Volume Title
Publisher
University of Kansas
Collections
Archive Status
This item contains archived web content.
Files
Loading...
Cole_ku_0099M_19600.pdf
Adobe PDF, 1.59 MB
Research Projects
Organizational Units
Journal Issue
Keywords
Behavioral sciences, checklist, percentage of correspondence, preference, procedural fidelity, rating scale, reliability