The Effects of a Simulated Self-Evaluative Routine on Teachers' Grades, Intraclass Correlations, and Feedback Characteristics
Issue Date
2011-12-31Author
Golden, Charles Hurst
Publisher
University of Kansas
Format
205 pages
Type
Dissertation
Degree Level
Ph.D.
Discipline
Curriculum and Teaching
Rights
This item is protected by copyright and unless otherwise specified the copyright of this thesis/dissertation is held by the author.
Metadata
Show full item recordAbstract
English language arts teachers committed to the teaching of writing must allocate substantial time and energy to the evaluation of student essays. And in doing so, these teachers wrestle with at least two star-crossed expectations. First, they must fulfill the institutional obligation of making reliable holistic judgments of the papers they receive, stratifying papers according to their successes against a set of stipulated criteria. Second--and more importantly for the sake of teaching and learning--they must also be the providers of insightful, inviting feedback that promotes rather than hinders students` progress toward robust literacies. The qualities of such feedback, having been studied by Kluger and DeNisi (1996), Hattie and Timperley (2007), and others, have recently been made available to classroom practitioners in Brookhart`s How to Give Effective Feedback to Your Students (2008). The current study leverages Brookhart`s transmission of previous research to investigate how teachers might improve their feedback characteristics by way of a self-evaluation routine administered to students prior to the submission of so-called final-draft essays. Specifically, the study tested teachers` scoring and feedback practices, with respect to their work on stronger and weaker essays across control and experimental conditions pertaining to the absence or presence of simulated self-evaluative comments by student authors. Scoring practices were considered by way of group means, distributions, and intraclass correlations of participating teachers` evaluative scores; similarly these teachers` feedback was coded according to criteria suggested by Brookhart, and then compared by way of a 2x2 ANOVA comparison of feedback variances across stronger and weaker papers under control and experimental conditions. The analyses of these data demonstrated a medium-sized positive effect for the desirable feedback trait of focus on self-regulation (partial ç2 = 0.079), as well as a small-sized positive effect for the desirable trait of comparisons to an imaginable previous or successive draft (partial ç2 = 0.032). These desirable improvements in feedback were accompanied while maintaining comparative stability in the grades imposed by teachers, limiting the concern that a "friendlier" approach derived from principles in interpersonal psychology (Heider, 1958) might somehow weaken the integrity of rigor in scoring.
Collections
- Dissertations [4701]
- Education Dissertations and Theses [1065]
Items in KU ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
We want to hear from you! Please share your stories about how Open Access to this item benefits YOU.