Degree Name
Nursing Practice, DNP
Publication Date
4-20-2026
First Advisor
Lisa Drake
Second Advisor
Paige Wimberley
Abstract
Student evaluation is an important factor in guiding students to develop self-confidence and gain competency in nursing skills. For evaluation to be effective, it must be consistent. The purpose of this quality improvement project is to implement a training program to improve consistency and interrater reliability among faculty conducting skill evaluations. The impact of the training program will be measured by a pre- and post-grading exercise using a skills rubric. Data will be extracted from the rubrics and entered into a codebook for data analysis. The project was guided by the theoretical framework of Stephens’ Star Model of Knowledge Transformation and Lewin’s Change Theory. A quasi-experimental pre-post-test design was used to examine interrater reliability from the grading exercises. A Shapiro-Wilk test was conducted, indicating normal distributions. The Intraclass correlation coefficient (ICC) statistical method was used to determine the interrater reliability for both exercises. The ICC reliability score for the first exercise was .54 and .71 on the second exercise indicating improvement, however both are within the moderate reliability range. The independent, two-tailed t-test revealed no significant difference, t(18) = -1.85, p = .081, likely due to the small sample size (N = 20). The project was consistent with literature, indicating educational training can impact interrater reliability and consistency of evaluation. The results demonstrate educational training is a valuable tool for improving evaluation, leading to a recommendation of annual professional development to include rater training to improve consistency in evaluation and develop confident, practice-ready students.
Rights Management
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Recommended Citation
Scrivner, Hollan, "Strengthening Evaluation for Student Success" (2026). Doctor of Nursing Practice Projects. 324.
https://arch.astate.edu/dnp-projects/324
