Latent Profiles of Evaluators’ Self-Reported Practices

Abstract

Presented are the results of a study using latent profile analysis to describe the self-reported practices of 138 evaluators. Four classes emerged and were labeled (a) indistinct pattern of practice, (b) method-focused, (c) user-focused, and (d) robust pattern of practice. Evaluators in the “indistinct pattern of practice” class had mean item responses closest to zero relative to the other three classes, suggesting relatively weak associations with the practices described by the study instrument. The “method-focused” class had strong and distinct preferences for using particular methods. The “user-focused” class placed high importance on the role of the evaluator as facilitator, and was concerned with attaining a high level of stakeholder/participant involvement. The “robust pattern of practice” class evaluators showed a high degree of rigor in their reported patterns of practice, specifically as they are prescribed by evaluation theorists. The four profiles were distinguished by years of evaluation experience, degree attainment, and internal/external evaluator status.