AMERICAN EVALUATION ASSOCIATION
Main Website – eval.org
AEA Guiding Principles for Evaluators
TYPES OF EVALUATIONS
- Needs Assessment
- Assessment of Program Theory
- Assessment of Program Process (process evaluation)
- Impact Assessment (outcome evaluation)
- Efficiency Assessment
TYPES OF QUESTIONS WELL-SUITED TO PROGRAM EVALUATION
- What is the nature and scope of the problem? Where is it located, whom does it affect, and how does it affect them?
- What is it about the problem or its effects that justifies new, expanded, or modified social problems?
- What feasible interventions are likely to significantly ameliorate the problem?
- What are the appropriate target populations for interventions?
- Is a particular intervention reaching its target population?
- Is the intervention being implemented well? Are the intended services being provided?
- Is the intervention effective in attaining the desired goals or benefits?
- How much does the program cost?
- Is the program cost reasonable in relation to effectiveness and benefits?
EVALUATION THEORETICAL FRAMEWORKS
From betterevaluation.org
Utilization-Focused Evaluation
- Patton: “Confusing empathy with bias” – musing on neutrality in research
GRAPHICS

CHALLENGES IN PROGRAM EVALUATION AND APPLICABLE SPORT PSYCHOLOGY SKILLS


REFERENCES
- Alkin, M. C., & Christie, C. A. (2004). An evaluation theory tree. In M. C. Alkin (ed.), Evaluation roots: Tracing theorists’ views and influences. Thousand Oaks, CA: Sage.
- American Evaluation Association. (2004). American Evaluation Association Guiding Principles For Evaluators. Retrieved November 2013, http://www.eval.org/p/cm/ld/fid=51.
- American Evlauation Association. (2013). The Program Evaluation Standards. Joint Committee for Standards in Educational Evaluation. Retrieved October 2013, http://www.eval.org/p/cm/ld/fid=103.
- Cousins, J. B., Donohue, J. J., & Bloom, G. A. (1996). Collaborative evaluation in North America: Evaluators’ self-reported opinions, practices, and consequences. Evaluation Practice, 17(3), 207-225.
- Cousins, J. B., & Whitmore, E. (1998). Framing participatory evaluation. New Directions for Evaluation, 80, 5-23.
- Kaner, S., Lind, L., Toldi, C., Fisk, S., & Berger, D. (2007). Facilitator’s guide to participatory decision-making. San Francisco, CA: Jossey-Bass.
- Linnan, L., & Steckler, A. (2002). Process evaluation for public health interventions and research. In A. Steckler & L. Linnan (Eds.) Process evaluation for public health interventions and research (pp. 1-23). San Francisco, CA: Jossey-Bass.
- Miller, R.L. (2010). Developing standards for empirical examinations of evaluation theory. American Journal of Evaluation, 31, 390-399.
- Patton, M. Q. (2002). Qualitative Research & Evaluation Methods (3rd edition). Thousand Oaks, CA: Sage.
- Patton, M. Q. (2011). Essentials of utilization-focused evaluation. Thousand Oaks, CA: Sage.
- Patton, M. Q. (2014). What brain sciences reveal about integrating theory and practice. American Journal of Evaluation, 35(2), 237-244. DOI: 10.1177/1098214013503700
- Patton, M. Q. (2015). Qualitative Research & Evaluation Methods (4th edition). Thousand Oaks, CA: Sage.
- Poister, T.H. (2004). Performance monitoring. In J.S. Wholey, H.P. Hatry, & K.E. Newcomer (Eds.), Handbook of practical program evaluation (2nd edition) (pp. 98-125). San Francisco: Jossey Bass.
- Rossi, P. H., Lipsey, M. W., & Freeman, H. E. (2004). Evaluation: A systematic approach. Thousand Oaks, CA: Sage.
- Scriven, M. (1991). Evaluation Thesaurus. Newbury Park, CA: Sage.
- Wholey, J.S. (1996). Formative and summative evaluation: Related issues in performance measurement. Evaluation Practice, 17, 145-149.
- Wholey, J. S. (2004). Evaluability assessment. In J. S. Wholey, H. P. Hatry, K. E. Newcomer (eds.), Handbook of Practical Program Evaluation. San Francisco, CA: Jossey-Bass.
- Witkin, B.R., & Altschuld, J.W. (1995). Planning and conducting needs assessments: A practical guide. Thousand Oaks, CA: Sage.
- W. K. Kellogg Foundation. (2004). Logic model development guide. Battle Creek, MI. Free from wkkf.org
- Yarbrough, D. B., Shulha, L. M., Hopson, R. K., and Caruthers, F. A. (2011). The program evaluation standards: A guide for evaluators and evaluation users (3rd ed.). Thousand Oaks, CA: Sage.