Mechanisms: Discussing program theory and theory-driven evaluation

Mechanisms is the home of the Program Theory and Theory-Based Evaluation TIG (topical interest group) of AEA, the American Evaluation Association.  AEA is an international professional association of evaluators devoted to the application and exploration of program evaluation, personnel evaluation, technology, and many other forms of evaluation.  The program theory TIG is an organized group of AEA members dedicated to using program theory to improve the design, implimentation, and evaluation of social and educational programs.

Mission and Purpose

The program theory and theory-driven evaluation TIG has three objectives:

1) Assemble: To bring together evaluators of similar interest for the purpose of sharing ideas, thoughts, and experiences on theory-based evaluation and theory-driven evaluation.

2) Instruct: To educate evaluators on what theory-based evaluation entails, and what program theory means.

3) Collaborate: To work with other topical interest groups in encouraging the integration of evaluation approaches and views.

Membership

To join the American Evaluation Association (AEA) and this TIG, click here

Schedule of Events/Meetings

The 2006 Annual Conference of the American Evaluation Association (AEA) will be held in Portland, Oregon: October 30-November 4, 2006.  This year's theme is The Consequences of Evaluation.  To learn more, visit the AEA Conference Website 

Please Note: If you are interested in helping with the Evaluation 2006 Proposal Reviews, please contact Katrina Bledsoe, Program Chair at bledsoe@tcnj.edu

What is program theory?

Program theory explains how stakeholders believe a social or educational program will achieve its desired goals.  Chen (1990) defines program theory as "a specification of what must be done to achieve the desired goals, what other important impacts may also be anticipated, and how these goals and impacts would be generated."  Program theories are typically represented as diagrams that indicate the casual relationships among programmatic actions, outcomes, and other intervening factors.  Donaldson (2001) names four sources of program theory: prior theory and research, implicit theories of those close to the program, observations of the program, and exploratory research to test critical assumptions.

What are theory-based evaluations?

Theory-based evaluations evaluate not only the end result of a program, but also the program theory itself: the intermediate steps to reach that end result.  Donaldson (Fitzpatrick 2002) names three levels that are being addressed and evaluated: actions, immediate outcomes, and long-term outcomes.   Thus, the evaluation will explore the process of achieving a program's goals and the effectiveness of each step in the process, all in addition to addressing whether or not the goals themselves have been achieved..

Chen, Huey-Tsyh. (1990). Theory-Driven Evaluations. Newbury Park, CA: Sage Publications.

Donaldson, S.I. (2001). Mediator and moderator analysis in program development.  In S. Sussman (Ed.), Handbook of program development for health behavior research. (pp. 470-496). Newbury Park, CA: Sage.

Fitzpatrick, Jody. (2002).  Dialogue with Stewart Donaldson.  American Journal of Evaluation, 23(3), 347-365.