Escolar Documentos
Profissional Documentos
Cultura Documentos
Effective Evaluation
Strategy
presenter:
Sponsored through
Goals of Training
Participants will understand
The terminology related to evaluation
Evaluation design options and how to
plan out a successful evaluation
strategy
How to design an effective evaluation
strategy
Data collection sources and methods
How to justify conclusions based on
evaluation results
What is evaluation?
The simple answer, dictionary
definition:
e + valuer =
to establish the worth or value of.
Why do we do Evaluation?
Required by funder
Purpose of Program
Evaluation
programs
Better manage limited resources
Document program accomplishments
Justify current program funding
Support the need for increased levels of funding
Satisfy ethical responsibility to clients to
demonstrate positive and negative effects of
program participation (Short, Hennessy, &
Campbell, 1996).
Document program development and activities to
help ensure successful replication
Framework for
Evaluation
Evaluation
Need not be
Expensive
Complicated
Time consuming
These must be
integrated
PlanningWhat actions
Evaluation Flowchart
GOAL
STATED OBJECTIVE
Activity
Outcome
Performance Indicator
(either quantitative or qualitative)
Types of Evaluation
Planning
Cost Benefit
Planning Evaluation
Why is the program needed?
planning?
Quantitative
Qualitative
evaluation:
Interviews
Focus groups
Observation
Questionnaires/Surveys
Analysis of existing documents
Outcome Evaluation
Outcome evaluations are sometimes referred
Control group
Comparison group
Pre- and post-test
Step-by-Step Evaluation
Design
1. Engage stakeholders: Decide
who needs to be part of the design and
implementation of the evaluation for it
to make a difference.
Step by Step
(continued)
Designing an Evaluation
Plan
STEP 1: Engage
Stakeholders
Who are major stakeholders for
our efforts
Where in this model doe they
want to see success?
Who needs to be engaged
upfront to ensure use of
results?
Group Exercise:
Engaging Stakeholders
Consider which stakeholders are
Designing an Evaluation
Plan
STEP 2: Describe the program
You dont always need a logic model, BUT you
ALWAYS need a program description
Dont jump into planning or evaluation without clarity on
The big need your program is to address
The key target group(s) who need to take action
The kinds of actions they need to take (your intended
outcomes or objectives)
Activities needed to meet those outcomes
Causal relationships between activities and outcomes
Proposal Problems
STEP 3: Setting
Evaluation Focus
Effectiveness (Outcome)
Efficiency
Causal Attribution
standard
Some Evaluation
Scenarios
Scenario 1:
At year 1, other
communities want to adopt your model
but want to know what they are in
for?
Purpose: Examine program
implementation
User: The other community
Use: To make a determination, based
upon your experience whether or not
they want to adopt this project
Group Exercise
YOU are the community next door that has
Contact Information
Sharon Schnelle
smschnelle@dps.state.oh.u
s
614.466.0346