www.isealalliance.

org

9. Evaluation of Training Effectiveness

Define Training Needs

Evaluate Training Outcomes

Evaluate Training Outcomes
Design and Plan Training

Monitor

Provide for Training

Creating a world where environmental sustainability and social justice are the normal conditions of business

www.isealalliance.org

Evaluation of Training Effectiveness

> So youve developed the learning objectives, qualified your trainers, designed and delivered one or more courses, and implemented a system to manage it all. Now, how do you measure the bottom line: Is it working? > Youll need to consider this at two levels:
How well is a specific course working? How well is your overall program working?

Evaluation of Training Effectiveness 2 Creating a world where environmental sustainability and social justice are the normal conditions of business

www.isealalliance.org

Evaluation of Course Effectiveness

> So how well is a specific course working?
> You can look at it from two dimensions, both important in the context of social auditing and adult learners:

Perceived Learning
This is what the students think theyve learned, and how the course has met their expectations

Demonstrated Learning
This is what the students can show theyve learned, through test results or performance in the field, etc.

In the next few slides, we'll go over some ways to measure both dimensions.
Evaluation of Training Effectiveness 3 Creating a world where environmental sustainability and social justice are the normal conditions of business

www.isealalliance.org

Perceived Learning
> Here are some ways to measure what students think theyve learned and how the course met their expectations:
Post-course questionnaire/survey > In-class > Online Phone interviews with sample of students Student testimonials Debriefing sessions with trainer after the exam Student evaluations of trainer Peer grading students assess each others performance
Evaluation of Training Effectiveness 4
SAI 2009 - draft for review

Creating a world where environmental sustainability and social justice are the normal conditions of business

www.isealalliance.org

Demonstrated Learning
> Here are some ways to measure what the student actually learned: Compare pre- and post- course questionnaire and quizzes (should be the same questions on each, for comparison) External evaluation methods (already covered) Take-home exams or projects (to give time to synthesize material) Follow-up surveys to test knowledge retention and attitude (such as cultural sensitivity) change over time Witness or shadow audits to measure performance of auditor in the field and the long-term impact of the training on operational knowledge, skills and behavior

Evaluation of Training Effectiveness 5 Creating a world where environmental sustainability and social justice are the normal conditions of business

www.isealalliance.org

Effectiveness of Overall Program

> So how well is your overall training program working?
> You need to pick some key performance indicators to measure. > Here are some to consider as baseline measurements: Average Student Performance in course Trainer and course ratings by students and observers Number of returning students If possible, field performance measurement or achievement of available or relevant certification

Click on the notes tab to get a Student Survey you can use.
Evaluation of Training Effectiveness 6 Creating a world where environmental sustainability and social justice are the normal conditions of business

www.isealalliance.org

Effectiveness of Overall Training Program (continued)

> These key performance indicators may become important as your program grows: Number of trainers qualified Number of languages in which courses offered Number of countries in which courses offered Average student performance from region to region Average student course evaluation from region to region Number of courses per year Number of students Number of new courses developed

Evaluation of Training Effectiveness 7 Creating a world where environmental sustainability and social justice are the normal conditions of business