Baker College Evaluation Plan 1

Baker College Evaluation Plan

Baker College Evaluation Plan of MYITLAB Training
Aaron Maike, President of Baker College

Dear President Maike:

Thank you for hiring ASP consulting for the MYITLAB Training Evaluation project.
We are very dedicated to working with Baker College through each phase of the
evaluation.

This evaluation plan includes:

Identification of Evaluation Goals and Scope
Description of Process including a Gantt Chart
Instruments and Instrument Descriptions
Data Collection & Analysis
Executive Summary

I look forward to working on this evaluation.

Alicia Pearlman
Owner, ASP consulting
apearlman@ASPConsulting.com
(248) 555-5555



Baker College Evaluation Plan 2


Discussion of Need:

Baker College has been using MyITLab by Pearson Education since 2010 for
its Microsoft Office classes. MyITLab is an online assessment and training for
Microsoft Office Applications and Computer Concepts (What is MyITLab?). The
MyITLab training includes a textbook that matches the simulation assignments and
assessment scenarios as well as quizzes and tests.
Baker College is currently using Microsoft Office 2010 and will be migrating to
Microsoft Office 2013 within the next year. Before committing to migrate to the new
version of MyITLab, the college wants to evaluate the training to see how effective it
is in teaching Microsoft Office to the students. Within the last year there have been a
number of students who had problems with the training and are not learning the
material. Baker College wants to have a smooth transition to the newer version of
the MyITLab training. For this reason the college has contacted ASP Consulting to
assist with the evaluation. Baker College wants to measure the effectiveness of the
MyITLab training. This evaluation will provide strategies to assist Baker College in
gathering evaluation metrics to create a baseline to compare current and future
performance of MyITLab.
I. EVALUATION GOALS AND SCOPE
Instructional Product Description:
MyITLab is an online training and assessment program for Microsoft Office.
The program was launched in 2007 by Pearson Learning Corporation. MyITLab was
designed by input from instructors and students. A team of experienced technology
professionals then built MyITLab to the market's specifications (What is MyITLab?).
Baker College pays a monthly fee to use MyITLab. The students pay a one-
time fee for an access code for the training. MyITLab is geared toward the student,
and the content can be customized to match the learning outcomes of each class.
The training for Microsoft Office using MyITLab is broken up into modules for each
version of the Microsoft Office suite. The following modules are available: Microsoft
Word 2010, Microsoft Excel 2010, Microsoft Access 2010, and Microsoft PowerPoint
2010. Each module is further broken up into multiple training phases with each
phase starting at the beginner level and moving up to the advanced level. Each
module includes a training section, a quiz, and an exam. There are also additional
projects available called grader projects that are used as hands on assessment
scenarios. The training consists of simulations in which the users get hands on
experience using the program.
Important Outcomes
The training is currently scheduled for the second half of the semester. The
training will begin the first week of November and continue through the second week
of December when the semester ends. Level 1 and Level 2 data will be collected
during the semester. Level 3 data will be collected after the semester ends. The
initial findings will be communicated on March 1, 2014 after all the data is analyzed.
A final report will be available on May 1, 2014.
Baker College Evaluation Plan 3


The results may include the following:
Training activities that needs to be revised or eliminated
Training that was successful and meets the objects
Gaps in the training where new activities may be needed
Entry-level prerequisites that should be incorporated into the training
The satisfaction level of the students as well as the faculty
How successful the training was in achieving the student outcomes
If the organizational results are achieved, how much impact the results had on
student enrollment
Purpose of Evaluation:
The goals of this training evaluation are the following:
1. Use the Kirkpatrick four level evaluation models to establish baseline
metrics.
2. Collect data to establish the baseline metrics on learner satisfaction, learner
outcomes, and learner behavior.
3. Analyze the data to make recommendations for continuing on with the
training.
4. Analyze the data for improving the training
5. Construct an evaluation methodology to track changes in learner
satisfaction, learner outcomes, learner behaviors, and ROI.
Primary Objective:
The primary objective of the training evaluation is to measure how effective
the MyITLab training courses are for learning Microsoft Office and also the
satisfaction level of the faculty and students with this training.
Learner Analysis:
The mission of MyITLab is to change the way that instructors and students
across the country teach and learn Information Technology (MyITLab for Office
2013, 2013). MyITLab is a cloud-based training and there is no face-to-face
interaction with an instructor. Students can access MyITLab from anywhere there is
an Internet connection. The training does not have to be accessed in the classroom.
The training can be completed from the students home or office. During the signup
process for MyITLab, very few demographics are collected. The only information
collected is age and location demographics. Baker College does collect
demographics on the students so this information is available. The majority of the
students are between the ages of 18 50, English-speaking, enrolled in higher
education at Baker College, and from varied ethnic backgrounds. A student only has
to purchase an access code for MyITLab one time and that code will give the student
access to all classes that use the MyITLab training. The cost of the code is an
additional $30 over the price of their textbook. MyITLab has no pre-requisites to use
and students can watch a video tutorial on how to use the software.
There are two primary audiences for learners using the MyITLab training
platform:
Baker College Evaluation Plan 4


Primary Audience: Students that are required to take Microsoft Office
classes for their major. This type of learner is already familiar with the
application. These students are usually first year students at Baker College.
Most of these students are recent high school graduates who have
experience with Microsoft Office.

Secondary Audience: Students that are not required to take Microsoft Office
classes for their major but want to know how to use the program. They are
taking the class as an elective. This type of learner is not familiar with the
application. This student is usually a second or third year student. Most of
these students are a little older ranging in age from 25 years old to 50 years
old.
II. EVALUATION PROCESS
The evaluation process will use Kirkpatricks 4 Level Training Evaluation
Model. This will be used to measure the effectiveness of the MyITLab training and
assessments.
Appendix A provides a detailed project plan and recommended timeline
(Gantt chart) for completing all 4 Kirkpatrick evaluation levels.
Level 1 Evaluation:
Don Kirkpatrick created a four level training evaluation model to determine the
effectiveness of training programs. The evaluation strategy will measure all four
levels of the Kirkpatrick evaluation model. The level 1 evaluation measures the
students reaction to the training. Don Kirkpatrick defines Level 1 (L1) as, The
participants reactions to a training event. It is basically a measure of (internal)
customer satisfaction (Ally, 2009).

Baker College is concerned with the trainees reaction to the MyITLab
training. They want to obtain a high level of learner satisfaction. The learners believe
that because they are paying extra for the MyITLab training that there should be no
glitches in the training. Baker College wants the training to be an engaging and
positive learning experience for all students. They want a positive reaction from the
trainees.
Evaluation Instrument: Online Survey Reaction Sheet

Evaluation Procedures: The survey can be created online through the
Blackboard Learning Management system and the experimental group can access
the survey through Blackboard after completing the training. The survey is not
required, but recommended for all trainees. The survey will be looking for the
trainees reaction to the training as part of the level 1 evaluation. The survey has
three categories of questions and scores will be collected from each category. The
survey is given anonymously but if a student wants to include his or her name the
student can do so.
The survey for level 1 will consist of a total of nine questions using a five point
Likert rating system that will provide quantitative data that can be analyzed. The five
Baker College Evaluation Plan 5


point Likert rating system will provide an appropriate range of responses on the
quality of the training. There will also be one question at the end of the survey for
trainees to include any comments about the training. The comments will be very
helpful as they will provide additional information about the training (See Appendix B
for the complete Training Feedback Survey).

Rationale: An online survey is recommended for this training as it may result
in more honest feedback than traditional survey methods, more efficient as far as
time goes, less errors in data entry, higher response rates as all items need to be
answered before turning it in, and at a lower cost.

Level 2 Evaluation:
Kirkpatricks level 2 evaluation measures what the trainees have learned.
Baker College wants to make sure that the trainees have learned how to use
Microsoft Office and that the learning objectives for the training have been met.
Kirkpatrick (1998) states that in order for us to say that our participants learned
they must have undergone an increase in skills, knowledge, or change of attitude as
a result of the training program (Kirkpatrick's Level Two - Learning).
Evaluation Instrument: Assessment tests before and after the training and
verbal assessments. (See Appendix C)

Evaluation Procedures: Level 2 data will be measured both before and after
the training. Testing will be given before the training to help to determine the level of
knowledge of the trainees along with their skill level and attitude. After the training is
done, the trainees will be tested a second time to measure what they have learned.
The evaluation data collected will help ensure that the learning outcomes are met.
This is a key foundation for evaluation at the higher levels ensuring you have
determined that learning has occurred before you examine behavior change at Level
3. Failure to confirm that learning has occurred at this stage has the potential to lead
to wrong conclusions later (Models).

Evaluation Procedures: Level 2 data will be measured both before and after
the training. Testing will be given before the training to help to determine the level of
knowledge of the trainees along with their skill level and attitude. After the training is
done, the trainees will be tested a second time to measure what they have learned.
The evaluation data collected will help ensure that the learning outcomes are being
met. This is a key foundation for evaluation at the higher levels ensuring you have
determined that learning has occurred before you examine behavior change at Level
3. Failure to confirm that learning has occurred at this stage has the potential to lead
to wrong conclusions later (Models).
The online quizzes will consist of multiple choice questions on the key
concepts of the training. When the quiz is completed, the trainees will receive instant
feedback. The instant feedback is being used to motive the trainee to stay focused
throughout the whole process.
Thirty days after the training a 15-minute learner interview will be given to see
if the learners have applied what they have learned. This time frame gives the
learner time to apply what they have learned. Only learners who have completed all
Baker College Evaluation Plan 6


of the modules will be interviewed. The interview questions will focus on what skills
or knowledge that the learners have obtained as a result of the training. The
interview request will be generated after the training is completed, and it is not
required. Because not all learners will be interviewed there is a possibility of some
bias as only learners who have completed the training will be invited to be
interviewed and these learners may have a more positive outlook because they have
completed all of the modules. (See Appendix C for the complete interview
questions.)
Rationale: Data from the online quizzes will be used to create a baseline of
data to analyze the effectiveness of the training. The quizzes and assessments from
each module can be used to verify that learning is occurring.

Level 3 Evaluation:
Level 3 measures whether there was an actual transfer of learning to the
actual work setting (Mayberry, 2005). According to noted evaluation expert Jack
Phillips (1996), evaluating at Level Three of the Kirkpatrick model servers the
following functions: (1) determining success in accomplishing organizational goals,
(2) identifying strengths and weaknesses in the training and development process,
(3) identifying which participants were the most successful and (4) providing an
opportunity to reinforce major points to the participants (Mayberry, 2005). In the
case of this evaluation it will measure if there was an actual transfer of learning to
the classroom setting. The MyITLab training includes projects titled Grader
Projects that can be used to show that there was an actual transfer of learning.
These projects are hands on and cover all of the skills learned in the training. The
projects require that the students do the work themselves with no directions or
prompts. Level 3 evaluations also provide verification that that Level 1 and Level 2
have been met, and that the learner is able to demonstrate the new knowledge,
skills, or attitudes (KSAs) in the work setting. In short, did the transfer of KSAs from
online learning to the work setting occur (Mayberry, 2005)?

Evaluation Instruments: Learner surveys (See Appendix D) and Performance
Based Tests (Grader Projects in MYITLAB).

Evaluation Procedure: A short survey will be requested from learners three
months after completion of the training. A random sample of the participants from
each course will be chosen for this evaluation. This timeframe was chosen because
it will give the learners time to apply what they have learned to the classroom, their
job, or their personal life. The questions asked will be open-ended questions An
open-ended question is designed to encourage a full, meaningful answer using the
subject's own knowledge and/or feelings (Open-Ended Questions). Level 3 is not
without challenges. Some of the challenges are that not all participants will agree to
be interviewed and of those interviewed; the results may be biased in favor of
positive learning taking place.

Rationale: The data from level 3 interviews can be used in conjunction with
the data from Level 1 and Level 2 to get a more complete picture of the learning that
is taking place. The data can provide insight about the transfer of learning as well as
corroborate learning objectives. The goal of Level 3 is to verify that learning is taking
Baker College Evaluation Plan 7


place and that the learner is able to transfer the knowledge to the classroom, their
job, or his or her personal computer.

Level 4 Evaluation:
The Level 4 Evaluation measures whether or not the strategic goals of Baker
College were met. The goal at this level is to discover if the training led to the results
that the college was striving to meet. At this level, you analyze the final results of
your training. This includes outcomes that you or your organization have determined
to be good for business, good for the employees, or good for the bottom line
(Kirkpatrick's Four-Level Training Evaluation Model Analyzing Training
Effectiveness). By reviewing the data for Levels 1, 2, and 3 Baker College can make
a determination of whether or not to continue using MyITLab for Microsoft Office
classes. The results from Level 4 can determine what extent the training has
contributed to colleges objectives.
Evaluation Instruments: Online Survey
Evaluation Procedure: A control group will be used for evaluating the impact
of the training. Two groups will be used; one group will receive the training and the
other group will not receive the training. Then the difference in performance between
the two groups is attributed to the training.
This evaluation plan will utilize the Return on Investment as a way of
determining if the training continues to work financially for the college.
III. DATA COLLECTION & ANALYSIS
Change is important for any organization because, without change,
businesses would likely lose their competitive edge and fail to meet the needs of
what most hope to be a growing base of loyal customers (Richards, 2013). The
process of setting a baseline will help organizations with change. Baselines
measure data and if the information from the baseline differs from the current data, it
may indicate that the project plan needs to be reviewed and possibly revised.
Level 1 Data analysis
Instrument Description: Online survey (See Appendix B)
The survey will be administered online through the Blackboard Learning
Management System and will provide reaction data on the following three areas:
quality of instructional content, relevance of instructional content and overall levels of
satisfaction. There will also be an area for comments that will provide additional
information on learner satisfaction.
Blackboard will be used to analyze the results of the survey, and a report will
be generated. The report will include the response period and how the results
compared. The results will also be presented visually using a pie chart that will show
the percentage of positive and negative responses. The average for each question
will be calculated by Blackboard. This information will be exported to a PDF file to
share with the stakeholders of the college.
Baker College Evaluation Plan 8


For each of the three areas of reaction data a standard score of 4. 0 has been
identified. If the data falls below 4.0, the content will be marked for revision.
Results: The training has not started yet. Once the data has been received, it
will be analyzed and a visual representation will be presented to show the data for
each of the three reaction areas.
Level 2 Data Analysis:
Instrument Description: Assessment tests before and after the training and
verbal assessments. (See Appendix C)

The trainees will complete a pretest before the training and a posttest after the
training. These tests will measure the level of knowledge of Microsoft Office of the
trainees before and after the training. The test scores will show the areas that
learning has taken place and will also show the areas where the training needs to be
revised.
Trainees will also be asked to participate in a 15-minute interview thirty days
after the training to see if the learners have applied what they have learned. This
time frame gives the learner time to apply what they have learned. Only learners who
have completed all of the modules will be interviewed.
The data from Level 2 will be analyzed along with the data from Level 1 to
determine the extent that the training program is benefitting the learners.
The data will be analyzed using a 5 point Lickert scale. The scores from each
of the questions will be tabulated and each question will have a mean score
calculated for it as well as a mode score. The scores will be displayed visually using
a bar chart. If any of the scores fall below an average of 4.0, the training will be
revised.
The interview data will be compiled and analyzed. Each question will be
analyzed to determine the overall satisfaction of the learners with the training. The
results of the interview will be shown visually using a line graph. The graph will show
the percentage of learners who mastered each skill. If a skill has not been mastered
the course will need to be revised to help the students master that skill.
Results:
The training has not started yet. After the data has been compiled and
analyzed, the results will be shared with the stakeholders.
Level 3 Data Analysis
Instrument Description: Online Survey (See Appendix D)
An online survey invitation will be sent out to a random sample of learners
who participated in the MyITLab Microsoft Office training. The invitation for the
survey will be sent out 90 days after the class ends. This will allow time for the
participants to practice what they have learned. The survey will determine the extent
to which the learner has been using what they have learned from the training. The
survey will use a 5-point Likert scale. The survey will be given using the Blackboard
Baker College Evaluation Plan 9


Learning Management System and will be totally anonymous so trainees can feel
free to express their views.
The information from the survey will provide data on how well the learners
have applied what they have learned. A control group of those who did not
participate in the training will be used. This control group will provide data on the
extent of the behavioral change. A question on the survey will ask if the student
participated in the training.

Data Analysis: The Blackboard learning management system will be used to
analyze the results of the survey. A report will be created that will compare the
answers of those in the control group with those not in the control group. The results
will be presented using a pie chart for both groups that will show the percentage of
positive and negative responses. The average for each question will also be
calculated by Blackboard. This information will be exported to a PDF file to share
with the stakeholders.
The data from the two groups will be compared to determine how much the
training has benefited the students. The information also can be used to determine
where the training needs to be revised. The information will also be analyzed to see
if it meets the learning outcomes set by the College.
Results: The results will be presented after the data has been analyzed. A
visual representation of the data will also be included using a bar chart to show the
differences between the students who completed the training with those who did not
complete the training.
Level 4 Data Analysis
Instrument Description: Level 4 Results evaluations measure the
organizational impact of the trained behaviors. Commonly referred to as Return on
Investment, level 4 attempts to quantify the value-added of a performance
intervention (Standard Operating Procedures (SOP) for the Coast Guard Training
System, 2011).
Data Analysis: Return on Investment is a method used to determine the level
4 results. The information that ROI gives an organization is about the financial
impact of the training. Baker College wants to use this figure to help the college
determine if they are going to move ahead with the next version of the MYITLAB
training. The stakeholders of the College are very interested in seeing this figure.
The ROI is a financial figure only and does not provide any information on improving
the training. The formula that will be used to calculate ROI is as follows:
ROI = Total Cost of Training/Number of Students

ROI (%) = Training Costs - Benefits x 100/Training Costs

Results: The training has not started yet so there are no results to report. The
results will be reported back to the administration of Baker College after the data has
been collected and analyzed. The results will be reported visually as well by using a
graph to show the return on investment.
Baker College Evaluation Plan 10


Level 1 and Level 2 data will be collected immediately at the end of the
program and Levels 3 and 4 will be collected 90 days after the completion of the
program. The data analysis phase will analyze the effects of the MyITLab training.
The data will be used to set a baseline for future MyITLab training at Baker College.
A baseline is an initial value that can be used to compare past, current and
projected future values. The baseline can be considered the starting point against
which all future values are measured (Baseline). The data from levels 1, 2, and 3
will be pooled for the level 4 analysis.
The data from Level 1, Level 2, and Level 3 can be combined and analyzed
for Level 4 analysis. Modifications will be applied and tested within MyITLab in the
anticipation of higher learner satisfaction. However, there may be some outside
factors present that influence the results such as time factors, equipment differences,
Internet connection variables, and personal problems affecting learners. Baseline
data will be collected at all levels for this evaluation and metrics will be established.
The training evaluation will be ongoing.
IV. EXECUTIVE SUMMARY
Purpose of Evaluation:

This evaluation plan has been created for Baker College to measure the
effectiveness of the MyITLab training for Microsoft Office. One of the goals of Baker
College is to have a satisfaction level of 75% for the training. The training is a very
high priority. This evaluation will provide strategies to assist Baker College in
gathering evaluation metrics to create a baseline to compare current and future
performance rates for MyITLab. The data will be analyzed and will focus on areas for
improvement in the training.

Primary Objective:

The primary objective of this evaluation is to measure the overall
effectiveness of the MYITLAB training to improve learner satisfaction.

Summary of Evaluation Plan:

Kirkpatricks 4 Level Training Evaluation Model will be used to measure the
effectiveness of the MYITLAB training and assessments. The evaluation will look at
the following four levels:
Level 1: Learner Reaction
Level 2: Learning
Level 3: Learning Behavior
Level 4: Results
Data will be collected from all 4 levels of the model and analyzed. The results
of the data analysis will be used to make a recommendation on whether to continue
using MyITLab training or make improvements in the training.
Baker College Evaluation Plan 11


A time frame of three months will be required to complete the project plan and
project outline. Examples of evaluation instruments are included in the Appendix.
Key Recommendations:
The evaluation will be conducted on a one semester basis with participation
and feedback from both faculty and students. Data will be collected at the beginning,
middle, and end of the semester. Baker College wants 100% participation, but
knows that number is not feasible and is striving for 75% participation. The data that
will be received will be analyzed to provide evidence about the training and whether
or not the college should move ahead with the next version of MyITLab. At this time
no training has been conducted and therefore there is no data to report. Once the
data has been received and analyzed the stakeholders will be able to review overall
learner reaction scores, learner outcome scores, and information from learner
interviews. All of these data will be analyzed with the goal of improving learner
satisfaction. The project timeline is included in Appendix A.
ASP Consulting will meet with the stakeholders of the college to present the
results. The results will be thoroughly presented to the stakeholders and will include
the data, the analysis of the data, and visual representations of the data. ASP
Consulting will also explain to the stakeholders, the process that was went through to
analyze the data. A one-page bulleted summary of the findings will also be
presented to the stakeholders that can serve as a quick way to see the results.



Baker College Evaluation Plan 12


APPENDIX A: PROJECT PLAN AND TIMELINE



Baker College Evaluation Plan 13


V. APPENDIX B: MYITLAB TRAINING FEEDBACK SURVEY
Name (optional):
Email (optional):
(*Note: if you would like to include your name or email address to be contacted by Baker College to
follow up with you on your feedback, please include your information; otherwise, leave the fields blank
to submit your responses anonymously)

Instructions: Thank you for taking the time to complete this survey about the MYITLAB
training. Your feedback is important to us to help us with improving our training. This survey
should only take about 5 minutes of your time. Your answers will be completely anonymous.
Please answer each question as honest as you can. A 5-point scale is being used with 5
being the highest and 1 the lowest.
1 = Strongly disagree | 2 = Disagree | 3 = Neither agree/disagree | 4 = Agree | 5 = Strongly
Agree
Strongly
Disagree
Disagree Neither
agree/disagree
Agree Strongly Agree
Quality of Instructional Content:
Course objectives
were clearly
explained.

The skills based
training helped me
understand the
concepts presented in
MYITLAB.

The online quizzes
helped me confirm my
understanding of the
content covered.

The content was well
organized and easy to
navigate.

Relevance of Instructional Content
The level of training
was suitable for my
knowledge and/or skill
level.

I feel that I am now
ready to use Microsoft
Office

The content covered
in the training
addressed using
Microsoft Office

Overall Levels of Satisfaction:
The training motivated
me to complete each
step

Baker College Evaluation Plan 14


I would recommend
this training to other
students

Please share any
comments that you
have about the
training


APPENDIX C: MYITLAB LEARNER INTERVIEW QUESTIONS
Instructions for Interviewer: Please ask the following 7 open-ended questions and
record the interviewees responses. Each interview will be recorded so that no
answer is missed.
Name (optional): __________________________
E-mail (optional): __________________________
(*Note: Please tell the interviewee that they have the option to remain anonymous)

Demographics:
Gender: _____
Age: ________
Year in School: _______
Major: ______

1. Prior to this training have you used Microsoft Office?

2. Why did you sign up for the MYITLAB Microsoft Office training?

3. What knowledge level of Microsoft Office would you classify yourself before you
started the training?
a. Never heard of it
b. Used it once or twice
c. Beginning User
d. Intermediate User
e. Proficient User

4. What knowledge level of Microsoft Office would you classify yourself after you
completed the training?
a. Used it once or twice
b. Beginning User
c. Intermediate User
d. Proficient User

5. To what extent have you had the opportunity to apply the knowledge and/or skills
presented in this training?

Baker College Evaluation Plan 15


6. To what extent has your confidence in using Microsoft Office increased as a
result of this training?

7. Did you experience any problems with using MYITLAB?

8. Do you have any additional comments or ideas for improving the Microsoft Office
training using MYITLAB?


Baker College Evaluation Plan 16


VI. APPENDIX D: MYITLAB TRAINING BEHAVIOR SURVEY
Name (optional):
Email (optional):
(*Note: if you would like to include your name or email address to be contacted by
Baker College to follow up with you on your feedback, please include your
information; otherwise, leave the fields blank to submit your responses
anonymously)

Instructions: Thank you for taking the time to complete this survey about the
MYITLAB training. Your feedback is important to us to help us with improving our
training. This survey should only take about 5 minutes of your time. Your answers
will be completely anonymous. Please answer each question as honest as you can.
A 5-point scale is being used with 5 being the highest and 1 the lowest.
1 = Strongly disagree | 2 = Disagree | 3 = Neither agree/disagree | 4 = Agree | 5 = Strongly
Agree
Strongly
Disagree
Disagree Neither
agree/disagree
Agree Strongly Agree

To what degree did
you use the
knowledge/skills prior
to attending the
training?

To what degree have
you had the
opportunity to use the
knowledge/skills
presented in the
training?

To what degree have
you actually used the
knowledge/skills
presented in the
training after
completing the class?

To what degree has
your confidence in
using the
knowledge/skills
increased as a result
of the training


To what degree did
you receive the
support necessary in
preparing you for this

Baker College Evaluation Plan 17


training?
To what degree has
the content of the
training reflected your
work in school?

To what degree have
you received
assistance with
applying the
knowledge/skills in
school?


As a result of the
training, my
performance on the
course objectives has
changed by a (%)

As a result of the
training, my overall
school performance
has changed by(%)s

Please share any
comments that you
have about the
training



VII. APPENDIX E: DATA
The data will be reported to the stakeholders after it has been
analyzed. The semester has not started yet, so there is no data to
report.

Baker College Evaluation Plan 18


VII. Works Ci ted
(2011). Standard Operating Procedures (SOP) for the Coast Guard Training System.
MyITLab for Office 2013. (2013). Retrieved from MyITLab: http://www.myitlab.com/learn-
about/office-2013.html
About Treehouse. (n.d.). Retrieved September 30, 2012, from Treehouse Corporate Website:
http://teamtreehouse.com/about
Ally. (2009, August 20). Kirkpatrick Rewrites Level 1 Evaluation. Retrieved from Brain Friendly
Trainer: http://www.brainfriendlytrainer.com/theory/kirkpartick-re-writes-level-1-
evaluation
Baseline. (n.d.). Retrieved from Investopedia: http://www.investopedia.com/terms/b/baseline.asp
Developing a Strategic Plan for a Program in Communication Sciences and Disorders. (n.d.).
Retrieved from American-Speech-Language-Hearing Association:
http://www.asha.org/academic/DSPBaselineDataSP.htm
Galloway, D. L. (2005). Evaluating Distance Delivery and E-Learning Is Kirkpatricks Model Relevant.
Performance Improvement, 21-27.
Hisako Matsuo, K. P. (2004). The Online Survey: Its Contributions and Potential. Journal of the
American Statistical Association, 3998-4000.
Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating training programs. San Francisco: Berrett-
Koehler Publishers, Inc.
Kirkpatrick's Four-Level Training Evaluation Model Analyzing Training Effectiveness. (n.d.). Retrieved
from Mind Tools: http://www.mindtools.com/pages/article/kirkpatrick.htm
Kirkpatrick's Level Two - Learning. (n.d.). Retrieved from Southern Illinois University Carbondale:
http://wed.siu.edu/Public1/ocdp/CDROM_FALL_2012/WED_463_CD/Evaluating%20Training
%20Programs/KirkpatrickLearning.htm
Mayberry, E. (2005, May 1). Kirkpatrick's Level 3: Improving the Evaluation of E-Learning . Retrieved
from astd.org: http://www.astd.org/Publications/Newsletters/Learning-Circuits/Learning-
Circuits-Archives/2005/05/Kirkpatricks-Level-3-Improving-the-Evaluation-of-E-Learning
Models, R. i. (n.d.). Kirkpatrick Level 2 Evaluation. Retrieved from Evaluation Focus:
http://evaluationfocus.com/kirkpatrick-level-2-evaluation/
Open-Ended Questions. (n.d.). Retrieved from MediaCollege.com:
http://www.mediacollege.com/journalism/interviews/open-ended-questions.html
Richards, L. (2013). Why Is Change Important in an Organization? Retrieved from Chron:
http://smallbusiness.chron.com/change-important-organization-728.html
Baker College Evaluation Plan 19


Vanek, C. (2012, April 24). Likert Scale What is it? When to Use it? How to Analyze it? Retrieved
from surveygizmo: http://www.surveygizmo.com/survey-blog/likert-scale-what-is-it-how-to-
analyze-it-and-when-to-use-it/
What is MyITLab? (n.d.). Retrieved from MyITLab: http://www.myitlab.com/learn-about/what-
is.html