Summer 2015

MIST 622 Assessment and Evaluation - 4 units

Bude Su, Ph.D.
bsu@csumb.edu

Phone: 831 582-4558

Office: Building 18, Room 168

Course Description
Assessment and evaluation of education, training, and performance
improvement programs deal with making judgments about the worth of
programs in terms of the degree to which program results achieve intended
objectives, whether or not results are desirable, and are they achieved in
cost-effective manners. In this course, students will learn how to assess
learning and performance outcomes through the use of psychometric
methodologies, evaluate effectiveness of curriculum design and instructional
delivery.

Learning Outcomes
Apply basic statistics required for the field of instructional technology
Design and develop appropriate instruments to assess learning process
and outcomes
Conduct appropriate usability, reliability, and effectiveness tests of
instructional or performance interventions
Design, conduct, analyze, and interpret an evaluation project in the field
of instructional and performance technology

Course resources
Required Textbooks
1. Evaluation in Organizations: A Systematic Approach to Enhancing
Learning, Performance, and Change (2nd Ed.) By Darlene Russ-Eft and
Hallie Preskill. 2009. New York: Basic books. ISBN-10: 0465018661,
ISBN-13: 978-0465018666.
2. Evaluating Training Programs: The Four Levels, 3rd Edition. Donald L.
Kirkpatrick and James D. Kirkpatrick. San Francisco: Berrett-Koehler,
2006. ISBN: 978-1576753484
3. (optional) A basic statistics book is required if you have taken statistics
long time ago or if you are unsure that you understand the basics of
applied statistics.

Additional Resources
Additional readings and/or on-line resources may be made available
throughout the course and will be listed with the weekly materials on
an, as-needed basis.
Required Software
o Microsoft Excel. Make sure that you have access to MS Excel. The
statistics part of this course will heavily rely on using Excel to complete
multiple assignments.

Assessment:
You will be assessed on all work that you do for this class, which means
that everything you do during this course results in points earned. There is
no extra credit designed for this course. If you keep up with and complete
all assignments, activities, readings, projects, and class collaboration
efforts, you will receive the assigned points according to the grading
criteria. Some grading criteria will be simple and based merely on evidence
of participation while other work will be assessed through the use of rubrics.
Weekly Activities (discussions, quizzes, etc.)
Data Analysis Project (Team work)
Mid Term Practice and Mid Term Exam
Final Project (Individual or small team)

80
50
50
70

pts
pts
pts
pts

Grading Criteria
A (95-100%): Extraordinarily high achievement. Unusually complete
command of the course content; outstanding level of
scholarship;
A- (90-94%): Excellent achievement. Very thorough command of
the course content; very high level of scholarship;
B+ (87-89%): Very good achievement. Significantly above average
understanding of materials and thorough command of
course material.
B (83-86%): Good achievement. Signifies mastery and fulfillment of
all course requirements; Solid, acceptable performance.
B- (80-82%): Fair achievement. Acceptable performance on most,
but not all, aspects of the course.
C+ (75-79%): Not wholly satisfactory achievement. Marginal
performance on some aspects of the course.
C (70-74%): Marginal achievement. Minimally acceptable
performance on most aspects of the course.
F ( < 70%): Unacceptable work. Little or no command of the
course objectives.
2

Other policies
Assignments
Specifications for each assignment will be given in the course
management system. Assignments are due no later than 11:59 p.m. PST
on the specified date. If an assignment due date cannot be met, notify
the instructor prior to the due date. You are responsible for turning in
work on time, as posted. Any assignments/activities not received by the
due date will be considered late and a reduction of total points will be
enforced at the rate of 10% for every day it is late.
Sometimes personal situations will arise and, on occasion, students may
not be able to meet assignment deadlines. Should that occur, students
are required to contact their professors as soon as possible, ideally prior
to the deadline itself. Some reasons will be accepted, such as military
deployment or illness, but others, such as family vacation, will not. With
the exception of fully documented medical (or similar) reasons, the
decision to accept late work is at the sole discretion of the instructor.
If the instructor agrees to an extension, the student and instructor must
formalize (in writing) an adjusted deadline schedule. Please note that
turning in missed assignments at the end of the semester will probably
not be acceptable to most instructors - plan accordingly. Additionally,
if the adjusted deadlines are not met, points may be deducted or the
assignment may not be accepted.
Any assignments turned in after the original due date will be graded at
the convenience of the instructor. That could mean that the late
assignment may not be graded until the end of the semester. Because
an exception has been made for that student, the instructor will not be
held to the grading timeline established in the class syllabus. This should
not be considered as an unwillingness to provide feedback in a timely
manner - just recognition that the instructor has a limited amount of
time for grading, and it is inappropriate to expect that work submitted
late will be prioritized over work submitted on time.
Feedback/communication
Please be sure that you have a campus email account (provided at
no cost through CSUMB). My feedback on assignments will be returned
through the CMS or campus email. This is usually done within two
weeks after the work has been submitted. Individualized feedback to
your personal email may be given as needed. If the feedback is unclear
or youd like further guidance, please feel free to contact me. Be sure
to check the CMS for all other returned assignments containing my
feedback.
3

Announcements will also be used to announce required information to

the class so you should check that regularly. In addition I will monitor
the ask your instructor forum for any inquires that are relevant to
the course. This is the best place to post your concerns that might be of
interest to the entire class. Also please help answer the questions if you
happen to know the answer. Please use a direct email message if your
inquiry is of a personal nature.
Drop Date
Students can drop the class for any reason before the end of the Add/
Drop period. After the Add/Drop period, a documented serious and
compelling reason, such as illness or death in the family is required to
drop, and a grade of W will show on your transcript. A serious and
compelling reason is one that affects the students emotional or physical
health, or financial conditions. If you are considering dropping the course
for non-compelling issues, please consult with me for a more complete
discussion.
Academic Honesty
Academic honesty is highly valued at CSUMB. Students must always
submit work that represents their original words, ideas, and design.
If any work used in a class, online posting, or assignment submission
does not represent that student's original words, ideas, or design, all
relevant sources must be cited and, when appropriate, permission to
use the work must be obtained. It must also be made clear the extent to
which such sources were used. Words, ideas, and designs that require
citation and permission include, but are not limited to, all hard copy or
electronic publications, whether copyrighted or not, and all verbal or
visual communication when the content of such communication clearly
originates from an identifiable source.
Online courses promote the publishing of individuals work for the
purpose of critique and/or comment by others. This should not be
construed as an open invitation to use any part of that published work,
whether it is in the form of text, language, ideas, or design format. If, in
fact, a student wishes to borrow or use anything from another students
efforts, it should be treated as any other resource, i.e. prior permission
must be received.
At CSUMB, plagiarism and other forms of academic dishonesty are not
tolerated. Students found by faculty to have breached the academic
integrity policy in any assignment will, at minimum, fail the class.
This breach will be reported to the college administration. As per the
directives established by the CSU Chancellor's Office, should a student
fail a course due to a violation of the academic integrity policy, that
student will not be permitted to repeat the course. Without successful
4

completion of all IST courses, that student will not be allowed to

continue in or graduate from the MIST program.
Please see the CSUMB Catalog for more information about academic
honesty, including consequences of academic dishonesty: http://
policy.csumb.edu/site/x20830.xml
Diversity
The CSUMB Mission Statement is to build a multicultural learning
community founded on academic excellence from which all partners in
the educational process emerge prepared to contribute productively,
responsibly, and ethically to California and the global community.
All students are required to show respect to their fellow students and to
the instructor. While you may not necessarily agree with their beliefs,
you are required to respect that they have them. I encourage you to
share and embrace the multiculturalism of the CSUMB vision statement.
In doing so you will be rewarded with a greater appreciation for this
global community within which we all live and function.
Disabilities and Learning issues
The goal is for you all to have equitable access to succeeding in this
course. Students with disabilities who require accommodations such
as time extension or course material accommodations must present
verification from Student Disability Resources within the first two weeks
of class. If you think a disability may impact your performance in this
class, please contact me before the end of the Add/Drop period. You
are encouraged to make contact with Student Disability Resources at
Student_Disability_Resources@csumb.edu or call them at 831 582-3672
voice, or 582-4024 fax/TTY. More information can be found on their
website at: http://sdr.csumb.edu/