FINAL REPORT

ASSESSMENT AND EVALUATION IN ENGLISH LANGUAGE TEACHING

COMMON VOCABULARY TEST ITEMS

Lecturers:
Drs. Bambang Sugeng, M.Pd., Ph.D.
& Nur Hidayanto Pancoro Setyo Putro S.Pd., M.Pd., Ph.D.

Written By:
Evi Tri Prasetyaningsih 18716251032

ENGLISH EDUCATION STUDY PROGRAM

YOGYAKARTA STATE UNIVERSITY
2019
1. Test Description
Nowadays, children have access to use English in their daily lives. They can
use their parent's mobile phones or their televisions to play YouTube. The contents
of the YouTube channels are mostly in English. Moreover, some of the children
have learned English at school as their local content or obligatory based on the
school program. Therefore, the writer tries to develop a vocabulary test for the
children.
a. Type of the test
The writer developed a vocabulary test. It was about common words which
were taken from the Dolch words list. In the Dolch words list, there are two
categorizations. They are non-noun and noun words. The writer chose 15 words
to be tested. The test was in the form of multiple choices with four options for
each question. The writer provided pictures to suit the subjects of the test or the
test takers.
b. The objective of the test
The test aims to know the children's competence in mastering common
English vocabulary. As the writer had stated before, the children have their
access to know and learn English through the gadget and YouTube channel.
Therefore, the writer wanted to know about the children's competence in
English, especially the common words based on Dolch words list.

2. Test Subjects
a. Subjects’ Description
The subjects of this test were the children in the Sunday School of GKJ
Gayamprit, Klaten. The first target for the participants were the children in the
range of age 7 to 9. However, the children at that age are only 3 or 4 persons.
Therefore, the writer switched the test takers' or subjects' range of age. They
 are in the range of elementary ages. Twelve children participated in this test as
the subjects.
b. Subjects’ Background
The subjects are from middle-high society. They can use their parents'
mobile phones and access YouTube. They have learned English in their school.
They are also the actives children in the church that join Sunday School
activities. The activities are singing in a choir, playing instruments, and dancing
together to be in charge of Sunday services.

3. Process and Result

The writer designed the test from the table of specifications that the writer had
made. Then the writer created the item core to be corrected whether the test items
were correct or wrong by the lecturers. The writer did finishing the items to be
checked the validity. The writer did content validity to the lecturer and revised the
items after being corrected. When the items had been corrected, and the lecturer
agreed to deliver the test, the writer asked the Sunday School teacher to get the time
for doing the test.
The process of the test was held on Sunday, May 12th, 2019. The test took 15
minutes for 15 questions that the writer had made. The subjects had just finished
their services in Sunday School. Twelve children joined in the test. The children
sat on the carpet and made a circle. They listened to the instructions in Bahasa
Indonesia that the writer gave to them. Then they started to do the test after the
writer said: "go." It was because the writer needed to set the timer to make sure that
the children answered the questions as the estimated time. The writer collected the
answers after the children finished answering the questions. Afterward, the writer
gave the children some snacks as a token for them.
The result from the test showed that some of the children could answer the
questions without any mistakes. Several children answered the problems with some
 mistakes. The writer found that two children got 10, and one child got 40. The other
children are in the range of 6,00 to 9,33. The writer provided the full result in the
attachment.

4. Item Analysis
a. Mean
Based on the result of the test, the writer calculated the mean and standard
deviation of the test. The aim to have the mean calculated is to know the level
difficulty of the test. The mean of the test result is 8,1. It means the test is easy to
answer for the subjects of the test. Two children got 100, and one child who got 40
for the lowest score.
b. Standard Deviation
The standard deviation has the aim to know the reliability of the test. As
the writer had stated in the process of having the test, the validity is based on the
content validity by the expert who is the lecturer. The standard deviation is 1.77,
with the reliability coefficient lower than 0.95. It can be considered that the test is
reliable.
c. Standard Error Measurement
The writer calculated the Standard Error Measurement (SEM) based on the
standard deviation (SD) that already checked. The way to get SEM is SD/√N. The
calculation is 1.77/√12 = 1.8/3.46 = 0.51.
d. Item Difficulty
There are two levels of difficulty found in the test. The levels are easy and
moderately difficult. There are ten items (1, 3, 6, 7, 8, 5, 14, 9, 10, and 13) which
are categorized as low level of difficulty. Five items (2, 4, 11, 12, and 15) are
classified as moderately difficult. There is no difficult item level because of the
writer aimed for testing children so that the writer created moderately difficult as
the most difficult item.
 e. Discriminating Power
There are three kinds of item quality found in the test. There are four items
(11, 12, 13, and 15) that have quiet satisfactorily quality in the test. The good
quality items are three items (4, 9, and 10). 9 items categorized as poor items which
are item number 1, 2, 3, 4, 5, 6, 7, 8 and 14. Most of the items need to be eliminated
and corrected.

5. Conclusion
Based on the item analysis that the writer had done, the vocabulary test that
the writer made is reliable and valid. However, some items need to be eliminated
or change because of the poor quality of the items. The difficulty levels of the items
are already the same as the expectation of the writer. It can be concluded that the
vocabulary test still needs to be modified.