Escolar Documentos
Profissional Documentos
Cultura Documentos
MUHAMMAD FATHONI
Report created on 4/19/2017
1. Specifications
2. Summary statistics
3. Item-by-item results.
The statistical output is also recorded in a comma-separated value (CSV) file of the same name.
Specifications
The Windows paths for the input files used in this analysis were:
The Windows paths for the output files produced by this analysis were:
Table 1 presents the specifications and basic information concerning the analysis. This provides
important documentation of the setup of the program for historical purposes.
Table 1: Specifications
Summary statistics
Table 2 presents the summary statistics of the test, for the scored items. Definitions of these
statistics are found in the Iteman manual.
Table 3 presents a reliability analysis of the tests. Alpha (also known as KR-20) is the most
commonly used index of reliability, and is therefore used to calculate the standard error of
measurement (SEM) on the raw score scale. Also presented are three configurations of split-half
reliability, first as uncorrected correlations, and then as Spearman-Brown (S-B) corrected
correlations. This is because an uncorrected split-half correlation is referenced to a "test" that
only contains half as many items as the full test, and therefore underestimates reliability.
Table 3: Reliability
Score Alpha SEM Split-Half Split-Half Split-Half S-B S-B First- S-B Odd-
(Random) (First-Last) (Odd-Even) Random Last Even
Scored items 0.653 2.167 0.127 0.687 0.060 0.225 0.815 0.114
Table 4 presents the item statistics and flags for the item(s) that were flagged during the analysis
Figure 1 displays the distribution of the raw scores for the scored items across all domains.
Table 5 displays the frequency distribution for total score shown in Figure 1.
Figure 1: Total score for the scored items
Score Frequency
11 1
12 1
13 4
14 2
15 1
16 0
17 0
18 3
19 2
20 2
21 2
22 2
Figure 2 displays the distribution of the P values for the dichotomously scored items
(correct/incorrect).
Table 6 displays the frequency distribution of the P values shown in Figure 2.
Score Frequency
0.0 to 0.1 5
0.1 to 0.2 3
0.2 to 0.3 3
0.3 to 0.4 1
0.4 to 0.5 2
0.5 to 0.6 4
0.6 to 0.7 2
0.7 to 0.8 1
0.8 to 0.9 2
0.9 to 1.0 6
Figure 3 displays the distribution of the Point-Biserial Correlations for the dichotomously scored
items (correct/incorrect). Table 7 displays the frequency distribution of the Point-Biserial
correlations shown in Figure 3.
Score Frequency
-0.7 to -0.6 1
-0.6 to -0.5 2
-0.5 to -0.4 1
-0.4 to -0.3 1
-0.3 to -0.2 2
-0.2 to -0.1 1
-0.1 to 0.0 1
0.0 to 0.1 7
0.1 to 0.2 1
0.2 to 0.3 2
0.3 to 0.4 3
0.4 to 0.5 3
0.5 to 0.6 4
0.6 to 0.7 0
0.7 to 0.8 3
0.8 to 0.9 2
0.9 to 1.0 0
Figure 4 displays the scatterplot of P (difficulty) by Rpbis (discrimination) for the dichotomously
scored items (correct/incorrect).
Figure 4: P by Rpbis
Figure 5 displays a graph of the Conditional Standard Error of Measurement (CSEM) Formula IV.
Figure 5: CSEM
Item-by-item results
The following section presents the item-by-item results of the analysis. Each item has several
tables and a figure. The figure, called a quantile plot, shows the proportion of examinees
selecting each option, for consecutive segments of the examinees as ranked by score. The key
thing to evaluate in this figure is that the line for the correct answer has a positive slope (goes up
from left to right), which means that examinees with higher scores tend to answer correctly more
often. Conversely, the lines for the incorrect options, called distractors, should have a negative
slope. Note, however, that the use of a small number of groups (e.g., 3 or fewer) oversimplifies
the graph, so that items which are very difficult or very easy (that is, discriminating in only the top
or bottom 20% of examinees) might appear to have poor quantile plots and classical statistics.
For such items, item response theory presents significant advantages in analysis
1. Item information table: records the information supplied by the control file (or Iteman 3 header)
for this
item.
2. Item statistics table: overall item statistics.
3. Option statistics: detailed statistics for each item, which helps diagnose issues in items with
poor
statistics.
4. Quantile plot data: the values used to create the quantile plot.
The item statistics table presents overall item statistics in the first row of numbers. The two most
important item-level statistics for dichotomously scored (correct/incorrect) items are the P value
and the point-biserial correlation, which represent the difficulty and discrimination of the item,
respectively. For polytomously scored (rating scale or partial credit) items, the difficulty is
represented by the mean (average) item score, while the discrimination is represented by a
Pearson r correlation.
The P value is the proportion of examinees that answered an item in the keyed direction. P
ranges from 0 to 1. A high value (0.95) means that an item is easy, a low value (0.25) means that
the item is difficult. The point-biserial correlation (Rpbis) is a measure of the discriminating, or
differentiating, power of the item. Rpbis ranges from -1 to 1. A negative Rpbis is indicative of a
bad item as lower scoring examinees are more likely than higher scoring examinees to respond in
the keyed direction.
For rating scale or partial credit items, the mean item score ranges from the minimum to the
maximum of the scale. For example, if the item has a rating scale of 1 to 5, the possible range for
the mean is 1 to 5. The Pearson r is similar to the Rpbis in that it ranges from -1 to 1, with a
positive r indicating that the item correlates well with total score.
The option statistics table presents statistics for each individual option (alternative). The key
thing to examine in this portion of the table is that no distractors have a higher Rpbis than the
correct answer. That indicates that higher scoring examinees are selecting the incorrect answer,
which therefore might be arguably correct.
The quantile plot data table simply presents the values calculated to create the quantile plot.
Because it contains the same information, the quantile plot itself presents a useful picture of the
item's performance, but this table can be used to examine that performance in detail to help
diagnose possible issues.
Item information
Seq. ID Key Scored Num Options Domain Flags
1 Soal01 D Yes 5 TGM
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.150 0.378 0.579 0.631
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 5 0.250 -0.560 -0.763 13.400 0.548 Maroon
B 6 0.300 0.231 0.305 17.833 3.920 Green
C 2 0.100 -0.114 -0.195 15.500 3.536 Blue
D 3 0.150 0.378 0.579 20.667 1.354 Olive **KEY**
E 4 0.200 0.089 0.128 17.250 4.193 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.050 -0.370 -0.782 0.672
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 8 0.400 0.029 0.036 16.875 3.441 Maroon
B 1 0.050 -0.370 -0.782 12.000 1.000 Green **KEY**
C 3 0.150 0.461 0.707 20.667 2.309 Blue
D 1 0.050 0.080 0.170 18.000 0.000 Olive
E 7 0.350 -0.243 -0.312 15.571 3.735 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.300 -0.585 -0.771 0.713
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 8 0.400 0.137 0.173 17.125 3.563 Green
C 6 0.300 -0.585 -0.771 14.167 2.229 Blue **KEY**
D 4 0.200 0.201 0.287 18.000 4.690 Olive
E 2 0.100 0.402 0.687 21.000 0.000 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.150 0.292 0.447 0.637
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 3 0.150 0.292 0.447 20.000 2.121 Maroon **KEY**
B 7 0.350 -0.761 -0.980 13.143 0.690 Green
C 3 0.150 0.499 0.764 20.667 2.309 Blue
D 1 0.050 0.092 0.194 18.000 0.000 Olive
E 6 0.300 0.132 0.174 17.333 3.615 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.000 0.000 0.000 0.653
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon **KEY**
B 4 0.200 0.172 0.245 18.000 4.243 Green
C 7 0.350 -0.018 -0.023 16.714 3.684 Blue
D 7 0.350 -0.438 -0.564 14.714 2.289 Olive
E 2 0.100 0.496 0.848 22.000 0.000 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.700 0.349 0.459 0.630
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 14 0.700 0.349 0.459 17.857 3.920 Maroon **KEY**
B 1 0.050 -0.145 -0.307 14.000 0.000 Green
C 4 0.200 -0.279 -0.398 14.250 2.500 Blue
D 1 0.050 -0.076 -0.161 15.000 0.000 Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.000 0.000 0.000 0.653
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon **KEY**
B 11 0.550 -0.483 -0.607 15.273 3.349 Green
C 2 0.100 -0.076 -0.130 16.000 2.828 Blue
D 0 0.000 -- -- -- -- Olive
E 7 0.350 0.552 0.711 19.429 3.207 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.450 -0.202 -0.254 0.685
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 9 0.450 -0.202 -0.254 16.556 3.264 Green **KEY**
C 8 0.400 0.493 0.626 18.500 4.036 Blue
D 3 0.150 -0.395 -0.606 13.000 0.000 Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 1.000 0.000 0.000 0.653
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 20 1.000 0.000 0.000 16.800 3.820 Green **KEY**
C 0 0.000 -- -- -- -- Blue
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.550 -0.483 -0.607 0.710
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 11 0.550 -0.483 -0.607 15.636 3.867 Green **KEY**
C 3 0.150 0.312 0.479 19.000 3.464 Blue
D 2 0.100 0.203 0.347 18.500 0.707 Olive
E 4 0.200 0.169 0.242 17.500 4.359 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.950 0.257 0.543 0.644
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 1 0.050 -0.257 -0.543 12.000 0.000 Green
C 0 0.000 -- -- -- -- Blue
D 0 0.000 -- -- -- -- Olive
E 19 0.950 0.257 0.543 17.053 3.741 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.000 0.000 0.000 0.653
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 1 0.050 -0.381 -0.804 11.000 0.000 Green
C 19 0.950 0.381 0.804 17.105 3.510 Blue
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.550 0.820 1.000 0.574
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 9 0.450 -0.820 -1.000 13.444 1.944 Maroon
B 0 0.000 -- -- -- -- Green
C 0 0.000 -- -- -- -- Blue
D 11 0.550 0.820 1.000 19.545 2.318 Olive **KEY**
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.750 0.579 0.789 0.608
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 0 0.000 -- -- -- -- Green
C 15 0.750 0.579 0.789 18.133 3.388 Blue **KEY**
D 1 0.050 -0.358 -0.756 11.000 0.000 Olive
E 4 0.200 -0.432 -0.617 13.250 0.500 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.700 0.597 0.787 0.604
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 4 0.200 -0.443 -0.633 13.250 0.500 Maroon
B 0 0.000 -- -- -- -- Green
C 1 0.050 -0.292 -0.618 12.000 0.000 Blue
D 1 0.050 -0.150 -0.317 14.000 0.000 Olive
E 14 0.700 0.597 0.787 18.357 3.455 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.250 -0.697 -0.950 0.718
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 15 0.750 0.697 0.950 18.067 3.369 Green
C 5 0.250 -0.697 -0.950 13.000 1.323 Blue **KEY**
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.900 0.334 0.572 0.636
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 18 0.900 0.334 0.572 17.278 3.707 Maroon **KEY**
B 1 0.050 -0.196 -0.415 13.000 0.000 Green
C 1 0.050 -0.264 -0.558 12.000 0.000 Blue
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.350 -0.005 -0.006 0.664
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 3 0.150 0.269 0.411 18.667 4.041 Maroon
B 0 0.000 -- -- -- -- Green
C 9 0.450 -0.088 -0.111 16.111 3.983 Blue
D 1 0.050 -0.228 -0.483 13.000 0.000 Olive
E 7 0.350 -0.005 -0.006 17.429 3.481 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.650 -0.118 -0.152 0.675
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 1 0.050 -0.205 -0.434 13.000 0.000 Maroon
B 2 0.100 0.460 0.786 21.000 0.000 Green
C 3 0.150 -0.177 -0.271 14.667 3.055 Blue
D 1 0.050 0.121 0.255 18.000 0.000 Olive
E 13 0.650 -0.118 -0.152 16.846 3.944 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 1.000 0.000 0.000 0.653
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 20 1.000 0.000 0.000 16.800 3.820 Green **KEY**
C 0 0.000 -- -- -- -- Blue
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.100 0.426 0.728 0.630
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0.100 0.426 0.728 22.000 1.414 Maroon **KEY**
B 1 0.050 -0.184 -0.389 14.000 0.000 Green
C 6 0.300 -0.558 -0.735 13.833 2.137 Blue
D 2 0.100 0.426 0.728 21.000 0.000 Olive
E 8 0.400 0.012 0.015 16.750 3.370 Gray
Omit 1 0.050 0.100 0.212 19.000 0.000
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.800 0.414 0.592 0.626
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 0 0.000 -- -- -- -- Green
C 16 0.800 0.414 0.592 17.688 3.737 Blue **KEY**
D 4 0.200 -0.414 -0.592 13.250 0.500 Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 1.000 0.000 0.000 0.653
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 0 0.000 -- -- -- -- Green
C 0 0.000 -- -- -- -- Blue
D 20 1.000 0.000 0.000 16.800 3.820 Olive **KEY**
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.650 0.520 0.669 0.611
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 0 0.000 -- -- -- -- Green
C 7 0.350 -0.520 -0.669 13.857 1.952 Blue
D 0 0.000 -- -- -- -- Olive
E 13 0.650 0.520 0.669 18.385 3.583 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.600 -0.212 -0.269 0.685
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 12 0.600 -0.212 -0.269 16.583 4.033 Maroon **KEY**
B 7 0.350 0.341 0.440 17.857 3.132 Green
C 1 0.050 -0.270 -0.572 12.000 0.000 Blue
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.050 0.016 0.035 0.655
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 1 0.050 0.082 0.174 18.000 0.000 Maroon
B 1 0.050 0.016 0.035 18.000 1.000 Green **KEY**
C 2 0.100 -0.406 -0.695 12.500 0.707 Blue
D 1 0.050 -0.115 -0.243 15.000 0.000 Olive
E 15 0.750 0.290 0.395 17.333 3.867 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.200 0.599 0.856 0.609
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0.100 -0.113 -0.193 15.500 3.536 Maroon
B 4 0.200 0.599 0.856 21.500 1.291 Green **KEY**
C 8 0.400 0.038 0.048 16.750 3.615 Blue
D 1 0.050 0.099 0.209 18.000 0.000 Olive
E 5 0.250 -0.568 -0.774 13.400 0.548 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.400 0.779 0.988 0.580
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 8 0.400 0.779 0.988 20.375 1.768 Maroon **KEY**
B 3 0.150 -0.278 -0.426 14.333 4.163 Green
C 2 0.100 -0.150 -0.256 15.000 4.243 Blue
D 0 0.000 -- -- -- -- Olive
E 7 0.350 -0.497 -0.641 14.286 1.799 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.800 0.184 0.262 0.646
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 0 0.000 -- -- -- -- Maroon
B 2 0.100 0.147 0.251 17.500 3.536 Green
C 16 0.800 0.184 0.262 17.313 3.719 Blue **KEY**
D 1 0.050 -0.202 -0.427 13.000 0.000 Olive
E 1 0.050 -0.337 -0.712 11.000 0.000 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.500 0.880 1.000 0.566
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0.100 -0.359 -0.613 13.000 1.414 Maroon
B 3 0.150 -0.132 -0.203 15.333 2.517 Green
C 0 0.000 -- -- -- -- Blue
D 10 0.500 0.880 1.000 20.000 1.826 Olive **KEY**
E 5 0.250 -0.659 -0.897 12.800 1.095 Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.200 -0.587 -0.839 0.705
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0.100 -0.144 -0.246 15.000 4.243 Maroon
B 11 0.550 0.771 0.969 19.182 3.060 Green
C 3 0.150 -0.295 -0.452 14.000 1.000 Blue
D 0 0.000 -- -- -- -- Olive
E 4 0.200 -0.587 -0.839 13.250 1.258 Gray **KEY**
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.600 0.772 0.978 0.580
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 12 0.600 0.772 0.978 19.167 2.887 Maroon **KEY**
B 5 0.250 -0.629 -0.857 12.800 1.095 Green
C 0 0.000 -- -- -- -- Blue
D 3 0.150 -0.296 -0.453 14.000 1.000 Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.900 0.436 0.746 0.630
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 2 0.100 -0.436 -0.746 11.500 0.707 Maroon
B 18 0.900 0.436 0.746 17.389 3.534 Green **KEY**
C 0 0.000 -- -- -- -- Blue
D 0 0.000 -- -- -- -- Olive
E 0 0.000 -- -- -- -- Gray
Omit 0
Not Admin 0
Item statistics
N P Total Total Rbis Alpha w/o
Rpbis
20 0.550 0.783 0.985 0.578
Option statistics
Option N Prop. Rpbis Rbis Mean SD Color
A 1 0.050 -0.313 -0.662 12.000 0.000 Maroon
B 5 0.250 -0.640 -0.872 12.800 1.095 Green
C 11 0.550 0.783 0.985 19.455 2.524 Blue **KEY**
D 1 0.050 0.129 0.273 18.000 0.000 Olive
E 2 0.100 -0.241 -0.412 14.000 1.414 Gray
Omit 0
Not Admin 0