Table 4. Estimated probability of success for the least and most consistent standard setters in test 2
Item SS 2 SS 4
AR CP Max.err AR CP Max.err
1 0.35 0.48 0.52 0.4 0.60 0.60
2 0.45 0.39 0.61 0.6 0.47 0.53
3 0.7 0.75 0.75 0.85 0.90 0.90
4 0.5 0.35 0.65 0.65 0.43 0.57
5 0.5 0.40 0.60 0.4 0.51 0.51
6 0.35 0.48 0.52 0.4 0.62 0.62
7 0.5 0.43 0.57 0.7 0.53 0.53
8 0.7 0.75 0.75 0.8 0.87 0.87
9 0.2 0.23 0.77 0.3 0.24 0.76
10 0.4 0.28 0.72 0.5 0.29 0.71
11 0.5 0.35 0.65 0.8 0.41 0.59
12 0.5 0.21 0.79 0.6 0.21 0.79
13 0.45 0.53 0.53 0.6 0.61 0.61
14 0.5 0.44 0.56 0.5 0.54 0.54
15 0.4 0.27 0.73 0.5 0.28 0.72
16 0.6 0.73 0.73 0.5 0.85 0.85
17 0.5 0.33 0.67 0.8 0.38 0.62
18 0.3 0.43 0.57 0.3 0.52 0.52
19 0.35 0.39 0.61 0.6 0.49 0.51
20 0.4 0.36 0.64 0.5 0.41 0.59

Note: SS=standard setter; AR=Original Angoff rating; CP=Conditional Probability. Max.err=The maximum absolute value of the error of specification.

Int J Med Educ. 2023; 14:123-130; doi: 10.5116/ijme.64ed.e296