Exercise 11.1 How Do you Interpret the Data Collected from a Quantitative Item Analysis

1-identify what test item should be kept.

(Selected items are highlighted in yellow color)

Item number	Average Inter item correlation	Difficulty	Discrimination index	Rationale
1	.40	.90	10	_
2	.38	.50	60	Item difficulty level is .5 range in between .3 to .7
3	.05	.50	19	Item difficulty level is .5 range in between .3 to .7
4	.30	.48	-2	_
5	.50	.50	50	Item difficulty level is .5 range in between .3 to .7
6	.01	.98	0	_
7	.60	.60	48	Item difficulty level is .5 range in between .3 to .7
8	.00	.10	10	_
9	.55	.49	40	Item difficulty level is .5 range in between .3 to .7
10	.30	.61	-5	Item difficulty level is .5 range in between .3 to .7
11	.44	.51	80	Item difficulty level is .5 range in between .3 to .7
12	-.10	.66	7	Item difficulty level is .5 range in between .3 to .7
13	.40	.55	75	Item difficulty level is .5 range in between .3 to .7
14	.77	.43	-10	_
15	.71	.71	60	_
16	.33	.56	40	Item difficulty level is .5 range in between .3 to .7
17	.00	.2	15	_
18	.22	.35	60	_
19	.55	.43	70	_
20	.04	.40	18	_

 

2- Calculate difficulty and discrimination index.

 

STUDENT	Item 1	Item 2	Item 3	Item 4	Item 5	Item 6	Item 7	Item 8	Item 9	Item 10	SCORE
1	1	1	0	1	1	0	1	1	0	1	7
2	0	0	0	1	0	0	0	0	1	1	3
3	0	0	1	1	0	0	1	1	0	1	5
4	0	0	0	0	0	0	1	0	0	1	2
5	1	1	0	1	0	0	1	1	1	1	7
6	1	1	1	1	1	1	1	1	1	1	10
7	1	0	1	1	0	1	0	1	0	1	6
8	1	1	1	1	1	1	1	1	0	1	9
9	0	1	1	1	1	1	1	1	1	1	9
10	0	0	0	1	0	1	1	1	1	1	6
11	0	0	0	1	0	0	0	0	0	0	1
12	0	1	1	1	1	1	1	1	1	1	9
13	1	1	1	1	1	1	1	1	1	1	10
14	0	1	0	1	0	1	1	1	1	1	7
15	1	1	1	1	0	1	0	1	1	1	8
16	0	1	0	1	0	0	0	0	0	0	2
17	0	0	0	0	0	0	0	0	0	0	0
18	1	1	1	0	0	1	1	1	0	0	6
P  (Item difficulty)	.44	.61	.5	.83	.33	.55	.66	.72	.5	.77
D  (Item discriminatory)	-.5	-.38	-.5	-.16	-.66	-.44	-.33	-.27	-.5	-.22

 

Exercise 11.2 Identify the correct Statistical Analysis

 

1- Choosing the right statistic.

 

Research question	Appropriate statistical analysis
Does this item measure the same constructs as other items do?	Item Validity Index
Is this item easier than for women ?	Item Characteristic Curve
Does this item provide information that helps predict a criterion	Item Validity Index
How difficult is this item?	Item Difficulty Index
If I drop this item from the test, will it increase or decrease internal reliability?	Item Reliability Index
How did the people who did well on this test do on this item?	Item Discriminatory Index
Is this item of sufficient difficulty and does it discriminate between high and low performers on the test?	Item Discriminatory Index
Is this biased on the minority group?	Item Characteristic Curve
How well does the answer on this item correlate the	Item Reliability Index
Individual’s overall test score?	Item Analysis

 

Exercise 11.6 Reflect on your Learning

 

1- Identify your ‘’Aha’’ moments from chapter 11.

Insight and realizations:

➔   I have learned the test construction and development of psychological tests.

➔   In this chapter I discover the concepts and implementations of statistical analysis in psychological testing.

➔   I have also learned the process of testing the items.

 

2- identify some muddy moments and discussion based Questions.

These are some muddy moments and questions that arrive in my mind during learning the chapter 11:

➔   What are the specific requirements of revising a test and why is there a need to revise a test?

➔   How to select a scaling method for the development of a Psychological test?

How to develop a test manual and what steps involved in preparing the manual of a test.