Content-Valid Test Construction Project (Draft)

39504This project involves the creation of a content-valid test about the topic of “reliability” and an accompanying report. Use information you learned in the course to develop your items. The draft of this project should be as complete as possible to allow for feedback provided to you to make any necessary adjustments for the final submission.

Report Specifications
* For this assignment, imagine that you were contracted to develop a content-valid test (with the content being reliability) for Tests and Measures Testing Corporation to be used in future Tests and Measures courses
* Discuss in detail the steps you would take to administer your test to a pilot sample
* Write a two- to four-page report in APA (current edition) format documenting the steps you took to develop your content-valid test and the steps you would take if you were to administer the test
* Also, be sure to include the following components in your report
Introduction and purpose of the test development
Background on reliability (explain and define what reliability is)
Item development process
Proposed method of administration
Discuss in detail the steps you would take to administer your test to a pilot sample (moved this here since a number of students missed it)
Conclusion and recommendations
References in APA (current edition) format
Appendix with
Difficulty index and discrimination index using the data provided in Table 1. (showing your work)
The test you developed and administration/scoring instructions
Answer key
Test Specifications
Your test should be made up of 10 multiple-choice items, all assessing the construct of “reliability” (please note: all the items you create should be about the topic of “reliability”; therefore, your test should assess individuals’ knowledge of reliability; you are not simply creating a reliable test), with four answer choices for each item. Use knowledge, principle, and application item types. Follow the item writing guidelines presented in the “Considerations For Writing Quality Test Items” video.

Difficulty Index and Discrimination Index
Use the hypothetical data provided below to calculate a difficulty index and discrimination index for each item (using the correct response you have identified for each item).

Table 1.
Group A B C D Total
High Group 34 32 56 43 165
Low Group 31 46 44 44 165
Total 65 78 100 87 330