Trace lines for classification decisions.
TL;DR: The authors analyzed referral, placement, and retention decisions using item response theory (IRT) to investigate whether classification decisions could be placed on the latent continuum of ability normally associated with test items.
read more
Abstract: Referral, placement, and retention decisions were analyzed using item response theory (IRT) to investigate whether classification decisions could be placed on the latent continuum of ability normally associated with test items. A second question pertained to the existence of classification differential item functioning (DIF) for the various decisions. When the decisions were calibrated, the resulting "item" parameters were similar to those that might be expected from conventional test items. For classification DIF analyses, referral decisions for ethnicity were found to be functioning differently for Whites versus non-Whites. Analyzing decisions represents a new unit of analysis for IRT and represents a powerful methodology that could be applied to a variety of new problem types.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Liberal and Conservative Differential Item Functioning Detection Using Mantel-Haenszel and SIBTEST: Implications for Type I and Type II Error Rates
TL;DR: In this paper, the authors performed a simulation study in which the Mantel-Haenszel and SIBTEST procedures were applied in conjunction, and the results indicated that although there was a high rate of agreement between the procedures, the joint Type I and Type II error rate may vary substantially from that obtained when each of the procedures was applied separately.
27
Applications of Decision Theory to Test-Based Decision Making. Project Psychometric Aspects of Item Banking No. 23. Research Report 87-9.
van der Linden,J Wim +1 more
- 01 Dec 1987
TL;DR: The use of tests has its roots in the necessity for selection and placement decisions in education, the army, and public administration as mentioned in this paper, and it is no coincidence that, in each of these fields, decision making is characterized both by high visibility and a massive number of examinees.
Nonparametric item response modeling for identifying differential item functioning in the moderate-to-small-scale testing context
Petronilla Murlita Witarsa
- 01 Jan 2003
TL;DR: In this paper, the authors investigated the Type I error rate of the nonparametric IRT DIF detection method, when applied to moderate-to-small-scale testing context wherein there were 500 or fewer examinees in a group.
An Analysis of Differential Item Functioning Based on Calculator Type.
Richard D. Schwarz,Changhua Rich,Ethan Arenson,Tracy Podrabsky,Gary Cook +4 more
- 01 Apr 2002
TL;DR: Schwarz, Richard, Rich, Changhua, Arenson, Ethan, Podrabsky, Tracy, Cook, and Cook as discussed by the authors presented an analysis of differential item functioning based on Calculator Type.
Modeling Diagnostic Expertise in Cases of Irreducible Uncertainty: The Decision-Aligned Response Model
TL;DR: In this article , the authors presented a decision-aligned response model that demonstrates the confusability of a particular electrocardiogram and the skill with which a clinician can distinguish 2 diagnoses along a continuum of confusion.
1
References
Statistical Aspects of the Analysis of Data From Retrospective Studies of Disease
Nathan Mantel,William Haenszel +1 more
TL;DR: In this paper, the role and limitations of retrospective investigations of factors possibly associated with the occurrence of a disease are discussed and their relationship to forward-type studies emphasized, and examples of situations in which misleading associations could arise through the use of inappropriate control groups are presented.
15.6K
•Book
Applications of Item Response Theory To Practical Testing Problems
Frederic M. Lord
- 01 Jul 1980
TL;DR: The application of item response theory to practical testing problems is discussed in this article, where the authors present an example of the application of the theory to real-world testing problems in a practical setting.
5.6K
•Book
Some latent trait models and their use in inferring an examinee's ability
A. L. Birnbaum
- 01 Jan 1968
2.4K