Applying Computerized Adaptive Testing to the Negative Acts Questionnaire-Revised: Rasch Analysis of Workplace Bullying

doi:10.2196/jmir.2819

CNU IR > College of Smart Living > Dept. of Hospital and Health (including master's program) > Periodical Articles > Item 310902800/28508

Please use this identifier to cite or link to this item: https://ir.cnu.edu.tw/handle/310902800/28508

Title:	Applying Computerized Adaptive Testing to the Negative Acts Questionnaire-Revised: Rasch Analysis of Workplace Bullying
Authors:	Ma, Shu-Ching Chien, Tsair-Wei Wang, Hsiu-Hung Li, Yu-Chi Yui, Mei-Shu
Contributors:	醫務管理系
Keywords:	computerized adaptive testing computer on wheels classic test theory item response theory nonadaptive testing the Negative Acts Questionnaire-Revised
Date:	2014-02
Issue Date:	2015-05-06 21:18:49 (UTC+8)
Publisher:	Jmir Publications, Inc
Abstract:	Background: Workplace bullying is a prevalent problem in contemporary work places that has adverse effects on both the victims of bullying and organizations. With the rapid development of computer technology in recent years, there is an urgent need to prove whether item response theory-based computerized adaptive testing (CAT) can be applied to measure exposure to workplace bullying. Objective: The purpose of this study was to evaluate the relative efficiency and measurement precision of a CAT-based test for hospital nurses compared to traditional nonadaptive testing (NAT). Under the preliminary conditions of a single domain derived from the scale, a CAT module bullying scale model with polytomously scored items is provided as an example for evaluation purposes. Methods: A total of 300 nurses were recruited and responded to the 22-item Negative Acts Questionnaire-Revised (NAQ-R). All NAT (or CAT-selected) items were calibrated with the Rasch rating scale model and all respondents were randomly selected for a comparison of the advantages of CAT and NAT in efficiency and precision by paired t tests and the area under the receiver operating characteristic curve (AUROC). Results: The NAQ-R is a unidimensional construct that can be applied to measure exposure to workplace bullying through CAT-based administration. Nursing measures derived from both tests (CAT and NAT) were highly correlated (r=.97) and their measurement precisions were not statistically different (P=.49) as expected. CAT required fewer items than NAT (an efficiency gain of 32%), suggesting a reduced burden for respondents. There were significant differences in work tenure between the 2 groups (bullied and nonbullied) at a cutoff point of 6 years at 1 worksite. An AUROC of 0.75 (95% CI 0.68-0.79) with logits greater than -4.2 (or >30 in summation) was defined as being highly likely bullied in a workplace. Conclusions: With CAT-based administration of the NAQ-R for nurses, their burden was substantially reduced without compromising measurement precision.
Relation:	Journal of Medical Internet Research, v.16 n.2, e50
Appears in Collections:	[Dept. of Hospital and Health (including master's program)] Periodical Articles

Files in This Item:

File	Description	Size	Format
index.html		0Kb	HTML	1856	View/Open

Loading...