Crowdsourcing is an essential data collection method for psychological research. Concerns about the validity and quality of crowdsourced data persist, however. A recent documented increase in the number of invalid responses within crowdsourced data has highlighted the need for quality control measures. Although a number of approaches are recommended, few have been empirically evaluated. The present study evaluated a Cyborg Method that used automated evaluation of participant meta-data and a review of short answer responses. Two samples were recruited - in the first, the Cyborg Method was applied after data collection to gauge the extent to which invalid responses were collected when 

The Cyborg Method: A Method to Identify Fraudulent Responses from Crowdsourced Data

Development and validation of a mental eHealth literacy scale

PURPOSE
This study aimed to generate the health state classification system (HCS) of a condition-specific preference-based measure to capture the health-related quality of life (HRQoL) of patients with myasthenia gravis (MG) from the 15-item Myasthenia Gravis Quality of Life Scale (MG-QoL15r).


MATERIALS AND METHODS
An HCS was derived from the MG-QoL15r in a large sample of 1739 patients with MG based on psychometric analysis, including factor analysis, item response theory analysis, and discussions with experts. Reliability, construct and convergent validity, and item fit of the HCS were further assessed using another sample.


RESULTS
The HCS has six dimensions: social activity, hobbies and fun activities, meeting family needs, work performance, mobility, and emotion, and it demonstrates good internal consistency reliability. The unidimensionality of the HCS was confirmed using confirmatory factor analysis. Satisfied convergent validity was supported by a significant association with the 12-item Short Form Survey (SF-12).


CONCLUSIONS
Based on a solid process of development and consultations with clinical professionals and patients, a valid MG-specific preference-based measure, MGQoL-6D, was developed. Further research will estimate the local preference weight to support the MG-related cost-utility analysis.IMPLICATION FOR REHABILITATIONA new condition-specific health state classification system (HCS) named Myasthenia gravis Quality of Life Scale (MGQoL-6D) is proposed.MGQoL-6D classifies MG health states as a combination of six dimensions with three response levels.The dimensions of the HCS are social activity, hobbies and fun activity, family needs, work performance, mobility, and emotion.The HCS and the upcoming value set of the MGQoL-6D could support the cost-effectiveness analysis of MG-related clinical and rehabilitated interventions.

Developing the health state classification system for a condition-specific preference-based measure for patients with myasthenia gravis.

Objective This study aimed to develop a short version of the Chinese Resident Health Literacy Scale focused on older adults in China, and further assess the reliability and validity of this short version. Methods The data was from a cross-sectional community-based older adults health survey conducted in 2020. The total of 5,829 older adults were randomly divided into two parts using for the simplification and assessment of the scale, respectively. Item Response Theory (IRT) and Differential Item Functioning (DIF) were used for item analysis and scale simplification. Cronbach’s alpha and McDonald’s omega were used to assess the reliability and three factors Confirmatory Factor Analysis (CFA) was used to assess the validity, which were compared to the original version. Moreover, Multi-group Confirmatory Factor Analysis (MCFA) was used to test the model invariance of the short version across groups of gender, age groups, level of education, and cognitive status. Results The simplified version consisted of 27 items taken from 50 original items, of them 11 items from the dimension of knowledge and attitudes, 9 items from the dimension of behavior and lifestyle, and 7 items from the dimension of health-related skills. The overall Cronbach’s alpha and McDonald’s omega were both 0.87 (95%CI: 0.86–0.88). The goodness-of-fits of CFA in simplified version were still acceptable in CFI, TLI, GFI, and RMSEA, even improved in CFI, TLI, and GFI compared to those of original version. Also, the model was stable and invariant in MCFA across gender, cognitive status, and educational level groups. Conclusion In this study, we formed a simplified instrument for measuring health literacy focused on older adults in China. This short version might be more suitable for the priority recommendation in extended tracking of the dynamic changes on the levels of health literacy in the whole life cycle in public health settings. Further research might be to identify the cut-off values to distinguish the older adults with different levels of health literacy.

https://www.frontiersin.org/articles/10.3389/fpubh.2023.1147862/pdf

Revised Chinese resident health literacy scale for the older adults in China: simplified version and initial validity testing

Crowdsourcing has become an essential data collection method for psychological research, especially when access to pools of participant are limited by location and resources. Concerns about the validity and quality of crowdsourced data persist, however. A recent documented increase in the number of invalid responses within crowdsourced data has highlighted the need for quality control measures. Although a number of approaches are recommended, few have been empirically evaluated. The present study evaluated a Cyborg Method that used automated evaluation of participant meta-data and a review of short answer responses. Two samples were recruited – in the first, the Cyborg Method was applied after data collection to gauge the extent to which invalid responses were collected when a priori quality controls were absent. In the second, the Cyborg Method was applied during data collection to determine if the method would proactively screen invalid responses. Results suggested that Cyborg Method identified a substantial portion of invalid responses and both automated and human evaluation components was necessary. Furthermore, the Cyborg Method could be applied proactively to screen invalid responses and substantially reduced the per participant cost of data collection. These results suggest that the Cyborg Method is a promising means by which to collect high quality crowdsourced data. 

The Posttrauma Risky Behaviors Questionnaire (PRBQ) assesses extent of engagement in posttrauma reckless and self-destructive behaviors (RSDBs). Given PRBQ's recent development with limited psychometric investigations, we used item response theory to examine (a) item analysis, (b) person fit, and (c) differential item functioning (DIF) across gender-based groups and two different samples. One sample included 464 participants reporting potentially traumatic experiences (Mechanical Turk [MTurk], recruited online), and the other sample included 171 trauma-exposed women reporting current intimate partner violence and substance use (recruited in-person). All PRBQ items contributed to the RSDB scale, and all PRBQ items and the PRBQ scale provided maximum information for high levels of the RSDB latent trait. Seven and 11 items were conceptualized as low information items in the MTurk and intimate partner violence samples, respectively. Eight MTurk participants' responses did not fit the overall pattern of responses as expected. Seven items were flagged for DIF between the two samples, and eight items were flagged for DIF between men and women in the MTurk sample. However, all effect sizes were <8%. Conclusively, results suggest good psychometric properties for the PRBQ and support its use to compare RSDBs across different samples and gender-based groups.

/pdf/psychometric-evaluation-of-the-posttrauma-risky-behaviors-i95xmeuaw6.pdf

Psychometric Evaluation of the Posttrauma Risky Behaviors Questionnaire: Item Response Theory Analyses

Handle everyday research tasks with reliable, citation-backed results

Your personal Research Agent to handle research tasks with citation-backed results

Popular Tasks used by Researchers

How can I help with your research?

Meet SciSpace

Get more enhanced response by uploading the PDFs you want me to reference.

No relevant PDFs in your library

SciSpace is the AI research assistant for academics. Run systematic literature reviews on 280M+ papers, and write papers with cited sources. Trusted by 1M+ students, PhDs & researchers.

SciSpace | AI for Research

Analyze PDFs

Code & Manuscripts

Funding & Grants

Literature & Patents

Medical & Clinical Data

Systematic Review

Visualize & Present

Web & Data

Build a Google Scholar-like website for your research.

Build a website

Create charts and images for your research

Create a Chart

Write a paper for submission to a journal

Draft a manuscript

Patent Search

Design eye-catching scientific posters in minutes.

Scientific Poster Generation

Systematic Literature Review

One task is running at the moment. Your messages will be shown right after.

Drag and drop or click here to browse

Loved by <highlight>1 million+</highlight> researchers

Extract a list of specific topics and their sources from unstructured text

Topics

Compare and analyze relevant papers that matches with your search

Papers

Get insights from PDFs and bookmarked papers from your library

My library

Recent searches

Try searching for:

Catch AI-generated content in scholarly and non-scholarly content

{ai} Detector

Ai Writer

Get PDF Summaries, highlighted text explanations 

Chat with PDF

Effortlessly create in-text citations and bibliographies in APA and 2,500 other formats

Citation generator

Get explanations, summaries, and answers on academic papers

Ease up your research workflow with {scispace}'s cohort of exciting AI tools

Elevate your academic writing skills and convey your ideas the way you want

Paraphraser

Explore our range of reading and writing tools

Your file is being prepared and should be ready in a few minutes. If it's a large file, it might take a bit longer. You can close this window, and we'll email you the file when it's done.

You have reached a maximum limit of <strong>{limit}</strong> columns in the table. Remove at least <strong>1</strong> column to add or create another one.

Sidonia E Compton

Author Tools

Chat about Author

Papers

Psychometric Evaluation of the Posttrauma Risky Behaviors Questionnaire: Item Response Theory Analyses