This study explored challenges associated with online crowdsourced data collection, particularly focusing on longitudinal tasks with time-sensitive outcomes like response latencies. The research identified two significant sources of bias: technical shortcomings such as low, variable frame rates, and human factors, contributing to high attrition rates. The study also explored potential solutions to these problems, such as enforcing hardware acceleration and defining study-specific frame rate thresholds, as well as pre-screening participants and monitoring hardware performance and task engagement over each experimental session. This study provides valuable insights into improving the quality and reliability of data collected via online crowdsourced platforms and emphasizes the need for researchers to be cognizant of potential pitfalls in online research.
Methodological considerations for behavioral studies relying on response time outcomes through online crowdsourcing platforms
P. McConnell,Christian Finetto,K. Heise
Published 2023 in bioRxiv
ABSTRACT
PUBLICATION RECORD
- Publication year
2023
- Venue
bioRxiv
- Publication date
2023-06-13
- Fields of study
Biology, Medicine, Computer Science, Psychology
- Identifiers
- External record
- Source metadata
Semantic Scholar, PubMed
CITATION MAP
EXTRACTION MAP
CLAIMS
- No claims are published for this paper.
CONCEPTS
- No concepts are published for this paper.
REFERENCES
Showing 1-38 of 38 references · Page 1 of 1
CITED BY
Showing 1-3 of 3 citing papers · Page 1 of 1