Methodological considerations for behavioral studies relying on response time outcomes through online crowdsourcing platforms

P. McConnell,Christian Finetto,K. Heise

Published 2023 in bioRxiv

ABSTRACT

This study explored challenges associated with online crowdsourced data collection, particularly focusing on longitudinal tasks with time-sensitive outcomes like response latencies. The research identified two significant sources of bias: technical shortcomings such as low, variable frame rates, and human factors, contributing to high attrition rates. The study also explored potential solutions to these problems, such as enforcing hardware acceleration and defining study-specific frame rate thresholds, as well as pre-screening participants and monitoring hardware performance and task engagement over each experimental session. This study provides valuable insights into improving the quality and reliability of data collected via online crowdsourced platforms and emphasizes the need for researchers to be cognizant of potential pitfalls in online research.

PUBLICATION RECORD

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-38 of 38 references · Page 1 of 1