Worker types and personality traits in crowdsourcing relevance labels

No abstract is available for this paper.

• Publication year

  2011

• Venue

  International Conference on Information and Knowledge Management

• Publication date

  2011-10-24

• Fields of study

  Computer Science, Psychology

• Identifiers
  DOI 10.1145/2063576.2063860
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Crowdsourcing for book search evaluation: impact of hit design on comparative system ranking

  2011cited by this paper
• Design and Implementation of Relevance Assessments Using Crowdsourcing

  2011cited by this paper
• In Search of Quality in Crowdsourcing for Search Engine Evaluation

  2011cited by this paper
• How Much Spam Can You Take? An Analysis of Crowdsourcing Results to Increase Accuracy

  2011cited by this paper
• Analyzing the Amazon Mechanical Turk marketplace

  2010cited by this paper
• The effect of assessor error on IR system evaluation

  2010cited by this paper
• An Analysis of Assessor Behavior in Crowdsourced Preference Judgments

  2010cited by this paper
• Ensuring quality in crowdsourced search relevance evaluation: The effects of training question distribution

  2010cited by this paper
• Overview of the INEX 2010 Book Track: Scaling Up the Evaluation Using Crowdsourcing

  2010cited by this paper
• Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business

  2010influential reference
• Crowdsourcing Document Relevance Assessment with Mechanical Turk

  2010cited by this paper
• Are Your Participants Gaming the System? Screening Mechanical Turk Workers

  2010cited by this paper
• Who are the crowdworkers?: shifting demographics in mechanical turk

  2010cited by this paper
• THE RELATIONSHIP BETWEEN PERSONALITY TRAITS AND ONLINE SHOPPING MOTIVATIONS

  2010cited by this paper
• Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks

  2008cited by this paper
• Crowdsourcing for relevance evaluation

  2008cited by this paper
• Crowdsourcing user studies with Mechanical Turk

  2008cited by this paper
• Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues.

  2008cited by this paper
• Personality Impressions Based on Facebook Profiles

  2007cited by this paper
• Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German

  2007cited by this paper

• Meta-learning representations for learning from multiple annotators

  2026cites this paper
• Word Overuse and Alignment in Large Language Models: The Influence of Learning from Human Feedback

  2025influential citation
• Empirical Studies on M-X Algorithm Implementation in Tester Eligibility Classification for Crowdsourced Based User Acceptance Testing

  2025cites this paper
• Improving User Behavior Prediction: Leveraging Annotator Metadata in Supervised Machine Learning Models

  2025cites this paper
• Identifying non-cooperative participation in web-based elicitation of acceptability judgments

  2024cites this paper
• Explaining crowdworker behaviour through computational rationality

  2024cites this paper
• “I Prefer Regular Visitors to Answer My Questions”: Users’ Desired Experiential Background of Contributors for Location-based Crowdsourcing Platform

  2024cites this paper
• Mood matters: the interplay of personality in ethical perceptions in crowdsourcing

  2024cites this paper
• An Exploratory Study of the Impact of Task Selection Strategies on Worker Performance in Crowdsourcing Microtasks

  2024cites this paper
• Productivity and Task Heterogeneity in Online Labor Markets: A Bonus Payment Experiment

  2024cites this paper
• FedTA: Federated Worthy Task Assignment for Crowd Workers

  2024cites this paper
• Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems

  2024cites this paper
• Cognitive personalization for online microtask labor platforms: A systematic literature review

  2023cites this paper
• Collusion-Resistant Worker Recruitment in Crowdsourcing Systems

  2023cites this paper
• Combining Worker Factors for Heterogeneous Crowd Task Assignment

  2023influential citation
• Payment schemes in online labour markets. Does incentive and personality matter?

  2023cites this paper
• Crowdmeta: Crowdsourcing truth inference with meta-Knowledge transfer

  2023cites this paper
• A New Method for Identifying Low-Quality Data in Perceived Usability Crowdsourcing Tests: Differences in Questionnaire Scores

  2023cites this paper
• Self-paced annotations of crowd workers

  2022cites this paper
• Treating Crowdsourcing as Examination: How to Score Tasks and Online Workers?

  2022influential citation
• Citizen science for Earth Observation (Citizens4EO): understanding current use in the UK

  2022cites this paper
• Answer Quality Aware Aggregation for Extractive QA Crowdsourcing

  2022cites this paper
• A deep active learning-based and crowdsourcing-assisted solution for named entity recognition in Chinese historical corpora

  2022cites this paper
• What Quality Control Mechanisms do We Need for High-Quality Crowd Work?

  2022cites this paper
• Aggregation of Crowdsourced Ontology-Based Item Descriptions by Hierarchical Voting

  2021cites this paper
• Spammer Detection Based on Task Completion Time Variation in Crowdsourcing

  2021cites this paper
• A Game Theory Approach for Estimating Reliability of Crowdsourced Relevance Assessments

  2021cites this paper
• A Survey on Task Assignment in Crowdsourcing

  2021influential citation
• Crowdsourcing with Meta-Workers: A New Way to Save the Budget

  2021cites this paper
• Open-Set Crowdsourcing using Multiple-Source Transfer Learning

  2021cites this paper
• Personality Characteristic-based Enhanced Software Testing Levels for Crowd Outsourcing Environment

  2021cites this paper
• VocalTurk: Exploring Feasibility of Crowdsourced Speaker Identification

  2021cites this paper
• Quality Control in Crowdsourcing based on Fine-Grained Behavioral Features

  2021cites this paper
• Using Worker Avatars to Improve Microtask Crowdsourcing

  2021influential citation
• A Time-Series-Based New Behavior Trace Model for Crowd Workers That Ensures Quality Annotation

  2021cites this paper
• Improving Reactions to Rejection in Crowdsourcing Through Self-Reflection

  2021cites this paper
• An experimental characterization of workers’ behavior and accuracy in crowdsourced tasks

  2021cites this paper
• On Creating Benchmark Dataset for Aerial Image Interpretation: Reviews, Guidances, and Million-AID

  2021cites this paper
• AI-Assisted Human Labeling

  2021cites this paper
• Empowering mobile crowdsourcing apps with user privacy control

  2021cites this paper
• Crowd Worker Strategies in Relevance Judgment Tasks

  2020cites this paper
• Crowdsourcing with Multiple-Source Knowledge Transfer

  2020cites this paper
• Effective Bayesian-network-based missing value imputation enhanced by crowdsourcing

  2020cites this paper
• Conversational Crowdsourcing

  2020cites this paper
• In vitro vs in vivo: does the study’s interface design influence crowdsourced video QoE?

  2020cites this paper
• CrowdCog

  2020cites this paper
• Rogue people: on adversarial crowdsourcing in the context of cyber security

  2020cites this paper
• A Robust Consistency Model of Crowd Workers in Text Labeling Tasks

  2020cites this paper
• DiRS: On Creating Benchmark Datasets for Remote Sensing Image Interpretation

  2020cites this paper
• Average Jane, Where Art Thou? – Recent Avenues in Efficient Machine Learning Under Subjectivity Uncertainty

  2020cites this paper
• Co-destruction Patterns in Crowdsourcing

  2020cites this paper
• Utilizing short version big five traits on crowdsouring

  2020cites this paper
• The quality of data collected online: An investigation of careless responding in a crowdsourced sample

  2020cites this paper
• Data convergence in syntactic theory and the role of sentence pairs

  2020cites this paper
• Personality traits and performance in online labour markets

  2020cites this paper
• A Review of Judgment Analysis Algorithms for Crowdsourced Opinions

  2020cites this paper
• Learning from Crowd Labeling with Semi-crowdsourced Deep Generative Models

  2020cites this paper
• Is Quality Control Pointless?

  2019cites this paper
• Attention-Aware Answers of the Crowd

  2019cites this paper
• Active Multilabel Crowd Consensus

  2019cites this paper
• Effect of Cognitive Abilities on Crowdsourcing Task Performance

  2019influential citation
• Modeling Uncertainty and Inaccuracy on Data from Crowdsourcing Platforms: MONITOR

  2019cites this paper
• An Interactive Method to Improve Crowdsourced Annotations

  2019cites this paper
• The Practice of Crowdsourcing

  2019cites this paper
• To enhance Effectiveness of Crowdsource Software Testing by applying Personality Types

  2019cites this paper
• Towards privacy-sensitive mobile crowdsourcing

  2019cites this paper
• Task Assignment and Personality

  2019cites this paper
• Dynamic Weighted Majority Approach for Detecting Malicious Crowd Workers

  2019cites this paper
• CMed: Crowd Analytics for Medical Imaging Data

  2019cites this paper
• Development of an Intelligent Job Recommender System for Freelancers using Client's Feedback Classification and Association Rule Mining Techniques

  2019cites this paper
• In Vivo or in Vitro? Influence of the Study Design on Crowdsourced Video QoE

  2019cites this paper
• X-ray Imaging Analysis of Silo Flow Parameters Based on Trace Particles Using Targeted Crowdsourcing

  2019cites this paper
• Rehumanized Crowdsourcing: A Labeling Framework Addressing Bias and Ethics in Machine Learning

  2019cites this paper
• Multi-label crowd consensus via joint matrix factorization

  2019cites this paper
• What You Sow, So Shall You Reap! Toward Preselection Mechanisms for Macrotask Crowdsourcing

  2019cites this paper
• Searching for Suitable Face of Quality in Crowdsourcing - A Personality Perspective

  2018cites this paper
• Quality Control in Crowdsourcing

  2018influential citation
• Crowdsourced promotions in doubt: Analyzing effective crowdsourced promotions

  2018cites this paper
• Cognitive Biases in Crowdsourcing

  2018cites this paper
• Computing Crowd Consensus with Partial Agreement

  2018influential citation
• Crowd Anatomy Beyond the Good and Bad: Behavioral Traces for Crowd Worker Modeling and Pre-selection

  2018influential citation
• Sloppiness mitigation in crowdsourcing: detecting and correcting bias for crowd scoring tasks

  2018influential citation
• Information Visualization Evaluation Using Crowdsourcing

  2018cites this paper
• Task Assignment Model for Crowdsourcing Software Development: TAM

  2018cites this paper
• Association Between Logical Reasoning Ability and Quality of Relevance Judgments in Crowdsourcing

  2018cites this paper
• Crowdsourcing Task Assignment with Online Profile Learning

  2018cites this paper
• Contributors profile modelization in crowdsourcing platforms

  2018cites this paper
• Multi-label Answer Aggregation Based on Joint Matrix Factorization

  2018cites this paper
• Spam elimination and bias correction : ensuring label quality in crowdsourced tasks.

  2018influential citation
• A Case Study on using Crowdsourcing for Ambiguous Tasks

  2018cites this paper
• Topic difficulty and order of document presentation in relevance assessments

  2018cites this paper
• Methodological Challenges of Research on Crowdsourcing

  2018cites this paper
• QUALITY OF CROWDSOURCED RELEVANCE JUDGMENTS IN ASSOCIATION WITH LOGICAL REASONING ABILITY

  2018cites this paper
• Modélisation du profil des contributeurs dans les plateformes de crowdsourcing

  2018cites this paper
• Explorer Information Visualization Evaluation Using Crowdsourcing

  2018cites this paper
• A model for the analysis of the impact of crowdsourcing activities on organizations

  2018cites this paper
• LEVERAGING CROWD SOURCING FOR EFFICIENT MALICIOUS USERS DETECTION IN LARGE-SCALE SOCIAL NETWORKS

  2018cites this paper
• Leveraging crowd skills and consensus for collaborative web-resource labeling

  2017cites this paper
• Weigh it and share it!: crowdsourcing for pro-environmental data collection

  2017influential citation
• Hot Topics Surrounding Acceptability Judgement Tasks

  2017cites this paper