Exploring the use of crowdsourcing to support empirical studies in software engineering

No abstract is available for this paper.

• Publication year

  2010

• Venue

  International Symposium on Empirical Software Engineering and Measurement

• Publication date

  2010-09-16

• Fields of study

  Computer Science, Engineering

• Identifiers
  DOI 10.1145/1852786.1852832
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Financial incentives and the "performance of crowds"

  2010cited by this paper
• Crowdsourcing graphical perception: using mechanical turk to assess visualization design

  2010cited by this paper
• Are Your Participants Gaming the System? Screening Mechanical Turk Workers

  2010cited by this paper
• Who are the crowdworkers?: shifting demographics in mechanical turk

  2010cited by this paper
• Analysis and Transformation of Pipe-like Web Mashups for End User Programmers

  2010cited by this paper
• Conversations in developer communities: a preliminary analysis of the yahoo! pipes community

  2009cited by this paper
• TurKit: Tools for iterative tasks on mechanical turk

  2009cited by this paper
• Crowdsourcing user studies with Mechanical Turk

  2008cited by this paper
• Towards a model of understanding social search

  2008cited by this paper
• Cheap and Fast – But is it Good? Evaluating Non-Expert Annotations for Natural Language Tasks

  2008cited by this paper
• Estimating the numbers of end users and end user programmers

  2005cited by this paper
• Refactoring

  2002cited by this paper

• STATOS: A portable tool for secure malware analysis and sample acquisition in low resource environments

  2025cites this paper
• Modelling Medical Students with Engineering Students: Addressing the Knowledge Gap in User Studies

  2025cites this paper
• Engaging Company Developers in Security Research Studies: A Comprehensive Literature Review and Quantitative Survey

  2024cites this paper
• An Approach for Auto Generation of Labeling Functions for Software Engineering Chatbots

  2024cites this paper
• PlayTest: A Gamified Test Generator for Games

  2023cites this paper
• A Review of Trending Crowdsourcing Topics in Software Engineering Highlighting Mobile Crowdsourcing and AI Utilization

  2023cites this paper
• On the Recruitment of Company Developers for Security Studies: Results from a Qualitative Interview Study

  2023cites this paper
• How R Developers explain their Package Choice: A Survey

  2023cites this paper
• Human–Computer Interaction and Participation in Software Crowdsourcing

  2023cites this paper
• Do CONTRIBUTING Files Provide Information about OSS Newcomers’ Onboarding Barriers?

  2023cites this paper
• What’s (Not) Working in Programmer User Studies?

  2023cites this paper
• Where to Recruit for Security Development Studies: Comparing Six Software Developer Samples

  2022cites this paper
• Towards a Methodology for Participant Selection in Software Engineering Experiments: A Vision of the Future

  2021cites this paper
• Conducting Malicious Cybersecurity Experiments on Crowdsourcing Platforms

  2021cites this paper
• Studying Programmer Behaviour at Scale: A Case Study using Amazon Mechanical Turk

  2021cites this paper
• An Empirical Study on Type Annotations

  2021cites this paper
• Towards an Extensible Architecture for an Empirical Software Engineering Computational Platform

  2021cites this paper
• Empirical Software Engineering Experimentation with Human Computation

  2020cites this paper
• Replication Can Improve Prior Results: A GitHub Study of Pull Request Acceptance

  2019cites this paper
• Dependable Dynamic Checkpoints for Batteryless Devices

  2019cites this paper
• Crowdsourcing Controls: A Review and Research Agenda for Crowdsourcing Controls Used for Macro-tasks

  2019cites this paper
• Mining Specifications from Documentation using a Crowd

  2019cites this paper
• Is Quality Control Pointless?

  2019cites this paper
• Crowdsourcing for Requirements Engineering : A Simplified Review

  2018cites this paper
• Assessing the Type Annotation Burden

  2018cites this paper
• Enhancing Efficiency oftheAgile Software by Using Crowdsourcing

  2018cites this paper
• Crowd-based Requirement Engineering

  2018cites this paper
• Continuous Refactoring in CI: A Preliminary Study on the Perceived Advantages and Barriers

  2018cites this paper
• Learning Quick Fixes from Code Repositories

  2018cites this paper
• A survey of the use of crowdsourcing in software engineering

  2017influential citation
• A framework for modelling and utilization of users' feedback for software systems evolution

  2017cites this paper
• Code Defenders: Crowdsourcing Effective Tests and Subtle Mutants with a Mutation Testing Game

  2017cites this paper
• Identifying Design Features Using Combination of Requirements Elicitation Techniques

  2017cites this paper
• Using Crowdsourced and Anonymized Personas in the Requirements Elicitation and Software Development Phases of Software Engineering

  2016cites this paper
• The challenge of continuous user participation in eBayanihan: Digitizing humanitarian action in a nationwide web mobile participatory disaster management system

  2016cites this paper
• Labeling relevant skills in tasks: Can the crowd help?

  2016cites this paper
• Leveraging a corpus of natural language descriptions for program similarity

  2016cites this paper
• Exploring Crowd Consistency in a Mechanical Turk Survey

  2016cites this paper
• A Process Model for Crowdsourcing: Insights from the Literature on Implementation

  2016influential citation
• UC Irvine UC Irvine Electronic Theses and Dissertations Title

  2016cites this paper
• Mining and Quality Assessment of Mashup Model Patterns with the Crowd

  2016cites this paper
• Learning Syntactic Program Transformations from Examples

  2016cites this paper
• Breaking Collaboration Barriers through Communication Practices in Software Crowdsourcing

  2016cites this paper
• Crowdsourcing for API documentation: A Preliminary Investigation

  2015cites this paper
• Crowdsourcing: A taxonomy and systematic mapping study

  2015cites this paper
• Investigating Samples Representativeness for an Online Experiment in Java Code Search

  2015cites this paper
• Exploring the Benefits of Using Redundant Responses in Crowdsourced Evaluations

  2015cites this paper
• Investigating probabilistic sampling approaches for large-scale surveys in software engineering

  2015cites this paper
• CloudTeams: Bridging the Gap Between Developers and Customers During Software Development Processes

  2015cites this paper
• Factors influencing the decision to crowdsource: A systematic literature review

  2015cites this paper
• Code Similarity via Natural Language Descriptions

  2014cites this paper
• Research protocol for a case study of crowdsourcing software development

  2014cites this paper
• Crowdsourcing software evaluation

  2014cites this paper
• Towards a framework to support large scale sampling in software engineering surveys

  2014cites this paper
• Creation of Reliable Relevance Judgments in Information Retrieval Systems Evaluation Experimentation through Crowdsourcing: A Review

  2014cites this paper
• Researching crowdsourcing software development: perspectives and concerns

  2014influential citation
• Software evaluation via users' feedback at runtime

  2014cites this paper
• Solving the Search for Source Code

  2014cites this paper
• Together we are stronger: facilitating the conduction of distributed human-oriented experiments

  2014cites this paper
• What makes a good app description?

  2014cites this paper
• Recommendation and Weaving of Reusable Mashup Model Patterns for Assisted Development

  2014cites this paper
• Crowdsourcing Definitions and Its Features: An Academic Technical Report

  2014cites this paper
• Towards Crowdsourcing for Requirements Engineering

  2014cites this paper
• Reducing the Usability Barrier to Specification and Verification

  2014cites this paper
• The four pillars of crowdsourcing: A reference model

  2014cites this paper
• CrowdOracles: Can the Crowd Solve the Oracle Problem?

  2013influential citation
• A Model-Driven Approach to Formalize and Support Controlled Experiments in Software Engineering

  2013cites this paper
• Search-based generation of human readable test data and its impact on human oracle costs

  2013cites this paper
• Using redundancy to improve security and testing

  2013cites this paper
• Would Sociable Software Engineers Observe Better?

  2013cites this paper
• Using Amazon's Mechanical Turk for User Studies: Eight Things You Need to Know

  2013cites this paper
• Evolving Readable String Test Inputs Using a Natural Language Model to Reduce Human Oracle Cost

  2013cites this paper
• Towards the Competence of Crowdsourcees: Literature-based Considerations on the Problem of Assessing Crowdsourcees' Qualities

  2013cites this paper
• Evaluation on crowdsourcing research: Current status and future direction

  2012cites this paper
• Tagging tagged images: on the impact of existing annotations on image tagging

  2012cites this paper
• How to filter out random clickers in a crowdsourcing-based study?

  2012cites this paper
• Playful Surveys: Easing Challenges of Human Subject Research with Online Crowds

  2012cites this paper
• Reducing the barriers to writing verified specifications

  2012cites this paper
• Finding suitable programs: Semantic search with incomplete and lightweight specifications

  2012cites this paper
• Investigating Factors Influencing Crowdsourcing Tasks with High Imaginative Load

  2011cites this paper
• Computer music composition using crowdsourcing and genetic algorithms

  2011cites this paper
• Investigating the Efficacy of Crowdsourcing on Evaluating Visual Decision Supporting System

  2011cites this paper
• The Smarter Crowd : Active Learning , Knowledge Corroboration , and Collective IQs

  2011cites this paper
• DigitalCommons@UNO DigitalCommons@UNO

  year unknowncites this paper