SCIENCE@home

Not Everyone Writes Good Examples but Good Examples Can Come from Anywhere

Shayan Doroudi,Ece Kamar,E. Brunskill

Published 2019 in AAAI Conference on Human Computation & Crowdsourcing

ABSTRACT

In many online environments, such as massive open online courses and crowdsourcing platforms, many people solve similar complex tasks. As a byproduct of solving these tasks, a pool of artifacts are created that may be able to help others perform better on similar tasks. In this paper, we explore whether work that is naturally done by crowdworkers can be used as examples to help future crowdworkers perform better on similar tasks. We explore this in the context of a product comparison review task, where workers must compare and contrast pairs of similar products. We first show that randomly presenting one or two peer-generated examples does not significantly improve performance on future tasks. In a second experiment, we show that presenting examples that are of sufficiently high quality leads to a statistically significant improvement in performance of future workers on a near transfer task. Moreover, our results suggest that even among high quality examples, there are differences in how effective the examples are, indicating that quality is not a perfect proxy for pedagogical value.

PUBLICATION RECORD

  • Publication year

    2019

  • Venue

    AAAI Conference on Human Computation & Crowdsourcing

  • Publication date

    2019-10-28

  • Fields of study

    Computer Science

  • Identifiers
    DOI 10.1609/hcomp.v7i1.5269
  • External record

    Open on Semantic Scholar

  • Source metadata

    Semantic Scholar

CITATION MAP

EXTRACTION MAP

CLAIMS

  • No claims are published for this paper.

CONCEPTS

  • No concepts are published for this paper.

REFERENCES

Showing 1-31 of 31 references · Page 1 of 1

CITED BY

Showing 1-14 of 14 citing papers · Page 1 of 1