skip to content
Conducting large-scale online experiments on a crowdsourcing platform Preview this item
ClosePreview this item
Checking...

Conducting large-scale online experiments on a crowdsourcing platform

Author: Felix Bader; Marc Keuschnigg
Publisher: London : SAGE Publications Ltd, 2018.
Series: SAGE Research Methods., Cases.
Edition/Format:   eBook : Document : English
Summary:
Crowdsourced online experiments are a promising complement to laboratory research in the social sciences. Conducting experiments over the Internet is not just a quick and inexpensive way of data collection. Transporting a homogeneous decision situation into heterogeneous living conditions, online experiments can generate behavioral data from people with different social backgrounds. If paired with recruiting from a  Read more...
Rating:

(not yet rated) 0 with reviews - Be the first.

Subjects
More like this

Find a copy online

Links to this item

Find a copy in the library

&AllPage.SpinnerRetrieving; Finding libraries that hold this item...

Details

Material Type: Document, Internet resource
Document Type: Internet Resource, Computer File
All Authors / Contributors: Felix Bader; Marc Keuschnigg
ISBN: 9781526441805 1526441802
OCLC Number: 1023828725
Description: 1 online resource.
Series Title: SAGE Research Methods., Cases.
Responsibility: Felix Bader, Marc Keuschnigg.

Abstract:

Crowdsourced online experiments are a promising complement to laboratory research in the social sciences. Conducting experiments over the Internet is not just a quick and inexpensive way of data collection. Transporting a homogeneous decision situation into heterogeneous living conditions, online experiments can generate behavioral data from people with different social backgrounds. If paired with recruiting from a global crowdsourcing platform, the potential for participant heterogeneity rises, including different nationalities and cultures. We guide through the 10 steps necessary for the practical implementation of a crowdsourced online experiment. For illustration, we refer to our recent project on fairness behavior conducted over Amazon Mechanical Turk. We used the platform to recruit participants from the United States and India. We address general issues of experimental research including randomization, instructions, incentives, and participants' informed consent as well as specific issues of online implementation such as international recruiting, payment, field control, and matching of asynchronously participating subjects. Our exemplary project focuses on altruism, fairness, and costly punishment as measured in standard experimental games. First, we randomly assigned participants to different levels of monetary incentives. We found that monetary incentives induce more selfish behavior, but the exact size of the stake is irrelevant for observed rates of prosocial behavior. Second, we explored context effects on elicited behavior using variation in participants' geographical location. We showed that context effects of regional prosperity and local social capital are comparable in size to stake effects. More importantly, we demonstrated that context effects are visible and quantifiable in a large-scale online experiment. We thus argue that studying the diverse backgrounds people bring into the experiment is the key potential of crowdsourced online designs.

Reviews

User-contributed reviews
Retrieving GoodReads reviews...
Retrieving DOGObooks reviews...

Tags

Be the first.
Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

Linked Data


Primary Entity

<http://www.worldcat.org/oclc/1023828725> # Conducting large-scale online experiments on a crowdsourcing platform
    a schema:CreativeWork, schema:MediaObject, schema:Book ;
    library:oclcnum "1023828725" ;
    library:placeOfPublication <http://id.loc.gov/vocabulary/countries/enk> ;
    schema:about <http://experiment.worldcat.org/entity/work/data/4773446176#Topic/human_computation> ; # Human computation
    schema:about <http://experiment.worldcat.org/entity/work/data/4773446176#Place/india> ; # India.
    schema:about <http://dewey.info/class/004.019/e23/> ;
    schema:about <http://experiment.worldcat.org/entity/work/data/4773446176#Topic/human_computation_united_states> ; # Human computation--United States
    schema:about <http://experiment.worldcat.org/entity/work/data/4773446176#Place/united_states> ; # United States.
    schema:about <http://experiment.worldcat.org/entity/work/data/4773446176#Topic/amazon_mechanical_turk> ; # Amazon Mechanical Turk
    schema:about <http://experiment.worldcat.org/entity/work/data/4773446176#Topic/human_computation_india> ; # Human computation--India
    schema:author <http://experiment.worldcat.org/entity/work/data/4773446176#Person/bader_felix> ; # Felix Bader
    schema:author <http://experiment.worldcat.org/entity/work/data/4773446176#Person/keuschnigg_marc> ; # Marc Keuschnigg
    schema:bookFormat schema:EBook ;
    schema:datePublished "2018" ;
    schema:description "Crowdsourced online experiments are a promising complement to laboratory research in the social sciences. Conducting experiments over the Internet is not just a quick and inexpensive way of data collection. Transporting a homogeneous decision situation into heterogeneous living conditions, online experiments can generate behavioral data from people with different social backgrounds. If paired with recruiting from a global crowdsourcing platform, the potential for participant heterogeneity rises, including different nationalities and cultures. We guide through the 10 steps necessary for the practical implementation of a crowdsourced online experiment. For illustration, we refer to our recent project on fairness behavior conducted over Amazon Mechanical Turk. We used the platform to recruit participants from the United States and India. We address general issues of experimental research including randomization, instructions, incentives, and participants' informed consent as well as specific issues of online implementation such as international recruiting, payment, field control, and matching of asynchronously participating subjects. Our exemplary project focuses on altruism, fairness, and costly punishment as measured in standard experimental games. First, we randomly assigned participants to different levels of monetary incentives. We found that monetary incentives induce more selfish behavior, but the exact size of the stake is irrelevant for observed rates of prosocial behavior. Second, we explored context effects on elicited behavior using variation in participants' geographical location. We showed that context effects of regional prosperity and local social capital are comparable in size to stake effects. More importantly, we demonstrated that context effects are visible and quantifiable in a large-scale online experiment. We thus argue that studying the diverse backgrounds people bring into the experiment is the key potential of crowdsourced online designs."@en ;
    schema:exampleOfWork <http://worldcat.org/entity/work/id/4773446176> ;
    schema:inLanguage "en" ;
    schema:isPartOf <http://experiment.worldcat.org/entity/work/data/4773446176#Series/sage_research_methods_cases> ; # SAGE Research Methods. Cases
    schema:isPartOf <http://experiment.worldcat.org/entity/work/data/4773446176#Series/sage_research_methods> ; # SAGE Research Methods.
    schema:name "Conducting large-scale online experiments on a crowdsourcing platform"@en ;
    schema:productID "1023828725" ;
    schema:url <http://methods.sagepub.com/case/conducting-large-scale-online-experiments-on-crowdsourcing-platform> ;
    schema:workExample <http://worldcat.org/isbn/9781526441805> ;
    wdrs:describedby <http://www.worldcat.org/title/-/oclc/1023828725> ;
    .


Related Entities

<http://experiment.worldcat.org/entity/work/data/4773446176#Person/bader_felix> # Felix Bader
    a schema:Person ;
    schema:familyName "Bader" ;
    schema:givenName "Felix" ;
    schema:name "Felix Bader" ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Person/keuschnigg_marc> # Marc Keuschnigg
    a schema:Person ;
    schema:familyName "Keuschnigg" ;
    schema:givenName "Marc" ;
    schema:name "Marc Keuschnigg" ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Place/united_states> # United States.
    a schema:Place ;
    schema:name "United States." ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Series/sage_research_methods> # SAGE Research Methods.
    a bgn:PublicationSeries ;
    schema:hasPart <http://www.worldcat.org/oclc/1023828725> ; # Conducting large-scale online experiments on a crowdsourcing platform
    schema:name "SAGE Research Methods." ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Series/sage_research_methods_cases> # SAGE Research Methods. Cases
    a bgn:PublicationSeries ;
    schema:hasPart <http://www.worldcat.org/oclc/1023828725> ; # Conducting large-scale online experiments on a crowdsourcing platform
    schema:name "SAGE Research Methods. Cases" ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Topic/amazon_mechanical_turk> # Amazon Mechanical Turk
    a schema:Intangible ;
    schema:name "Amazon Mechanical Turk"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Topic/human_computation> # Human computation
    a schema:Intangible ;
    schema:name "Human computation"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Topic/human_computation_india> # Human computation--India
    a schema:Intangible ;
    schema:name "Human computation--India"@en ;
    .

<http://experiment.worldcat.org/entity/work/data/4773446176#Topic/human_computation_united_states> # Human computation--United States
    a schema:Intangible ;
    schema:name "Human computation--United States"@en ;
    .

<http://worldcat.org/isbn/9781526441805>
    a schema:ProductModel ;
    schema:isbn "1526441802" ;
    schema:isbn "9781526441805" ;
    .


Content-negotiable representations

Close Window

Please sign in to WorldCat 

Don't have an account? You can easily create a free account.