skip to content
The practice of crowdsourcing Preview this item
ClosePreview this item
Checking...

The practice of crowdsourcing

Author: Omar Alonso
Publisher: [San Rafael, California] : Morgan & Claypool, [2019]
Series: Synthesis lectures on information concepts, retrieval, and services, #66.
Edition/Format:   eBook : Document : EnglishView all editions and formats
Summary:
Many data-intensive applications that use machine learning or artificial intelligence techniques depend on humans providing the initial dataset, enabling algorithms to process the rest or for other humans to evaluate the performance of such algorithms. Not only can labeled data for training and evaluation be collected faster, cheaper, and easier than ever before, but we now see the emergence of hybrid human-machine  Read more...
Rating:

(not yet rated) 0 with reviews - Be the first.

Subjects
More like this

Find a copy online

Find a copy in the library

&AllPage.SpinnerRetrieving; Finding libraries that hold this item...

Details

Genre/Form: Electronic books
Additional Physical Format: Print version:
Material Type: Document, Internet resource
Document Type: Internet Resource, Computer File
All Authors / Contributors: Omar Alonso
ISBN: 1681735245 9781681735245
OCLC Number: 1103600437
Notes: Title from PDF title page (viewed on June 4, 2019).
Description: 1 online resource (xix, 129 pages) : illustrations (some color)
Contents: 1. Introduction --
1.1. Human computers --
1.2. Basic concepts --
1.3. Examples --
1.4. Some generic observations --
1.5. A note on platforms --
1.6. The importance of labels --
1.7. Scope and structure 2. Designing and developing microtasks --
2.1. Microtask development flow --
2.2. Programming hits --
2.3. Asking questions --
2.4. Collecting responses --
2.5. Interface design --
2.6. Cognitive biases and effects --
2.7. Content aspects --
2.8. Task clarity --
2.9. Task complexity --
2.10. Sensitive data --
2.11. Examples --
2.12. Summary 3. Quality assurance --
3.1. Quality framework --
3.2. Quality control overview --
3.3. Recommendations from platforms --
3.4. Worker qualification --
3.5. Reliability and validity --
3.6. Hit debugging --
3.7. Summary 4. Algorithms and techniques for quality control --
4.1. Framework --
4.2. Voting --
4.3. Attention monitoring --
4.4. Honey pots --
4.5. Workers reviewing work --
4.6. Justification --
4.7. Aggregation methods --
4.8. Behavioral data --
4.9. Expertise and routing --
4.10. Summary 5. The human side of human computation --
5.1. Overview --
5.2. Demographics --
5.3. Incentives --
5.4. Worker experience --
5.5. Worker feedback --
5.6. Legal and ethics --
5.7. Summary 6. Putting all things together --
6.1. The state of the practice --
6.2. Wetware programming --
6.3. Testing and debugging --
6.4. Work quality control --
6.5. Managing construction --
6.6. Operational considerations --
6.7. Summary of practices --
6.8. Summary 7. Systems and data pipelines --
7.1. Evaluation --
7.2. Machine translation --
7.3. Handwritting recognition and transcription --
7.4. Taxonomy creation --
7.5. Data analysis --
7.6. News near-duplicate detection --
7.7. Entity resolution --
7.8. Classification --
7.9. Image and speech --
7.10. Information extraction --
7.11. RABJ --
7.12. Workflows --
7.13. Summary 8. Looking ahead --
8.1. Crowds and social networks --
8.2. Interactive and real-time crowdsourcing --
8.3. Programming languages --
8.4. Databases and crowd-powered algorithms --
8.5. Fairness, bias, and reproducibility --
8.6. An incomplete list of requirements for infrastructure --
8.7. Summary.
Series Title: Synthesis lectures on information concepts, retrieval, and services, #66.
Responsibility: Omar Alonso.
More information:

Abstract:

Building systems and data processing pipelines that require crowd computing remains difficult. In this book, the authors present practical considerations for designing and implementing tasks that  Read more...

Reviews

User-contributed reviews
Retrieving GoodReads reviews...
Retrieving DOGObooks reviews...

Tags

Be the first.
Confirm this request

You may have already requested this item. Please select Ok if you would like to proceed with this request anyway.

Linked Data


Primary Entity

<http://www.worldcat.org/oclc/1103600437> # The practice of crowdsourcing
    a schema:CreativeWork, schema:Book, schema:MediaObject ;
    library:oclcnum "1103600437" ;
    library:placeOfPublication <http://id.loc.gov/vocabulary/countries/cau> ;
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/ground_truth> ; # ground truth
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/crowd_computing> ; # crowd computing
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Topic/human_computation> ; # Human computation
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/wetware_programming> ; # wetware programming
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/data_pipelines> ; # data pipelines
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/human_computation> ; # human computation
    schema:about <http://dewey.info/class/004.019/e23/> ;
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/crowdsourcing> ; # crowdsourcing
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/hybrid_human_machine_computation> ; # hybrid human-machine computation
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/human_in_the_loop> ; # human-in-the-loop
    schema:about <http://experiment.worldcat.org/entity/work/data/9144824136#Thing/labeling> ; # labeling
    schema:author <http://experiment.worldcat.org/entity/work/data/9144824136#Person/alonso_omar> ; # Omar Alonso
    schema:bookFormat schema:EBook ;
    schema:datePublished "2019" ;
    schema:description "1. Introduction -- 1.1. Human computers -- 1.2. Basic concepts -- 1.3. Examples -- 1.4. Some generic observations -- 1.5. A note on platforms -- 1.6. The importance of labels -- 1.7. Scope and structure"@en ;
    schema:description "Many data-intensive applications that use machine learning or artificial intelligence techniques depend on humans providing the initial dataset, enabling algorithms to process the rest or for other humans to evaluate the performance of such algorithms. Not only can labeled data for training and evaluation be collected faster, cheaper, and easier than ever before, but we now see the emergence of hybrid human-machine software that combines computations performed by humans and machines in conjunction. There are, however, real-world practical issues with the adoption of human computation and crowdsourcing. Building systems and data processing pipelines that require crowd computing remains difficult. In this book, we present practical considerations for designing and implementing tasks that require the use of humans and machines in combination with the goal of producing high-quality labels."@en ;
    schema:exampleOfWork <http://worldcat.org/entity/work/id/9144824136> ;
    schema:genre "Electronic books"@en ;
    schema:inLanguage "en" ;
    schema:isPartOf <http://worldcat.org/issn/1947-9468> ; # Synthesis lectures on information concepts, retrieval, and services,
    schema:isPartOf <http://experiment.worldcat.org/entity/work/data/9144824136#Series/synthesis_lectures_on_information_concepts_retrieval_and_services> ; # Synthesis lectures on information concepts, retrieval, and services ;
    schema:isSimilarTo <http://worldcat.org/entity/work/data/9144824136#CreativeWork/> ;
    schema:name "The practice of crowdsourcing"@en ;
    schema:productID "1103600437" ;
    schema:url <https://doi.org/10.2200/S00904ED1V01Y201903ICR066> ;
    schema:url <https://public.ebookcentral.proquest.com/choice/publicfullrecord.aspx?p=5781357> ;
    schema:url <https://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=2147390> ;
    schema:workExample <http://worldcat.org/isbn/9781681735245> ;
    schema:workExample <http://dx.doi.org/10.2200/S00904ED1V01Y201903ICR066> ;
    wdrs:describedby <http://www.worldcat.org/title/-/oclc/1103600437> ;
    .


Related Entities

<http://experiment.worldcat.org/entity/work/data/9144824136#Person/alonso_omar> # Omar Alonso
    a schema:Person ;
    schema:familyName "Alonso" ;
    schema:givenName "Omar" ;
    schema:name "Omar Alonso" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Series/synthesis_lectures_on_information_concepts_retrieval_and_services> # Synthesis lectures on information concepts, retrieval, and services ;
    a bgn:PublicationSeries ;
    schema:hasPart <http://www.worldcat.org/oclc/1103600437> ; # The practice of crowdsourcing
    schema:name "Synthesis lectures on information concepts, retrieval, and services ;" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Thing/crowd_computing> # crowd computing
    a schema:Thing ;
    schema:name "crowd computing" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Thing/data_pipelines> # data pipelines
    a schema:Thing ;
    schema:name "data pipelines" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Thing/human_computation> # human computation
    a schema:Thing ;
    schema:name "human computation" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Thing/human_in_the_loop> # human-in-the-loop
    a schema:Thing ;
    schema:name "human-in-the-loop" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Thing/hybrid_human_machine_computation> # hybrid human-machine computation
    a schema:Thing ;
    schema:name "hybrid human-machine computation" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Thing/wetware_programming> # wetware programming
    a schema:Thing ;
    schema:name "wetware programming" ;
    .

<http://experiment.worldcat.org/entity/work/data/9144824136#Topic/human_computation> # Human computation
    a schema:Intangible ;
    schema:name "Human computation"@en ;
    .

<http://worldcat.org/isbn/9781681735245>
    a schema:ProductModel ;
    schema:isbn "1681735245" ;
    schema:isbn "9781681735245" ;
    .

<http://worldcat.org/issn/1947-9468> # Synthesis lectures on information concepts, retrieval, and services,
    a bgn:PublicationSeries ;
    schema:hasPart <http://www.worldcat.org/oclc/1103600437> ; # The practice of crowdsourcing
    schema:issn "1947-9468" ;
    schema:name "Synthesis lectures on information concepts, retrieval, and services," ;
    .


Content-negotiable representations

Close Window

Please sign in to WorldCat 

Don't have an account? You can easily create a free account.