Targeting the right group of workers for crowdsourcing often achieves better quality results. One unique example of targeted crowdsourcing is seeking community-situated workers whose familiarity with the background and the norms of a particular group can help produce better outcome or accuracy. These community-situated crowd workers can be recruited in diferent ways from generic online crowdsourcing platforms or from online recovery communities. We evaluate three diferent approaches to recruit generic and community-situated crowd in terms of the time and the cost of recruitment, and the accuracy of task completion. We consider the context of Alcoholics Anonymous (AA), the largest peer support group for recovering alcoholics, and the task of identifying and validating AA meeting information. We discuss the benefts and trade-ofs of recruiting paid vs. unpaid community-situated workers and provide implications for future research in the recovery context and relevant domains of HCI, and for the design of crowdsourcing ICT systems.
|Original language||English (US)|
|Title of host publication||CHI 2021 - Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems|
|Subtitle of host publication||Making Waves, Combining Strengths|
|Publisher||Association for Computing Machinery|
|State||Published - May 6 2021|
|Event||2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021 - Virtual, Online, Japan|
Duration: May 8 2021 → May 13 2021
|Name||Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems|
|Conference||2021 CHI Conference on Human Factors in Computing Systems: Making Waves, Combining Strengths, CHI 2021|
|Period||5/8/21 → 5/13/21|
Bibliographical noteFunding Information:
Thank you to the participants for their time and contribution. We thank Zachary Levonian and Daniel Kluver for their useful feedback on the quantitative analysis. This work was funded by the NSF grants (1464376 and 1651575).
© 2021 ACM.
- Alcoholics anonymous
- Community-situated crowd