Conducting Recommender Systems User Studies Using POPROX

Robin Burke; Joseph A. Konstan; Michael D. Ekstrand

doi:10.1145/3640457.3687092

Conducting Recommender Systems User Studies Using POPROX

Robin Burke, Joseph A. Konstan, Michael D. Ekstrand

Administration (CSENG)

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The Platform for OPen Recommendation and Online eXperimentation (POPROX) is a new resource to allow RecSys researchers to conduct online user research without having to develop all of the necessary infrastructure and recruit users. Our first domain is personalized news recommendations – POPROX 1.0 provides a daily newsletter (with content from the Associated Press) to users who have already consented to participate in research, along with interfaces and protocols to support researchers in conducting studies that assign subsets of users to various experimental algorithms and/or interfaces. The purpose of this tutorial is to introduce the platform and its capabilities to prospective research users while walking through the implementation of a sample experiment so that researchers can proceed to propose and carry out experiments on the POPROX platform.

Original language	English (US)
Title of host publication	RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems
Publisher	Association for Computing Machinery, Inc
Pages	1277-1278
Number of pages	2
ISBN (Electronic)	9798400705052
DOIs	https://doi.org/10.1145/3640457.3687092
State	Published - Oct 8 2024
Event	18th ACM Conference on Recommender Systems, RecSys 2024 - Bari, Italy Duration: Oct 14 2024 → Oct 18 2024

Publication series

Name	RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems

Conference

Conference	18th ACM Conference on Recommender Systems, RecSys 2024
Country/Territory	Italy
City	Bari
Period	10/14/24 → 10/18/24

Bibliographical note

Publisher Copyright:
© 2024 Copyright held by the owner/author(s).

Keywords

experimental infrastructure
recommender systems
user studies

Publisher link

10.1145/3640457.3687092

Find It

Find It at U of M Libraries

Cite this

Conducting Recommender Systems User Studies Using POPROX. / Burke, Robin; Konstan, Joseph A.; Ekstrand, Michael D.
RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems. Association for Computing Machinery, Inc, 2024. p. 1277-1278 (RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Burke, R, Konstan, JA & Ekstrand, MD 2024, Conducting Recommender Systems User Studies Using POPROX. in RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems. RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems, Association for Computing Machinery, Inc, pp. 1277-1278, 18th ACM Conference on Recommender Systems, RecSys 2024, Bari, Italy, 10/14/24. https://doi.org/10.1145/3640457.3687092

@inproceedings{9d7197f84315404c99018250effdf648,

title = "Conducting Recommender Systems User Studies Using POPROX",

abstract = "The Platform for OPen Recommendation and Online eXperimentation (POPROX) is a new resource to allow RecSys researchers to conduct online user research without having to develop all of the necessary infrastructure and recruit users. Our first domain is personalized news recommendations – POPROX 1.0 provides a daily newsletter (with content from the Associated Press) to users who have already consented to participate in research, along with interfaces and protocols to support researchers in conducting studies that assign subsets of users to various experimental algorithms and/or interfaces. The purpose of this tutorial is to introduce the platform and its capabilities to prospective research users while walking through the implementation of a sample experiment so that researchers can proceed to propose and carry out experiments on the POPROX platform.",

keywords = "experimental infrastructure, recommender systems, user studies",

author = "Robin Burke and Konstan, {Joseph A.} and Ekstrand, {Michael D.}",

note = "Publisher Copyright: {\textcopyright} 2024 Copyright held by the owner/author(s).; 18th ACM Conference on Recommender Systems, RecSys 2024 ; Conference date: 14-10-2024 Through 18-10-2024",

year = "2024",

month = oct,

day = "8",

doi = "10.1145/3640457.3687092",

language = "English (US)",

series = "RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems",

publisher = "Association for Computing Machinery, Inc",

pages = "1277--1278",

booktitle = "RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems",

}

TY - GEN

T1 - Conducting Recommender Systems User Studies Using POPROX

AU - Burke, Robin

AU - Konstan, Joseph A.

AU - Ekstrand, Michael D.

PY - 2024/10/8

Y1 - 2024/10/8

N2 - The Platform for OPen Recommendation and Online eXperimentation (POPROX) is a new resource to allow RecSys researchers to conduct online user research without having to develop all of the necessary infrastructure and recruit users. Our first domain is personalized news recommendations – POPROX 1.0 provides a daily newsletter (with content from the Associated Press) to users who have already consented to participate in research, along with interfaces and protocols to support researchers in conducting studies that assign subsets of users to various experimental algorithms and/or interfaces. The purpose of this tutorial is to introduce the platform and its capabilities to prospective research users while walking through the implementation of a sample experiment so that researchers can proceed to propose and carry out experiments on the POPROX platform.

AB - The Platform for OPen Recommendation and Online eXperimentation (POPROX) is a new resource to allow RecSys researchers to conduct online user research without having to develop all of the necessary infrastructure and recruit users. Our first domain is personalized news recommendations – POPROX 1.0 provides a daily newsletter (with content from the Associated Press) to users who have already consented to participate in research, along with interfaces and protocols to support researchers in conducting studies that assign subsets of users to various experimental algorithms and/or interfaces. The purpose of this tutorial is to introduce the platform and its capabilities to prospective research users while walking through the implementation of a sample experiment so that researchers can proceed to propose and carry out experiments on the POPROX platform.

KW - experimental infrastructure

KW - recommender systems

KW - user studies

UR - http://www.scopus.com/inward/record.url?scp=85210520520&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85210520520&partnerID=8YFLogxK

U2 - 10.1145/3640457.3687092

DO - 10.1145/3640457.3687092

M3 - Conference contribution

AN - SCOPUS:85210520520

T3 - RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems

SP - 1277

EP - 1278

BT - RecSys 2024 - Proceedings of the 18th ACM Conference on Recommender Systems

PB - Association for Computing Machinery, Inc

T2 - 18th ACM Conference on Recommender Systems, RecSys 2024

Y2 - 14 October 2024 through 18 October 2024

ER -

Conducting Recommender Systems User Studies Using POPROX

Abstract

Publication series

Conference

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this