research-article

Impartial Peer Selection: An Annotated Reading List

Authors:

Omer Lev,

Harper Lyon,

Nicholas MatteiAuthors Info & Claims

ACM SIGecom Exchanges, Volume 22, Issue 1

Pages 113 - 117

https://doi.org/10.1145/3699824.3699834

Published: 08 October 2024 Publication History

Get Access

Abstract

The study of peer selection mechanisms presents a unique opportunity to understand and improve the practice of a group selecting its best members, despite each member of that group wanting to be selected. A prime example of such a setting is academic peer review, for which peer selection offers a variety of improvement directions. We present an annotated reading list covering the foundations of peer selection as well as recent and emerging work within the field.

References

[1]

Ardabili, P. N. and Liu, M. 2013. Incentives, quality, and risks: A look into the NSF proposal review pilot. CoRR abs/1307.6528.

Google Scholar

[2]

Bousquet, N., Norin, S., and Vetta, A. 2014. A near-optimal mechanism for impartial selection. In Proceedings of the 10th International Conference on Web and Internet Economics (WINE). Beijing, China, 133--146.

Google Scholar

[3]

Cole, S., Cole, J., and Simon, G. 1981. Chance and consensus in peer review. Science 214, 4523, 881--886.

Google Scholar

[4]

Fischer, F. and Klimm, M. 2015. Optimal impartial selection. SIAM Journal on Computing 44, 5, 1263--1285.

Digital Library

Google Scholar

[5]

Goldberg, A., Stelmakh, I., Cho, K., Oh, A. H., Agarwal, A., Belgrave, D., and Shah, N. B. 2023. Peer reviews of peer reviews: A randomized controlled trial and other experiments. CoRR abs/2311.09497.

Google Scholar

[6]

Holzman, R. and Moulin, H. 2013. Impartial nominations for a prize. Econometrica 81, 1 (January), 173--196.

Google Scholar

[7]

McNutt, R. A., Evans, A. T., Fletcher, R. H., and Fletcher, S. W. 1990. The effects of blinding on the quality of peer review: A randomized trial. The Journal of the American Medical Association 263, 10, 1371--1376.

Crossref

Google Scholar

[8]

Olckers, M. and Walsh, T. 2022. Manipulation and peer mechanisms: A survey. CoRR abs/2210.01984.

Google Scholar

[9]

Shah, N. B. 2022. Challenges, experiments, and computational solutions in peer review. Commun. ACM 65, 6, 76--87.

Digital Library

Google Scholar

[10]

Wenneras, C. and Wold, A. 1997. Nepotism and sexism in peer-review. Nature 387, 341--343.

Crossref

Google Scholar

Index Terms

Impartial Peer Selection: An Annotated Reading List
1. Human-centered computing
  1. Collaborative and social computing
    1. Collaborative and social computing systems and tools
    2. Collaborative and social computing theory, concepts and paradigms
  2. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Web-based interaction
2. Information systems
  1. Information retrieval
    1. Retrieval tasks and goals
  2. World Wide Web
    1. Web searching and information discovery

Index terms have been assigned to the content through auto-classification.

Recommendations

Deterministic Impartial Selection with Weights
In the impartial selection problem, a subset of agents up to a fixed size k among a group of n is to be chosen based on votes cast by the agents themselves. A selection mechanism is impartial if no agent can influence its own chance of being selected by ...
Deterministic Impartial Selection with Weights
Web and Internet Economics
Abstract
In the impartial selection problem, a subset of agents up to a fixed size k among a group of n is to be chosen based on votes cast by the agents themselves. A selection mechanism is impartial if no agent can influence its own chance of being ...
Scalable Supernode Selection in Peer-to-Peer Overlay Networks
HOT-P2P '05: Proceedings of the Second International Workshop on Hot Topics in Peer-to-Peer Systems

We define a problem called the supernode selection problem which has emerged across a variety of peer-topeer applications. Supernode selection involves selection of a subset of the peers to serve a special role. The supernodes must be well-dispersed ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM SIGecom Exchanges Volume 22, Issue 1

June 2024

180 pages

EISSN:1551-9031

DOI:10.1145/3699824

Editors:
Irene Lo
Stanford University
,
Sam Taggart
Oberlin College

Issue’s Table of Contents

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2024

Published in SIGECOM Volume 22, Issue 1

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
10
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)3

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Index Terms

Recommendations

Deterministic Impartial Selection with Weights

Deterministic Impartial Selection with Weights

Scalable Supernode Selection in Peer-to-Peer Overlay Networks

Comments

Information

Published In

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations