Contests for Predictive Algorithms: Ensembling, Interdependency, and Optimal Rewards Design
Files
Date
2024-01-03
Contributor
Advisor
Department
Instructor
Depositor
Speaker
Researcher
Consultant
Interviewer
Narrator
Transcriber
Annotator
Journal Title
Journal ISSN
Volume Title
Publisher
Volume
Number/Issue
Starting Page
6171
Ending Page
Alternative Title
Abstract
With the increased availability of data and widespread use of AI/ML technologies, firms are increasingly using crowdsourcing contests to acquire predictive algorithms for business use. A unique feature of these contests is that the designer can create an ensemble of submitted algorithms and improve upon the predictive accuracy (or quality) of individual algorithms. Given this departure from conventional contests, we ask how the optimal rewarding schemes should be in the presence of ensembling and interdependent algorithms. To answer this question, we develop a stylistic model of a contest for a predictive algorithm with two participants. As opposed to the single best contribution typically sought out in conventional contests and the winner-takes-all reward scheme, we find that both the winner and the runner-up could receive rewards in contests for algorithms, depending on whether the ensembled algorithms substitute or complement each other as determined by the algorithm interdependency. We show that the degree of substitution or complementarity can fundamentally alter the structure of the optimal reward scheme. We highlight our results using a real-world algorithm contest for predicting breast cancer using digital mammograms, we demonstrate the practical applicability of our framework.
Description
Keywords
Digital Innovation, Transformation, and Entrepreneurship, algorithms, artifical intelligence, competition design, crowdsourcing contests, ensemble
Citation
Extent
10 pages
Format
Geographic Location
Time Period
Related To
Proceedings of the 57th Hawaii International Conference on System Sciences
Related To (URI)
Table of Contents
Rights
Attribution-NonCommercial-NoDerivatives 4.0 International
Rights Holder
Local Contexts
Email libraryada-l@lists.hawaii.edu if you need this content in ADA-compliant format.