Nothing Special   »   [go: up one dir, main page]
IDEAS home Printed from https://ideas.repec.org/p/ces/ceswps/_4636.html
   My bibliography  Save this paper

A Ranking Method Based on Handicaps

Author

Listed:
  • Gabrielle Demange
Abstract
Ranking methods are fundamental tools in many areas. Popular methods aggregate the statements of ‘experts’ in different ways. As such, there are various reasonable ranking methods, each one of them more or less adapted to the environment under consideration. This paper introduces a new method, called the handicap-based method, and characterizes it through appealing properties. This method assigns not only scores to the items but also weights to the experts. Scores and weights form an equilibrium for a relationship based on the notion of handicaps. The method is, in a sense made precise in the paper, the counterpart to the counting method in environments that require intensity-invariance. Intensity-invariance is a desirable property when the intensity of the experts' statements has to be controlled. Otherwise, both the counting and handicap-based methods satisfy a property called homogeneity, which is a desirable property when cardinal statements matter, as is the case in many applications. The method is illustrated for ranking economic journals.

Suggested Citation

  • Gabrielle Demange, 2014. "A Ranking Method Based on Handicaps," CESifo Working Paper Series 4636, CESifo.
    • Handle: RePEc:ces:ceswps:_4636
    as

    Download full text from publisher

    File URL: https://www.cesifo.org/DocDL/cesifo1_wp4636.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Gabrielle Demange, 2012. "On the influence of a ranking system," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(2), pages 431-455, July.
    2. BOAVENTURA de SOUSA SANTOS, 1998. "Participatory Budgeting in Porto Alegre: Toward a Redistributive Democracy," Politics & Society, , vol. 26(4), pages 461-510, December.
    3. Giora Slutzki & Oscar Volij, 2006. "Scoring of web pages and tournaments—axiomatizations," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 26(1), pages 75-92, January.
    4. de Clippel, Geoffroy & Moulin, Herve & Tideman, Nicolaus, 2008. "Impartial division of a dollar," Journal of Economic Theory, Elsevier, vol. 139(1), pages 176-191, March.
    5. Gabrielle Demange & Michel L. Balinski, 1989. "An Axiomatic Approach to Proportionality between Matrices," Post-Print halshs-00670952, HAL.
    6. Liebowitz, S J & Palmer, J P, 1984. "Assessing the Relative Impacts of Economic Journals," Journal of Economic Literature, American Economic Association, vol. 22(1), pages 77-88, March.
    7. Woeginger, Gerhard J., 2008. "An axiomatic characterization of the Hirsch-index," Mathematical Social Sciences, Elsevier, vol. 56(2), pages 224-232, September.
    8. AMIR, Rabah, 2002. "Impact-adjusted citations as a measure of journal quality," LIDAM Discussion Papers CORE 2002074, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    9. van den Brink, René & Gilles, Robert P., 2009. "The outflow ranking method for weighted directed graphs," European Journal of Operational Research, Elsevier, vol. 193(2), pages 484-491, March.
    10. Leo Katz, 1953. "A new status index derived from sociometric analysis," Psychometrika, Springer;The Psychometric Society, vol. 18(1), pages 39-43, March.
    11. repec:hal:pseose:halshs-00754615 is not listed on IDEAS
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Dirk Bergemann & Marco Ottaviani, 2021. "Information Markets and Nonmarkets," Cowles Foundation Discussion Papers 2296, Cowles Foundation for Research in Economics, Yale University.
    2. Antonin Macé, 2023. "The Limits of Citation Counts," Working Papers halshs-01630095, HAL.
    3. Angus, Simon D. & Atalay, Kadir & Newton, Jonathan & Ubilava, David, 2021. "Geographic diversity in economic publishing," Journal of Economic Behavior & Organization, Elsevier, vol. 190(C), pages 255-262.
    4. Eric Danan & Thibault Gajdos & Jean-Marc Tallon, 2023. "Tailored recommendations," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 60(1), pages 15-34, January.
    5. Gabrielle Demange, 2021. "On the resolution of cross-liabilities," Working Papers halshs-03151128, HAL.
    6. Dequiedt, Vianney & Zenou, Yves, 2017. "Local and consistent centrality measures in parameterized networks," Mathematical Social Sciences, Elsevier, vol. 88(C), pages 28-36.
    7. L'aszl'o Csat'o, 2019. "Journal ranking should depend on the level of aggregation," Papers 1904.06300, arXiv.org, revised Sep 2019.
    8. Demange, Gabrielle, 2017. "Mutual rankings," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 35-42.
    9. Kim‐Sau Chung & Meng‐Yu Liang & Melody Lo, 2022. "On the information contents of indirect citations," Canadian Journal of Economics/Revue canadienne d'économique, John Wiley & Sons, vol. 55(1), pages 156-173, February.
    10. Cho, Wonki Jo, 2022. "How to add apples and oranges: Aggregating performances of different nature," Games and Economic Behavior, Elsevier, vol. 131(C), pages 222-244.
    11. Flores-Szwagrzak, Karol & Treibich, Rafael, 2015. "Co-authorship and the Measurement of Individual Productivity," Discussion Papers on Economics 17/2015, University of Southern Denmark, Department of Economics.
    12. Karol Flores-Szwagrzak & Rafael Treibich, 2020. "Teamwork and Individual Productivity," Management Science, INFORMS, vol. 66(6), pages 2523-2544, June.
    13. Johannes König & David I. Stern & Richard S.J. Tol, 2022. "Confidence Intervals for Recursive Journal Impact Factors," Tinbergen Institute Discussion Papers 22-038/III, Tinbergen Institute.
    14. van den Brink, René & Rusinowska, Agnieszka, 2022. "The degree measure as utility function over positions in graphs and digraphs," European Journal of Operational Research, Elsevier, vol. 299(3), pages 1033-1044.
    15. Rene (J.R.) van den Brink & Agnieszka Rusinowska, 2017. "The Degree Measure as Utility Function over Positions in Networks," Tinbergen Institute Discussion Papers 17-065/II, Tinbergen Institute.
    16. Germano, Fabrizio & Sobbrio, Francesco, 2020. "Opinion dynamics via search engines (and other algorithmic gatekeepers)," Journal of Public Economics, Elsevier, vol. 187(C).
    17. Csató, László, 2019. "Journal ranking should depend on the level of aggregation," Journal of Informetrics, Elsevier, vol. 13(4).
    18. Sprumont, Yves, 2018. "Ranking by rating," Theoretical Economics, Econometric Society, vol. 13(1), January.
    19. Nicolas CARAYOL & Agenor LAHATTE, 2014. "Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide," Cahiers du GREThA (2007-2019) 2014-14, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).
    20. Brink, René van den & Rusinowska, Agnieszka, 2021. "The degree ratio ranking method for directed graphs," European Journal of Operational Research, Elsevier, vol. 288(2), pages 563-575.
    21. Ham, John C. & Wright, Julian & Ye, Ziqiu, 2023. "Documenting and Explaining the Dramatic Rise of the New Society Journals in Economics," IZA Discussion Papers 16337, Institute of Labor Economics (IZA).
    22. Bouyssou, Denis & Marchant, Thierry, 2016. "Ranking authors using fractional counting of citations: An axiomatic approach," Journal of Informetrics, Elsevier, vol. 10(1), pages 183-199.
    23. Lutz Bornmann & Alexander Butz & Klaus Wohlrabe, 2018. "What are the top five journals in economics? A new meta-ranking," Applied Economics, Taylor & Francis Journals, vol. 50(6), pages 659-675, February.
    24. Palacios-Huerta, Ignacio & Volij, Oscar, 2014. "Axiomatic measures of intellectual influence," International Journal of Industrial Organization, Elsevier, vol. 34(C), pages 85-90.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Demange, Gabrielle, 2017. "Mutual rankings," Mathematical Social Sciences, Elsevier, vol. 90(C), pages 35-42.
    2. Brink, René van den & Rusinowska, Agnieszka, 2021. "The degree ratio ranking method for directed graphs," European Journal of Operational Research, Elsevier, vol. 288(2), pages 563-575.
    3. Rene van den Brink & Agnieszka Rusinowska, "undated". "The Degree Ratio Ranking Method for Directed Networks," Tinbergen Institute Discussion Papers 19-026/II, Tinbergen Institute.
    4. Gabrielle Demange, 2012. "On the influence of a ranking system," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 39(2), pages 431-455, July.
    5. Gabrielle Demange, 2012. "Collective attention and ranking methods," PSE Working Papers halshs-00564982, HAL.
    6. Gabrielle Demange, 2011. "On the influence of rankings," PSE Working Papers halshs-00589657, HAL.
    7. van den Brink, René & Rusinowska, Agnieszka, 2022. "The degree measure as utility function over positions in graphs and digraphs," European Journal of Operational Research, Elsevier, vol. 299(3), pages 1033-1044.
    8. René van den Brink & Agnieszka Rusinowska, 2017. "The degree measure as utility function over positions in networks," Université Paris1 Panthéon-Sorbonne (Post-Print and Working Papers) halshs-01592181, HAL.
    9. Pantelis Kalaitzidakis & Theofanis P. Mamuneas & Thanasis Stengos, 2011. "An updated ranking of academic journals in economics," Canadian Journal of Economics, Canadian Economics Association, vol. 44(4), pages 1525-1538, November.
    10. Ignacio Palacios-Huerta & Oscar Volij, 2004. "The Measurement of Intellectual Influence," Econometrica, Econometric Society, vol. 72(3), pages 963-977, May.
    11. Carmen Herrero & Antonio Villar, 2022. "Sports competitions and the Break-Even rule," Working Papers 22.13, Universidad Pablo de Olavide, Department of Economics.
    12. Francis Bloch & Matthew O. Jackson & Pietro Tebaldi, 2023. "Centrality measures in networks," Social Choice and Welfare, Springer;The Society for Social Choice and Welfare, vol. 61(2), pages 413-453, August.
    13. Balázs Sziklai, 2018. "How to identify experts in a community?," International Journal of Game Theory, Springer;Game Theory Society, vol. 47(1), pages 155-173, March.
    14. Itay Fainmesser & Chaim Fershtman & Neil Gandal, 2009. "A Consistent Weighted Ranking Scheme With an Application to NCAA College Football Rankings," Journal of Sports Economics, , vol. 10(6), pages 582-600, December.
    15. Csató, László, 2017. "European qualifiers to the 2018 FIFA World Cup can be manipulated," MPRA Paper 82652, University Library of Munich, Germany.
    16. Mitri Kitti, 2012. "Axioms for Centrality Scoring with Principal Eigenvectors," Discussion Papers 79, Aboa Centre for Economics.
    17. Gonzalez-Diaz, J. & Hendrickx, R.L.P. & Lohmann, E.R.M.A., 2011. "Paired Comparisons Analysis : An Axiomatic Approach to Rankings in Tournaments," Discussion Paper 2011-116, Tilburg University, Center for Economic Research.
    18. Sprumont, Yves, 2018. "Ranking by rating," Theoretical Economics, Econometric Society, vol. 13(1), January.
    19. Du, Ye & Lehrer, Ehud & Pauzner, Ady, 2015. "Competitive economy as a ranking device over networks," Games and Economic Behavior, Elsevier, vol. 91(C), pages 1-13.
    20. Nicolas CARAYOL & Agenor LAHATTE, 2014. "Dominance relations and ranking when quantity and quality both matter: Applications to US universities and econ. departments worldwide," Cahiers du GREThA (2007-2019) 2014-14, Groupe de Recherche en Economie Théorique et Appliquée (GREThA).

    More about this item

    Keywords

    ranking; scores; invariant method; peers' method; handicap; scaling matrix;
    All these keywords.

    JEL classification:

    • D71 - Microeconomics - - Analysis of Collective Decision-Making - - - Social Choice; Clubs; Committees; Associations
    • D89 - Microeconomics - - Information, Knowledge, and Uncertainty - - - Other

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ces:ceswps:_4636. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Klaus Wohlrabe (email available below). General contact details of provider: https://edirc.repec.org/data/cesifde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.