Abstract
This paper aims at addressing the problem of what characterises decision-aiding for public policy making problem situations. Under such a perspective it analyses concepts like “public policy”, “deliberation”, “legitimation”, “accountability” and shows the need to expand the concept of rationality which is expected to support the acceptability of a public policy. We then analyse the more recent attempt to construct a rational support for policy making, the “evidence-based policy making” approach. Despite the innovation introduced with this approach, we show that it basically fails to address the deep reasons why supporting the design, implementation and assessment of public policies is such a hard problem. We finally show that we need to move one step ahead, specialising decision-aiding to meet the policy cycle requirements: a need for policy analytics.
Similar content being viewed by others
References
Alexander, E. R. (2000). Rationality revisited: Planning paradigms in a post-postmodernist perspective. Journal of Planning Education and Research, 19, 242–256.
Almquist, R., Grossi, G., van Helden, G.J ., & Reichard, C. (2013). Public sector governance and accountability. Critical Perspectives of Accounting, 24, 479–487.
Anderson, J. (1975). Public policy making. New York: Praeger Publishing. 9 editions, last in 2006 with Houghton Miffling.
Aristotle. (1990). Nicomachean ethics. Oxford: Oxford University Press. Originally published in 350bc, english edition by I. Bywater.
Beck, U. (1992). Risk society: Towards a new modernity. New Delhi: Sage. Translated from the German Risikogesellschaft, published in 1986.
Blair, T. (1994). Labour party manifesto. http://www.labour-party.org.uk/manifestos/1997/1997-labour-manifesto.shtml
Blunkett, D. (2000). Influence or irrelevance: Can social science improve government. In Speech to the economic and social research council.
Bouyssou, D., Marchant, T., Pirlot, M., Perny, P., Tsoukiàs, A., & Vincke, P. (2000). Evaluation and decision models: A critical perspective. Dordrecht: Kluwer.
Bouyssou, D., Marchant, T., Pirlot, M., Tsoukis, A., & Vincke, P. (2006). Evaluation and decision models with multiple criteria. Stepping stones for the analyst. Berlin: Springer.
Brewer, G. D. (1974). The policy science emerge: To nature and structure a discipline. Policy Sciences, 5, 239–244.
Brewer, G., & de Leon, P. (1983). The foundations of policy analysis. Cole: Brooks.
Buckingham Shum, S. (2012). Learning analytics. UNESCO Policy Brief.
Cabinet Office, London. (1999). Modernising Government White Paper.
Cabinet Office, London. (2001). Regulatory Impact Appraisal.
Cabinet Office, London. (2003). The Magenta Book.
Cabinet, Performance and Innovation Unit, London. (2001). A discussion paper: Better policy delivery and design.
Comte, A. (1853). The positive philosophy of Auguste Comte. Chapman (reissued by Cambridge University Press, 2009).
Comte, A. (1865). A general view of positivism. Trubner and Co. (reissued by Cambridge University Press, 2009).
Daniell, K. A., Mazri, C., & Tsoukiàs, A. (2010). Real world decision-aiding: A case of participatory water management. In S. French & D. Rios-Insua (Eds.), e-Democracy: A group decision and negotiation perspective (pp. 125–150). Berlin: Springer.
Davenport, T. H., & Harris, J. H. (2007). Competing on analytics: The new science of winning. Harvard: Harvard Business School Press.
Davenport, T. H., Harris, J. G., & Morison, R. (2010). Analytics at work: Smarter decisions, better results. Boston: Harvard Business Press.
Davies, P. T. (2004). Is evidence-based government possible? Jerry Lee Lecture: http://www.nationalschool.gov.uk/policyhub/downloads/JerryLeeLecture1202041
Davies, P. T. (1999). What is evidence-based education? British Journal of Educational Studies, 47(2), 108–121.
De Saint-Simon, C. H. (1976). Political thought of Saint-Simon. Oxford: Oxford University Press.
Dente, B. (2011). Le decisioni di policy. Bologna: Il Mulino. (In Italian).
Department of Education, Training ad Youth. (2000). The impact of educational research. Technical report, Higher Education Division.
Dowie, J. (1996). Evidence based medicine. Needs to be within framework of decision making based on decision analysis. British Medical Journal, 20, 170–171.
Dror, Y. (1964). Muddling through: “science” or inertia? Public Administration Review, 24, 153–157.
Dryzek, J. S. (2006). Policy analysis as critique. In M. Moran, M. Rein, & R. E. Goodin (Eds.), The Oxford handbook of public policy, chapter 9 (pp. 190–203). New York: Oxford University Press.
Dunn, W. (1981). Public policy analysis. An introduction. Englewood Cliffs, NJ: Prentice Hall.
Dye, T. (1972). Understanding public policy. Englewood Cliffs, NJ: Prentice Hall.
Etzioni, A. (1967). Mixed scanning: A third approach to decision making. Public Administration Review, 27, 387–392.
Faludi, A. (1973). Planning theory. Oxford: Oxford University Press.
Fitzsimmons, P. (2010). Rapid access to information: The key to cutting costs in the NHS. British Journal of Healthcare Management, 16, 448–450.
Friedman, J. (1987). Planning in the public domain: From knowledge to actions. Princeton, NJ: Princeton University Press.
Giddens, A. (1974). Positivism and sociology. London: Heinemann.
Goodin, R. E., Rein, M., & Moran, M. (2006). The public and its policies. In M. Moran, M. Rein, & R. E. Goodin (Eds.), The Oxford handbook of public policy, chapter 1 (pp. 3–35). New York: Oxford University Press.
Gray, J. A. M. (1997). Evidence-based healthcare: How to make health policy and management decisions. New York: Churchill Livingstone.
Grimshaw, J. M., Thomas, R. M., MacLennan, G., Fraser, C., & Ramsay, C. R. (2003). Effectiveness and efficienciency of guideline dissemination and implementation strategies. Final report. Aberdeen: Health Services Research Unit.
Habermas, J. (1984). The theory of communicative action. Oxford: Polity Press.
Hammond, P. J. (1997). Rationality in economics. Rivista Internazionale di Scienze Sociali CV, 247–288.
Hanfling, O. (1981). Logical positivism. Oxford: Blackwell.
Harsanyi, J. C. (1955). Cardinal welfare, individualistic ethics, and interpersonal comparisons of utility. Journal of Political Economy, 63, 309–321.
Hill, M. (1997). The public policy process. Harlow, England: Pearson Education Limited.
HM Treasury, London (1997). Appraisal and evaluation in central goverment. London: The Green Book.
HM Treasury, London (2003) The green book: A guide to appraisal and evaluation.
Hostovsky, C. (2006). The paradox of the rational comprehensive model of planning. Tales from waste management planning in Ontario, Canada. Journal of Planning Education and Research, 25, 382–395.
Jann, W., & Wegrich, K. (2007). Theories of the policy cycle. In F. Fischer, G. J. Miller, & M. S. Sidney (Eds.), Handbook of public policy analysis (pp. 43–62). Boca Raton, FL: CRC Press.
Jenkins, W. (1978). Policy analysis: A political and organizational perspective. Oxford: Martin Robertson.
Kingdon, J. W. (1984). Agendas, alternatives and public policies. Boston, NY: Little Brown.
Kraft, M., & Furlong, S. R. (2007). Public policy. Politics, analysis and alternatives (2nd ed.). Washington: CQ Press.
Lasswell, H. D. (1948). Power and personality. New York: Norton.
Lasswell, H. D. (1956). The decision process: Seven categories of functional analysis. College Park: University of Maryland Press.
Lasswell, H. D. (1965). World politics and personal security. New York: Free Press.
Latham, M. (2001). The myths of the welfare state. In Key note presentation. Brisbane: Institute of Public Administration Australia, Qld Division.
Lerner, D., & Lasswell, H. D. (1951). The policy sciences. Stanford: Stanford University Press.
Lindblom, A. (1959). The science of muddling through. Public Administration Review, 19, 78–88.
March, J. C., & Olsen, J. P. (1976). Ambiguity and choice in organizations. Bergen: Universitetsforlaget.
March, J. C., & Olsen, J. P. (1989). Rediscovering intitutions: The organizational basis of politics. New York: The Free Press.
Marston, G., & Watts, R. (2003). Tampering with the evidence: A critical appraisal of evidence-based policy-making. The Drawing Board: An Australian Review of Public Affairs, 3, 143–166.
May, J. V., & Wildavsky, A. B. (1978). The policy cycle. Beverly Hills: Sage Publications.
Mazri, C., Debray, B., Merad, M. & Tsoukiàs A. (2012). Participative design of participation structures: A general approach and some risk management case studies. Cahier du LAMSADE, 327, Universit Paris Dauphine.
Mazri, C., Lucertini, G., Olivotto, A., Prod’homme, G. & Tsoukiàs, A. (2014). Protection of transport infrastructures against major accidents in land use planning policies. A decision support approach. Journal of Loss Prevention in the Process Industries, 27, 119–129.
Melnyk, B. M., & Fineout-Overholt, E. (2005). Making the case for evidence-based practice. Philadelphia: Lippincott Williams & Wilkins.
Mitchell, G. (1999). Evidence-based practice: Critique and alternative view. Nursing Science Quarterly, 12, 30–35.
Nutley, S. M., Walter, I., & Davies, H. T. O. (2003). From knowing to doing: A framework for understanding the evidence-into-practice agenda. Evaluation, 9(2), 125–148.
ODPM, Office of the Deputy Prime Minister, London (2000). Integrated Policy Appraisal.
Ostanello, A., & Tsoukiàs, A. (1993). An explicative model of public interorganisational interactions. European Journal of Operational Research, 70, 67–82.
Ostrom, V., & Ostrom, E. (1971). Public choice: A different approach to the study of public administration. Public Administration Review, 31, 203–216.
Ostrom, E., & Ostrom, V. (2004). The quest for meaning in public choice. American Journal of Economics and Sociology, 63(1), 105–147.
Parson, W. (2002). From muddling through to muddling up—evidence based policy making and the modernisation of British Government. Public Policy and Administration, 17, 43–60.
Perri, S. (2002). Can policy making be evidence-based? Journal of Integrated Care, 10, 3–8.
Phillips Inquiry, London. (2001). The BSE inquiry: The inquiry into BSE and variant CJD in the United Kingdom.
Regional Policy Inforegio. (2011). EVALSED: The resource for the evaluation of socio-economic development. European Commission. [Online; Accessed 06 June 2011].
Robbins, L. (1932). An essay on the nature and significance of economic science. London: Macmillan.
Royal Society, London (2002). Foot and Mouth Desease 2001: Lessons To Be Learned Inquiry.
Sackett, D. L., Rosenberg, W. M., Gray, J. A., Haynes, R. B., & Richardson, W. S. (1996). Evidence based medicine: What it is and what it isn’t. British Medical Journal, 13, 71–72.
Sanderson, I. (2002). Evaluation, policy learning and evidence-based policy making. Public Administration, 80(1), 1–22.
Schön, D. A. (1979). Generative metaphor: A perspective on problem-setting in social policy. In A. Ortony (Ed.), Metaphor and thought (pp. 137–163). Cambridge: Cambridge University Press.
Simon, H. A. (1947). Administrative behaviour: A study of decision making processes in administrative organizations. New York: MacMillan.
Simon, H. A. (1955). A behavioural model of rational choice. The Quarterly Journal of Economics, 69, 99–118.
Simon, H. A. (1959). Theories of decision-making in economics and behavioral science. American Economic Review, 49, 253–283.
Simon, H. A. (1962). The architecture of complexity. Proceedings of the American Philosophical Society, 106, 467–482.
Simon, H. A. (1964). Administrative behavior: A study of decision making process in administrative organizations. New York: Mac Millan.
Simon, H. A. (1969). The science of the artificial. Cambridge: The MIT Press.
Simon, H. A. (1979). Rational decision making in business organisations. American Economic Review, 69, 349–513.
Smith, S., & Kulynych, J. (2002). It may be social, but why is it capital? The social construction of social capital and the politics of language. Politics and Society, 30(1), 149–186.
Solesbury, W. (2001). Evidence based policy: Whence it came and where it’s going. ESRC UK Centre for Evidence Based Policy and Practice, October 2001. Working Paper 1.
Sutcliffe, S. & Court, J. (2005). Evidence-based policy making: What is it? How does it work? What relevance for developing country? London: Overseas Development Institute.
Trinder, L. (2000). Introduction: The context of evidence-based practice. In L. Trinder & S. Reynolds (Eds.), Evidence-based practice: A critical appraisal (pp. 1–16). Oxford: Blackwell Science.
Tsoukiàs, A., Montibeller, G., Lucertini, G., & Belton, V. (2013). Policy analytics: An agenda for research and practice. EURO Journal on Decision Processes, 1, 115–134.
Tsoukiàs, A. (2007). On the concept of decision aiding process: An operational perspective. Annals of Operations Research, 154, 3–27.
Tsoukiàs, A. (2008). From decision theory to decision aiding methodology. European Journal of Operational Research, 187, 138–161.
Watzlawick, P., Beavin, J. H., & Jackson, D. D. (1967). Pragmatics of human communication. New York: W.W. Norton.
Weber, M. (1922). Wirtschaft und Gesellschaft. Tubingen: Mohr.
Wells, P. (2007). New labour and evidence based policy making: 1997–2007. People, Place and Policy, 1, 22–29.
White, L. D. (1926). Introduction to the study of public administration. New York: The Macmillan Company.
Wilson, W. (1887). The study of administration. Political Science Quarterly, 2, 197–222.
Young, K., Ashby, D., Boaz, A., & Grayson, L. (2002). Social science and the evidence-based policy movement. Social Policy & Society, 1, 215–224.
Zammito, J. H. (2004). A nice derangement of epistemes. Post-positivism in the study of science from Quine to Latour. Chicago: The University of Chicago Press.
Acknowledgments
This paper has gone through multiple versions. The evolution of the paper benefitted from the remarks of many colleagues (mostly during the special sessions about policy analytics in the EURO conferences in Vilnius, 2012 and Rome, 2013) among which we would like to mention Valerie Belton and Gilberto Montibeler with whom we wrote a position paper about policy analytics (originally scheduled to appear after this one). The comments of three referees as well as of the guest editors helped us very much in order to improve the paper. The support of a PEPS/PSL-CNRS 2013 grant is acknowledged by the third author. When the first version of this paper was written the first author was with the Department of Architecture at Alghero, University of Sassari, IT, while the second author was with the DIMEG, University of Padova, IT. The support of both is acknowledged.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
De Marchi, G., Lucertini, G. & Tsoukiàs, A. From evidence-based policy making to policy analytics. Ann Oper Res 236, 15–38 (2016). https://doi.org/10.1007/s10479-014-1578-6
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10479-014-1578-6