Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Experimental Evidence on Decision-Making in Availability Service Level Agreements

Published: 01 March 2016 Publication History

Abstract

As more enterprises buy information technology services, studying their underpinning contracts becomes more important. With cloud computing and outsourcing, these service level agreements (SLAs) are now often the only link between the business and the supporting IT services. This paper presents an experimental economics investigation of decision-making with regard to availability SLAs, among enterprise IT professionals. The method and the ecologically valid subjects make the study unique to date among IT service SLA studies. The experiment consisted of pairwise choices under uncertainty, and subjects (<inline-formula><tex-math notation="LaTeX">$N=46$</tex-math></inline-formula>) were incentivized by payments based on one of their choices, randomly selected. The research question investigated in this paper is: Do enterprise IT professionals maximize expected value when procuring availability SLAs, as would be optimal from the business point of view? The main result is that enterprise IT professionals fail to maximize expected value. Whereas some subjects do maximize expected value, others are risk-seeking, risk-averse, or exhibit nonmonotonic preferences. The nonmonotonic behavior in particular is an interesting observation, which has no obvious explanation in the literature. For a subset of the subjects (<inline-formula><tex-math notation="LaTeX">$N=29$</tex-math></inline-formula>), a few further hypotheses related to associations between general attitude to risk or professional experience on the one hand, and behavior in SLAs on the other hand, were investigated. No support for these associations was found. The results should be interpreted with caution, due to the limited number of subjects. However, given the prominence of SLAs in modern IT service management, the results are interesting and call for further research, as they indicate that current professional decision-making regarding SLAs can be improved. In particular, if general attitude to risk and professional experience do not impact decision-making with regard to SLAs, more extensive use of decision-support systems might be called for in order to facilitate proper risk management.

References

[1]
S. Marston, Z. Li, S. Bandyopadhyay, J. Zhang, and A. Ghalsasi, “Cloud computing—The business perspective,” Decision Support Syst., vol. 51, no. 1, pp. 176–189, 2011.
[2]
S. Karunakaran, V. Krishnaswamy, and R. Sundarraj, “Decisions, models and opportunities in cloud computing economics: A review of research on pricing and markets,” in Service Research and Innovation. New York, NY, USA: Springer, 2014, pp. 85–99.
[3]
G. Spafford, I. Head, and J. M. Brooks, “Use this 10-step approach to service-level management to deliver business value,” Gartner, Inc., Stamford, CT, USA, Tech. Rep. , Aug. 2013.
[4]
M. Sallé and C. Bartolini, “Management by contract,” in Proc. IEEE/IFIP Netw. Oper. Manage. Symp. (NOMS’04), 2004, vol. 1, pp. 787–800.
[5]
D. Williams, “The challenges and approaches of establishing IT infrastructure monitoring SLAs in IT operations,” Gartner, Inc., Stamford, CT, USA, Tech. Rep. , Sep. 2010.
[6]
S. Taylor, V. Lloyd, and C. Rudd, Service Design (ITIL). London, U.K.: The Stationery Office, TSO, 2007.
[7]
IBM Global Services, “Improving systems availability,” IBM Global Services, Atlanta, GA, USA, Tech. Rep., 1998.
[8]
B. Jackson, “Business continuity planning: Evolution in response to major news events,” in Encyclopedia of Information Assurance. New York, NY, USA: Taylor & Francis, 2011, ch. 46, pp. 377–383.
[9]
S. Taylor, D. Cannon, and D. Wheeldon, Service Operation (ITIL). London, U.K., The Stationery Office, TSO, 2007.
[10]
D. Smith and D. Scott, “Increase availability through best-in-class benchmarking and by targeting causes of downtime,” Gartner, Inc., Stamford, CT, USA, Tech. Rep. , Sep. 2014.
[11]
F. Marques, J. Sauvé, and J. Moura, “SLA design and service provisioning for outsourced services,” J. Netw. Syst. Manage., vol. 17, no. 1, pp. 73–90, 2009.
[12]
A. González and B. Helvik, “Guaranteeing service availability in SLAs; A study of the risk associated with contract period and failure process,” in Proc. IEEE Latin-Amer. Conf. Commun. (LATINCOM’09), 2009, pp. 1–6.
[13]
U. Franke, M. Buschle, and M. Österlind, “An experiment in SLA decision-making,” in Economics of Grids, Clouds, Systems, and Services. New York, NY, USA: Springer, 2013, pp. 256–267.
[14]
G. Held, “Service level agreements,” in Encyclopedia of Information Assurance. New York, NY, USA: Taylor & Francis, 2011, ch. 329, pp. 2705–2708.
[15]
The Open Group. (2000). TOGAF Glossary [Online]. Available: http://www.opengroup.org/public/arch/p4/glossary/glossary.htm, accessed on Aug. 10, 2015.
[16]
Gartner Inc. (2012). IT Definitions and Glossary [Online]. Available: http://www.gartner.com/technology/it-glossary/, accessed on Feb. 27, 2012.
[17]
P. Johnson, “Enterprise software system integration: An architectural perspective,” Ph.D. dissertation, Industrial Information and Control Systems, Royal Inst. Technol. (KTH), Stockholm, Sweden, Apr. 2002.
[18]
M. Fowler, Patterns of Enterprise Application Architecture. Reading, MA, USA: Addison-Wesley, 2003.
[19]
W. Morris, Ed., American Heritage Dictionary of the English Language, New College ed. Boston, MA, USA: Houghton Mifflin, 1976.
[20]
H. Demirkan and J. C. Spohrer, “Servitized enterprises for distributed collaborative commerce,” in Technological Applications and Advancements in Service Science, Management, and Engineering. Los Alamitos, CA, USA: IEEE Computer Society, 2012, p. 70.
[21]
G. C. Silaghi, L. D. Şerban, and C. M. Litan, “A framework for building intelligent SLA negotiation strategies under time constraints,” in Economics of Grids, Clouds, Systems, and Services. New York, NY, USA: Springer, 2010, pp. 48–61.
[22]
E. Yaqub, R. Yahyapour, P. Wieder, C. Kotsokalis, K. Lu, and A. I. Jehangiri, “Optimal negotiation of service level agreements for cloud-based services through autonomous agents,” in Proc. IEEE Int. Conf. Serv. Comput. (SCC), 2014, pp. 59–66.
[23]
B. Tang and M. Tang, “Bayesian model-based prediction of service level agreement violations for cloud services,” in Proc. IEEE Theor. Aspects Softw. Eng. Conf. (TASE), 2014, pp. 170–176.
[24]
Y. Diao, L. Lam, L. Shwartz, and D. Northcutt, “Modeling the impact of service level agreements during service engagement,” IEEE Trans. Netw. Serv. Manage., vol. 11, no. 4, pp. 431–440, Dec. 2014.
[25]
I. Aib and R. Boutaba, “On leveraging policy-based management for maximizing business profit,” IEEE Trans. Netw. Serv. Manage., vol. 4, no. 3, pp. 25–39, Dec. 2007.
[26]
T. Setzer, K. Bhattacharya, and H. Ludwig, “Change scheduling based on business impact analysis of change-related risk,” IEEE Trans. Netw. Serv. Manage., vol. 7, no. 1, pp. 58–71, Mar. 2010.
[27]
A. Snow, G. Weckman, and V. Gupta, “Meeting SLA availability guarantees through engineering margin,” in Proc. 9th Int. Conf. Netw. (ICN), Apr. 2010, pp. 331–336.
[28]
A. Snow and G. Weckman, “What are the chances an availability SLA will be violated?” in Proc. 6th Int. Conf. Netw. (ICN’07), 2007, p. 35.
[29]
U. Franke, H. Holm, and J. König, “The distribution of time to recovery of enterprise IT services,” IEEE Trans. Reliab., vol. 63, no. 4, pp. 858–867, Dec. 2014.
[30]
C. Figueroa, N. Figueroa, A. Jofre, A. Sahai, Y. Chen, and S. Iyer, “A game theoretic framework for SLA negotiation,” HP Lab., Palo Alto, CA, USA, Tech. Rep. , 2008.
[31]
H. Demirkan, M. Goul, and D. S. Soper, “Service level agreement negotiation: A theory-based exploratory study as a starting point for identifying negotiation support system requirements,” in Proc. Hawaii Int. Conf. Syst. Sci., 2005, vol. 1, p. 37b.
[32]
V. K. Rai and S. Mehta, “Performance assessment of outsourced service engagements: Leveraging economic theories based critical success factors,” in Proc. 8th Annu. IEEE Syst. Conf. (SysCon), 2014, pp. 277–284.
[33]
Y. Fu, K. K. Lai, and L. Liang, “A robust optimisation approach to the problem of supplier selection and allocation in outsourcing,” Int. J. Syst. Sci., vol. 47, no. 4, pp. 913–918, 2016. https://doi.org/10.1080/00207721.2014.907970.
[34]
M. Hedwig, S. Malkowski, and D. Neumann, “Risk-aware service level agreement design for enterprise information systems,” in Proc. 45th Hawaii Int. Conf. Syst. Sci. (HICSS), 2012, pp. 4552–4561.
[35]
A. Kieninger, D. Baltadzhiev, B. Schmitz, and G. Satzger, “Towards service level engineering for it services: Defining it services from a line of business perspective,” in Proc. Annu. SRII Global Conf. (SRII), 2011, pp. 759–766.
[36]
J. J. Trienekens, J. J. Bouman, and M.van der Zwan, “Specification of service level agreements: Problems, principles and practices,” Softw. Qual. J., vol. 12, pp. 43–57, 2004. https://doi.org/10.1023/B:SQJO.0000013358.61395.96.
[37]
E. Katok, D. Thomas, and A. Davis, “Inventory service-level agreements as coordination mechanisms: The effect of review periods,” Manuf. Serv. Oper. Manage., vol. 10, no. 4, pp. 609–624, 2008.
[38]
S. Huck and G. Weizsäcker, “Risk, complexity, and deviations from expected-value maximization: Results of a lottery choice experiment,” J. Econ. Psychol., vol. 20, no. 6, pp. 699–715, 1999.
[39]
W. Davenport and M. Middleton, “Expectation theories of decision making for duplex gambles,” Acta Psychol., vol. 37, no. 3, pp. 155–172, 1973.
[40]
D. Kahneman and A. Tversky, “Prospect theory: An analysis of decision under risk,” Econometrica, vol. 47, no. 2, pp. 263–291, Mar. 1979.
[41]
C. Starmer, “Developments in non-expected utility theory: The hunt for a descriptive theory of choice under risk,” J. Econ. Lit., vol. 38, no. 2, pp. 332–382, Jun. 2000.
[42]
J. A. List and C. F. Mason, “Are CEOs expected utility maximizers?” J. Econom., vol. 162, no. 1, pp. 114–123, 2011.
[43]
H. J. Holm, S. Opper, and V. Nee, “Entrepreneurs under uncertainty: An economic experiment in China,” Manage. Sci., vol. 59, no. 7, pp. 1671–1687, 2013.
[44]
S. Andersen, A. Di Girolamo, G. W. Harrison, and M. I. Lau, “Risk and time preferences of entrepreneurs: Evidence from a Danish field experiment,” Theory Decision, vol. 77, no. 3, pp. 341–357, 2014.
[45]
M. Lefebvre and F. M. Vieider, “Risk taking of executives under different incentive contracts: Experimental evidence,” J. Econ. Behav. Organ., vol. 97, pp. 27–36, 2014.
[46]
U. Franke, “Optimal IT service availability: Shorter outages, or fewer?” IEEE Trans. Netw. Serv. Manage., vol. 9, no. 1, pp. 22–33, Mar. 2012.
[47]
A. Høyland and M. Rausand, System Reliability Theory: Models and Statistical Methods. Hoboken, NJ, USA: Wiley, 1994.
[48]
D. Patterson, “A simple way to estimate the cost of downtime,” in Proc. 16th Syst. Admin. Conf. (LISA), 2002, pp. 185–188.
[49]
F. Bergström and J. Arnberg, “När handlar vi?—Om konsumtionsmönster i den traditionella detaljhandeln,” Handelns Utredningsinstitut, Stockholm, Sweden, Tech. Rep., Mar. 2005, (in Swedish).
[50]
E. Marcus and H. Stern, Blueprints for High Availability, 2nd ed. Hoboken, NJ, USA: Wiley, 2003.
[51]
B. Malik and D. Scott, “How to calculate the cost of continuously available IT services,” Gartner, Inc., Stamford, CT, USA, Tech. Rep. , Nov. 2010.
[52]
C. Tran and Z. Dziong, “Service overlay network capacity adaptation for profit maximization,” IEEE Trans. Netw. Serv. Manage., vol. 7, no. 2, pp. 72–82, Jun. 2010.
[53]
Z. Liu, M. S. Squillante, and J. L. Wolf, “On maximizing service-level-agreement profits,” in Proc. 3rd ACM Conf. Electron. Commerce, 2001, pp. 213–223.
[54]
L. Zhang and D. Ardagna, “SLA based profit optimization in autonomic computing systems,” in Proc. 2nd Int. Conf. Serv. Oriented Comput., 2004, pp. 173–182.
[55]
M. B. Brewer, “Research design and issues of validity,” in Handbook of Research Methods in Social and Personality Psychology. Cambridge, U.K.: Cambridge University Press 2000, pp. 3–16.
[56]
U. Franke, P. Johnson, and J. König, “An architecture framework for enterprise IT service availability analysis,” Softw. Syst. Model., vol. 13, pp. 1417–1445, 2014.
[57]
P. Johnson, J. Ullberg, M. Buschle, U. Franke, and K. Shahzad, “An architecture modeling framework for probabilistic prediction,” Inf. Syst. e-Bus. Manage., vol. 12, pp. 595–622, 2014.
[58]
A. Kieninger, J. Westernhagen, and G. Satzger, “The economics of service level engineering,” in Proc. 44th Hawaii Int. Conf. Syst. Sci. (HICSS), 2011, pp. 1–10.

Cited By

View all
  • (2021)SINIS-LA Method for IT Alignment Considering Service Level ManagementProceedings of the XVII Brazilian Symposium on Information Systems10.1145/3466933.3466977(1-8)Online publication date: 7-Jun-2021
  • (2020)Digitizing Service Level Agreements in Service-Oriented Enterprise ArchitectureSN Computer Science10.1007/s42979-020-00256-21:5Online publication date: 9-Aug-2020
  • (2019)Risks and assets: a qualitative study of a software ecosystem in the mining industryProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3340443(895-904)Online publication date: 12-Aug-2019
  • Show More Cited By

Index Terms

  1. Experimental Evidence on Decision-Making in Availability Service Level Agreements
    Index terms have been assigned to the content through auto-classification.

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image IEEE Transactions on Network and Service Management
    IEEE Transactions on Network and Service Management  Volume 13, Issue 1
    March 2016
    164 pages

    Publisher

    IEEE Press

    Publication History

    Published: 01 March 2016

    Qualifiers

    • Research-article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 16 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2021)SINIS-LA Method for IT Alignment Considering Service Level ManagementProceedings of the XVII Brazilian Symposium on Information Systems10.1145/3466933.3466977(1-8)Online publication date: 7-Jun-2021
    • (2020)Digitizing Service Level Agreements in Service-Oriented Enterprise ArchitectureSN Computer Science10.1007/s42979-020-00256-21:5Online publication date: 9-Aug-2020
    • (2019)Risks and assets: a qualitative study of a software ecosystem in the mining industryProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3340443(895-904)Online publication date: 12-Aug-2019
    • (2019)QoS and Profit Aware Task Scheduling with Simulated-Annealing-Based Bi-Objective Differential Evolution in Green Clouds2019 IEEE 15th International Conference on Automation Science and Engineering (CASE)10.1109/COASE.2019.8842927(904-909)Online publication date: 22-Aug-2019
    • (2019)Characteristics that affect preference of decision models for asset selection: an industrial questionnaire surveySoftware Quality Journal10.1007/s11219-019-09489-828:4(1675-1707)Online publication date: 28-Dec-2019

    View Options

    View options

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media