The Variance Learning Curve
Abstract
The expansive learning curve literature in operations management has established how various facets of prior experience improve average performance. In this paper, we explore how increased cumulative experience affects performance variability or consistency. We use a two-stage estimation method of a heteroskedastic learning curve model to examine the relationship between experience and performance variability among paramedics at the London Ambulance Service. We find that, for paramedics with lower experience, an increase in experience of 500 jobs reduces the variance of task completion time by 8.7%, in addition to improving average completion times by 2.7%. Similar to prior results on the average learning curve, we find a diminishing impact of additional experience on the variance learning curve. We provide an evidence base for how to model the learning benefits of cumulative experience on performance in service systems. Our findings imply that the benefits of learning are substantially underestimated if the consistency effect is ignored. Specifically, our estimates indicate that queue lengths (or wait times) might be overestimated by as much as 4% by ignoring the impact of the variance learning curve in service systems. Furthermore, our results suggest that previously established drivers of productivity should be revisited to examine how they affect consistency, in addition to average performance.
This paper was accepted by Charles Corbett, operations management.
References
[1]
Akşin Z, Deo S, Jónasson JO, Ramdas K (2020) Learning from many: Partner exposure and team familiarity in fluid teams. Management Sci., ePub ahead of print, June 25, https://doi.org/10.1287/mnsc.2019.3576.
[2]
Alchian A (1963) Reliability of progress curves in airframe production. Econometrica 31(4):679–693.
[3]
Argote L (2012) Organizational Learning: Creating, Retaining and Transferring Knowledge (Springer Science & Business Media, Boston).
[4]
Argote L, Epple D (1990) Learning curves in manufacturing. Science 247(4945):920–924.
[5]
Arlotto A, Chick SE, Gans N (2014) Optimal hiring and retention policies for heterogeneous workers who learn. Management Sci. 60(1):110–129.
[6]
Barth ME, Landsman WR, Lang MH (2008) International accounting standards and accounting quality. J. Accounting Res. 46(3):467–498.
[7]
Batt RJ, Gallino S (2019) Finding a needle in a haystack: The effects of searching and learning on pick-worker performance. Management Sci. 65(6):2624–2645.
[8]
Bavafa H, Jónasson JO (2020) Recovering from critical incidents: Evidence from paramedic performance. Manufacturing Service Oper. Management, ePub ahead of print, April 7, https://doi.org/10.1287/msom.2019.0863.
[9]
Boh WF, Slaughter SA, Espinosa JA (2007) Learning from experience in software development: A multilevel analysis. Management Sci. 53(8):1315–1331.
[10]
Clark JR, Huckman RS, Staats BR (2013) Learning from customers: Individual and organizational effects in outsourced radiological services. Organ. Sci. 24(5):1539–1557.
[11]
Da Silva FP, Santos JA, Meireles A (2014) Road accident: Driver behaviour, learning and driving task. Procedia Soc. Behav. Sci. 162:300–309.
[12]
Dar-El EM (2013) Human Learning: From Learning Curves to Learning Organizations (Springer Science & Business Media, New York).
[13]
Dechow PM, Dichev ID (2002) The quality of accruals and earnings: The role of accrual estimation errors. Accounting Rev. 77(s-1):35–59.
[14]
Delaney PF, Reder LM, Staszewski JJ, Ritter FE (1998) The strategy-specific nature of improvement: The power law applies by strategy within task. Psych. Sci. 9(1):1–7.
[15]
Deo S, Jain A (2019) Slow first, fast later: Temporal speed-up in service episodes of finite duration. Production Oper. Management 28(5):1061–1081.
[16]
Evenson KR, Rosamond WD, Morris DL (2001) Prehospital and in-hospital delays in acute stroke care. Neuroepidemiology 20(2):65–76.
[17]
Falk A, Zimmermann F (2016) Consistency as a signal of skills. Management Sci. 63(7):2197–2210.
[18]
Feero S, Hedges JR, Simmons E, Irwin L (1995) Does out-of-hospital EMS time affect trauma survival? Amer. J. Emergency Medicine 13(2):133–135.
[19]
Gans N, Liu N, Mandelbaum A, Shen H, Ye H (2010) Service times in call centers: Agent heterogeneity and learning with some operational consequences. Berger JO, Cai TT, Johnstone IM, eds. Borrowing Strength: Theory Powering Applications–A Festschrift for Lawrence D. Brown (Institute of Mathematical Statistics, Beachwood, OH), 99–123.
[20]
Gaur V, Kesavan S, Raman A, Fisher ML (2007) Estimating demand uncertainty using judgmental forecasts. Manufacturing Service Oper. Management 9(4):480–491.
[21]
Gold LS, Fahrenbruch CE, Rea TD, Eisenberg MS (2010) The relationship between time to arrival of emergency medical services (EMS) and survival from out-of-hospital ventricular fibrillation cardiac arrest. Resuscitation 81(5):622–625.
[22]
Greene WH (2003) Econometric Analysis, 5th ed. (Prentice Hall, Upper Saddle River, NJ).
[23]
Harrell FE (2001) Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis (Springer, New York).
[24]
Harvey AC (1976) Estimating regression models with multiplicative heteroscedasticity. Econometrica 44(3):461–465.
[25]
Huckman RS, Pisano GP (2006) The firm specificity of individual performance: Evidence from cardiac surgery. Management Sci. 52(4):473–488.
[26]
Huckman RS, Staats BR (2011) Fluid tasks and fluid teams: The impact of diversity in experience and team familiarity on team performance. Manufacturing Service Oper. Management 13(3):310–328.
[27]
Huckman RS, Staats BR, Upton DM (2009) Team familiarity, role experience, and performance: Evidence from Indian software services. Management Sci. 55(1):85–100.
[28]
KC DS, Staats BR (2012) Accumulating a portfolio of experience: The effect of focal and related experience on surgeon performance. Manufacturing Service Oper. Management 14(4):618–633.
[29]
KC DS, Terwiesch C (2011) The effects of focus on performance: Evidence from California hospitals. Management Sci. 57(11):1897–1912.
[30]
Kent P, Siemsen E (2018) Production process moves: template use and the need to adapt. Production Oper. Management 27(3):480–495.
[31]
Kim JW, Ritter FE (2015) Learning, forgetting, and relearning for keystroke-and mouse-driven tasks: Relearning is important. Human-Comput. Interaction 30(1):1–33.
[32]
Kim S, Song H, Valentine M (2018) Cross-disciplinary temporary teams in healthcare organizations: The role of partner variety and shared experience. Working paper, Marshall School of Business, University of Southern California.
[33]
Kingman JFC (1961) The single server queue in heavy traffic. Math. Proc. Cambridge Philos. Soc. 57:902–904.
[34]
Larsson AFL, Kircher K, Hultgren JA (2014) Learning from experience: Familiarity with acc and responding to a cut-in situation in automated driving. Transportation Res. Part F: Traffic Psych. Behav. 27:229–237.
[35]
Lewis M (2008) Price dispersion and competition with differentiated sellers. J. Indust. Econom. 56(3):654–678.
[36]
Narayanan S, Balasubramanian S, Swaminathan JM (2009) A matter of balance: Specialization, task variety, and individual learning in a software maintenance environment. Management Sci. 55(11):1861–1876.
[37]
Narayanan S, Swaminathan JM, Talluri S (2014) Knowledge diversity, turnover, and organizational-unit productivity: An empirical analysis in a knowledge-intensive context. Production Oper. Management 23(8):1332–1351.
[38]
Newell A, Rosenbloom PS (1981) Mechanisms of skill acquisition and the law of practice. Cognitive Skills Acquisition 1:1–55.
[39]
Papachristofi O, Jenkins D, Sharples LD (2016) Assessment of learning curves in complex surgical interventions: A consecutive case-series study. Trials 17(1):1–10.
[40]
Reagans R, Argote L, Brooks D (2005) Individual experience and experience working together: Predicting learning rates from knowing who knows what and knowing how to work together. Management Sci. 51(6):869–881.
[41]
Ritter FE, Baxter G, Kim JW, Srinivasmurthy S (2013) Learning and retention. Lee JD, Lee AK, eds. The Oxford Handbook of Cognitive Engineering (Oxford University Press, New York), 125–142.
[42]
Robbins TR (2015) Experience-based routing in call center environments. Service Sci. 7(2):132–148.
[43]
Rossnagel K, Jungehülsing GJ, Nolte CH, Müller-Nordhorn J, Roll S, Wegscheider K, Villringer A, Willich SN (2004) Out-of-hospital delays in patients with acute stroke. Ann. Emergency Medicine 44(5):476–483.
[44]
Sherman J, Weiss A (2017) On fruitful and futile tests of the relationship between search and price dispersion. Econom. Inquiry 55(4):1898–1918.
[45]
Shostack GL (1987) Service positioning through structural change. J. Marketing 51(1):34–43.
[46]
Staats BR (2012) Unpacking team familiarity: The effects of geographic location and hierarchical role. Production Oper. Management 21(3):619–635.
[47]
Staats BR, Brunner D, Upton D (2011) Lean principles, learning, and knowledge work: Evidence from a software services provider. J. Oper. Management 29(5):376–390.
[48]
Thorndike EL (1898) Animal intelligence: An experimental study of the associative processes in animals. Psych. Rev. Monograph Supplements 2(4):i–109.
[49]
Thurstone LL (1919) The learning curve equation. Psych. Monographs 26(3):i–51.
[50]
van Leeuwen PM, Happee R, de Winter JCF (2015) Changes of driving performance and gaze behavior of novice drivers during a 30-min simulator-based training. Procedia Manufacturing 3:3325–3332.
[51]
Western B, Bloome D (2009) Variance function regressions for studying inequality. Sociol. Methodology 39(1):293–326.
[52]
Wright TP (1936) Factors affecting the cost of airplanes. J. Aeronautical Sci. 3(4):122–128.
[53]
Yelle LE (1979) The learning curve: Historical review and comprehensive survey. Decision Sci. 10(2):302–328.
Index Terms
- The Variance Learning Curve
Index terms have been assigned to the content through auto-classification.
Recommendations
The Distributional Impact of Fatigue on Performance
Little is known about how people-centric factors affect the shape of service time distributions despite distributional statistics (variance or quantiles) being key drivers of system performance in many service industries. We investigate the impact of one ...
How Bad May Learning Curves Be?
In this paper, we motivate the need for estimating bounds on learning curves of average-case learning algorithms when they perform the worst on training samples. We then apply the method of reducing learning problems to hypothesis testing ones to ...
GreedyAgent: Crafting Efficient Agents for Meta-learning from Learning Curves via Greedy Algorithm Selection
Advanced Intelligent Computing Technology and ApplicationsAbstractWith the rapid development of artificial intelligence and machine learning technologies, Automated Machine Learning (AutoML) has become a hot research area in recent years. Meta-learning plays an increasingly important role in AutoML. A key sub-...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2021, INFORMS.
Publisher
INFORMS
Linthicum, MD, United States
Publication History
Published: 01 May 2021
Accepted: 02 July 2020
Received: 22 February 2020
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 20 Nov 2024
Other Metrics
Citations
View Options
View options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in