Abstract
Background
Surgical skills training outside the operating room is beneficial. The best methods have yet to be identified. The authors aimed to document the predictive validity of simulation training in three different studies.
Methods
Study 1 was a prospective, randomized, multicenter trial comparing performance in the operating room after training on a laparoscopic simulator and after no training. The Global Operative Assessment of Laparoscopic Skills (GOALS) was used to evaluate operative performance. Study 2 retrospectively reviewed the operative performance of junior residents before and after implementation of a laparoscopic skills training curriculum. Operative time was the variable used to determine resident improvement. Study 3 was a prospective, randomized trial evaluating intern operative performance of laparoscopic cholecystectomy in a porcine model before and after training on a simulator. Operative performance was assessed using GOALS.
Results
All three studies failed to demonstrate predictive validity. With GOALS used as the assessment tool, no difference was found between trained and untrained residents in studies 1 and 3. In study 2, the trained group took significantly longer to complete a laparoscopic cholecystectomy than the untrained group.
Conclusions
No correlation was found between the three types of training outside the operating room, and no improved operative performance was observed. Possible explanations include too few subjects, training introduced too late in the learning curve, and training criteria that were too easy. Additionally, simulator training focuses on precision, which may actually increase task time. Awareness of these issues can improve the design of future studies.
Similar content being viewed by others
References
Jordan JA, Gallagher AG, McGuigan J, McClure N (2001) Virtual reality training leads to faster adaptation to the novel psychomotor restrictions encountered by laparoscopic surgeons. Surg Endosc 15:1080–1084
Kumar U, Gill IS (2006) Learning curve in human laparoscopic surgery. Curr Urol Rep 7:120–124
Gallagher AG, McClure N, McGuigan J, Ritchie K, Sheehy NP (1998) An ergonomic analysis of the fulcrum effect in the acquisition of endoscopic skills. Endoscopy 30:617–620
Halstead W (1906) The training of the surgeon. Bull Johns Hopkins Hosp 15:267–275
Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements in 2005
Fried GM (1994) General surgery residency training: a time for change? Can J Surg 37:261–262
Fried GM (2006) Lessons from the surgical experience with simulators: incorporation into training and utilization in determining competency. Gastrointest Endosc Clin North Am 16:425–434
Bass BL (2007) Fundamental changes in general surgery residency training. Am Surg 73:109–113
Rogers DA, Elstein AS, Bordage G (2001) Improving continuing medical education for surgical techniques: applying the lessons learned in the first decade of minimal access surgery. Ann Surg 233:159–166
Stefanidis D, Korndorffer JR Jr, Markley S, Sierra R, Heniford BT, Scott DJ (2007) Closing the gap in operative performance between novices and experts: does harder mean better for laparoscopic simulator training? J Am Coll Surg 205:307–313
Aggarwal R, Grantcharov TP, Eriksen JR, Blirup D, Kristiansen VB, Funch-Jensen P, Darzi A (2006) An evidence-based virtual reality training program for novice laparoscopic surgeons. Ann Surg 244:310–314
Ahlberg G, Heikkinen T, Iselius L, Leijonmarck CE, Rutqvist J, Arvidsson D (2002) Does training in a virtual reality simulator improve surgical performance? Surg Endosc 16:126–129
Gallagher AG, McClure N, McGuigan J, Crothers I, Browning J (1999) Virtual reality training in laparoscopic surgery: a preliminary assessment of minimally invasive surgical trainer virtual reality (MIST-VR). Endoscopy 31:310–313
Kolkman W, Van de Put MA, Van den Hout WB, Trimbos JB, Jansen FW (2007) Implementation of the laparoscopic simulator in a gynecological residency curriculum. Surg Endosc 21:1363–1368
Rosser JC Jr, Rosser LE, Savalgi RS (1998) Objective evaluation of a laparoscopic surgical skill program for residents and senior surgeons. Arch Surg 133:657–661
Stovall DW, Fernandez AS, Cohen SA (2006) Laparoscopy training in United States obstetric and gynecology residency programs. J Soc Laparoendosc Surg 10:11–15
Chaer RA, Derubertis BG, Lin SC, Bush HL, Karwowski JK, Birk D, Morrissey NJ, Faries PL, McKinsey JF, Kent KC (2006) Simulation improves resident performance in catheter-based intervention: results of a randomized, controlled study. Ann Surg 244:343–352
Ritter EM, Scott DJ (2007) Design of a proficiency-based skills training curriculum for the fundamentals of laparoscopic surgery. Surg Innov 14:107–112
Duffy AJ, Hogle NJ, McCarthy H, Lew JI, Egan A, Christos P, Fowler DL (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405
Seymour NE, Gallagher AG, Roman SA, O’Brien MK, Bansal VK, Andersen DK, Satava RM (2002) Virtual reality training improves operating room performance: results of a randomized, double-blinded study. Ann Surg 236:458–463 discussion 463–454
Boyd KB, Olivier J, Salameh JR (2006) Surgical residents’ perception of simulation training. Am Surg 72:521–524
Seymour NE (2008) VR to OR: a review of the evidence that virtual reality simulation improves operating room performance. World J Surg 32:182–188
Peters JH, Fried GM, Swanstrom LL, Soper NJ, Sillin LF, Schirmer B, Hoffman K, Committee SF (2004) Development and validation of a comprehensive program of education and assessment of the basic fundamentals of laparoscopic surgery. Surgery 135:21–27
Lentz GM, Mandel LS, Goff BA (2005) A six-year study of surgical teaching and skills evaluation for obstetric/gynecologic residents in porcine and inanimate surgical models. Am J Obstet Gynecol 193:2056–2061
Goff B, Mandel L, Lentz G, Vanblaricom A, Oelschlager AM, Lee D, Galakatos A, Davies M, Nielsen P (2005) Assessment of resident surgical skills: is testing feasible? Am J Obstet Gynecol 192:1331–1338 discussion 1338–1340
Derossis AM, Bothwell J, Sigman HH, Fried GM (1998) The effect of practice on performance in a laparoscopic simulator. Surg Endosc 12:1117–1120
Adrales GL, Chu UB, Hoskins JD, Witzke DB, Park AE (2004) Development of a valid, cost-effective laparoscopic training program. Am J Surg 187:157–163
Derossis AM, Antoniuk M, Fried GM (1999) Evaluation of laparoscopic skills: a 2-year follow-up during residency training. Can J Surg 42:293–296
Munz Y, Almoudaris AM, Moorthy K, Dosis A, Liddle AD, Darzi AW (2007) Curriculum-based solo virtual reality training for laparoscopic intracorporeal knot tying: objective assessment of the transfer of skill from virtual reality to reality. Am J Surg 193:774–783
Reznick R, Regehr G, MacRae H, Martin J, McCulloch W (1997) Testing technical skill via an innovative “bench station” examination. Am J Surg 173:226–230
Aggarwal R, Tully A, Grantcharov T, Larsen CR, Miskry T, Farthing A, Darzi A (2006) Virtual reality simulation training can improve technical skills during laparoscopic salpingectomy for ectopic pregnancy. BJOG Int J Obstet Gynaecol 113:1382–1387
Duffy A, Hogle N, McCarthy H, Lew J, Egan A, Christos P, Fowler D (2005) Construct validity for the LAPSIM laparoscopic surgical simulator. Surg Endosc 19:401–405
Woodrum DT, Andreatta PB, Yellamanchilli RK, Feryus L, Gauger PG, Minter RM (2006) Construct validity of the LapSim laparoscopic surgical simulator. Am J Surg 191:28–32
van Dongen KW, Tournoij E, van der Zee DC, Schijven MP, Broeders IA (2007) Construct validity of the LapSim: can the LapSim virtual reality simulator distinguish between novices and experts? Surg Endosc 21:1413–1417
Chang L, Hogle NJ, Moore BB, Graham MJ, Sinanan MN, Bailey R, Fowler DL (2007) Reliable assessment of laparoscopic performance in the operating room using videotape analysis. Surg Innov 14:122–126
Aggarwal R, Ward J, Balasundaram I, Sains P, Athanasiou T, Darzi A (2007) Proving the effectiveness of virtual reality simulation for training in laparoscopic surgery. Ann Surg 246:771–779
Brunner WC, Korndorffer JR Jr, Sierra R, Massarweh NN, Dunne JB, Yau CL, Scott DJ (2004) Laparoscopic virtual reality training: are 30 repetitions enough? J Surg Res 122:50–156
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hogle, N.J., Chang, L., Strong, V.E.M. et al. Validation of laparoscopic surgical skills training outside the operating room: a long road. Surg Endosc 23, 1476–1482 (2009). https://doi.org/10.1007/s00464-009-0379-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00464-009-0379-5