Article

Inline caching meets quickening

Author:

Stefan BrunthalerAuthors Info & Claims

ECOOP'10: Proceedings of the 24th European conference on Object-oriented programming

Pages 429 - 451

Published: 21 June 2010 Publication History

Abstract

Inline caches effectively eliminate the overhead implied by dynamic typing. Yet, inline caching is mostly used in code generated by just-in-time compilers. We present efficient implementation techniques for using inline caches without dynamic translation, thus enabling future interpreter implementers to use this important optimization technique-- we report speedups of up to a factor of 1.71--without the additional implementation and maintenance costs incurred by using a just-in-time compiler.

References

[1]

Bell, J.R.: Threaded code. Communications of the ACM 16(6), 370-372 (1973)

Digital Library

[2]

Brunthaler, S.: Virtual-machine abstraction and optimization techniques. In: Proceedings of the 4th International Workshop on Bytecode Semantics, Verification, Analysis and Transformation (BYTECODE 2009). Electronic Notes in Theoretical Computer Science, vol. 253(5), pp. 3-14. Elsevier, Amsterdam (December 2009)

Digital Library

[3]

Brunthaler, S.: Efficient inline caching without dynamic translation. In: Proceedings of the 2010 ACM Symposium on Applied Computing (SAC 2010). ACM, New York (March 2010) (to appear)

Digital Library

[4]

Casey, K., Ertl, M.A., Gregg, D.: Optimizations for a java interpreter using instruction set enhancement. Tech. Rep. 61, Department of Computer Science, University of Dublin. Trinity College (September 2005), https://www.cs.tcd.ie/publications/tech-reports/reports.05/ TCD-CS-2005-61.pdf

[5]

Conroy, T.J., Pelegri-Llopart, E.: An Assessment of Method-Lookup Caches for Smalltalk-80 Implementations. In: Krasner {16}, ch. 13, pp. 239-247 (1982)

[6]

Deutsch, L.P., Schiffman, A.M.: Efficient implementation of the Smalltalk-80 system. In: Proceedings of the SIGPLAN 1984 Symposium on Principles of Programming Languages (POPL 1984), pp. 297-302. ACM, New York (1984)

Digital Library

[7]

Ertl, M.A.: Threaded code variations and optimizations. In: EuroForth, TU Wien, Vienna, Austria, pp. 49-55 (2001)

[8]

Ertl, M.A., Gregg, D.: The structure and performance of efficient interpreters. Journal of Instruction-Level Parallelism 5, 1-25 (2003)

[9]

Fulgham, B.: The computer language benchmarks game, http://shootout.alioth.debian.org/

[10]

Haupt, M., Hirschfeld, R., Denker, M.: Type feedback for bytecode interpreters, Position Paper (ICOOOLPS 2007) (2008), http://scg.unibe.ch/archive/papers/Haup07aPIC.pdf

[11]

Hölzle, U.: Adaptive Optimization for SELF: Reconciling High Performance with Exploratory Programming. Ph.D. thesis, Stanford University, Stanford, CA, USA (1994)

Digital Library

[12]

Hölzle, U., Chambers, C., Ungar, D.: Optimizing dynamically-typed objectoriented languages with polymorphic inline caches. In: Proceedings of the European Conference on Object-Oriented Programming (ECOOP 1992), pp. 21-38. Springer, London (1991)

Digital Library

[13]

Hölzle, U., Ungar, D.: Optimizing dynamically-dispatched calls with run-time type feedback. In: Proceedings of the SIGPLAN 1994 Conference on Programming Language Design and Implementation (PLDI 1994), pp. 326-336 (1994)

Digital Library

[14]

Intel: Intel turbo boost technology in Intel core microarchitecture (nehalem) based processors (November 2008), http://download.intel.com/design/processor/applnots/ 320354.pdf?iid=tech tb+paper

[15]

Kiczales, G., Rodriguez, L.: Efficient method dispatch in PCL. In: Proceedings of the 1990 ACM Conference on LISP and Functional Programming (LFP 1990), pp. 99-105. ACM, New York (1990)

Digital Library

[16]

Krasner, G. (ed.): Smalltalk-80: bits of history, words of advice. Addison-Wesley Longman Publishing Co. Inc., Boston (1983)

Digital Library

[17]

Lindholm, T., Yellin, F.: The Java Virtual Machine Specification, 1st edn. Addison-Wesley, Boston (1997)

[18]

Stallmann, R.M., Pesch, R.H., Shabs, S.: Debugging with GDB: The GNU sourcelevel debugger. Free Software Foundation, 9th edn. (2009)

[19]

Vitale, B., Abdelrahman, T.S.: Catenation and specialization for Tcl virtual machine performance. In: Proceedings of the 2004 Workshop on Interpreters, virtual machines and emulators (IVME 2004), pp. 42-50. ACM, New York (2004)

Digital Library

Cited By

Polito GPalumbo NLabsari SDucasse STesone P(2022)Interpreter Register Autolocalisation: Improving the Performance of Efficient InterpretersCompanion Proceedings of the 6th International Conference on the Art, Science, and Engineering of Programming10.1145/3532512.3532518(1-5)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3532512.3532518
Castro DHu RJongmans SNg NYoshida N(2019)Distributed programming using role-parametric session types in go: statically-typed endpoint APIs for dynamically-instantiated communication structuresProceedings of the ACM on Programming Languages10.1145/32903423:POPL(1-30)Online publication date: 2-Jan-2019
https://dl.acm.org/doi/10.1145/3290342
Kataoka TUgawa TIwasaki HHaddad HWainwright RChbeir R(2018)A framework for constructing javascript virtual machines with customized datatype representationsProceedings of the 33rd Annual ACM Symposium on Applied Computing10.1145/3167132.3167266(1238-1247)Online publication date: 9-Apr-2018
https://dl.acm.org/doi/10.1145/3167132.3167266
Show More Cited By

Inline caching meets quickening
1. Software and its engineering
  1. Software notations and tools
    1. General programming languages

Recommendations

Efficient interpretation using quickening
DLS '10: Proceedings of the 6th symposium on Dynamic languages

Just-in-time compilers offer the biggest achievable payoff performance-wise, but their implementation is a non-trivial, time-consuming task affecting the interpreter's maintenance for years to come, too. Recent research addresses this issue by providing ...
Selective Victim Caching: A Method to Improve the Performance of Direct-Mapped Caches

Although direct-mapped caches suffer from higher miss ratios as compared to set-associative caches, they are attractive for today's high-speed pipelined processors that require very low access times. Victim caching was proposed by Jouppi [1] as an ...
Dynamic Loop Caching Meets Preloaded Loop Caching " A Hybrid Approach
ICCD '02: Proceedings of the 2002 IEEE International Conference on Computer Design: VLSI in Computers and Processors (ICCD'02)

Dynamically-loaded tagless loop caching reduces instruction fetch power for embedded software with small loops, but only supports simple loops without taken branches. Preloaded tagless loop caching supports complex loops with branches and thus can ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ECOOP'10: Proceedings of the 24th European conference on Object-oriented programming

June 2010

599 pages

ISBN:3642141064

Editor:
Theo D'Hondt
Vrije Universiteit Brussel, Software Languages Lab, Brussels, Belgium

Sponsors

Google Inc.

In-Cooperation

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 21 June 2010

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 19 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Polito GPalumbo NLabsari SDucasse STesone P(2022)Interpreter Register Autolocalisation: Improving the Performance of Efficient InterpretersCompanion Proceedings of the 6th International Conference on the Art, Science, and Engineering of Programming10.1145/3532512.3532518(1-5)Online publication date: 21-Mar-2022
https://dl.acm.org/doi/10.1145/3532512.3532518
Castro DHu RJongmans SNg NYoshida N(2019)Distributed programming using role-parametric session types in go: statically-typed endpoint APIs for dynamically-instantiated communication structuresProceedings of the ACM on Programming Languages10.1145/32903423:POPL(1-30)Online publication date: 2-Jan-2019
https://dl.acm.org/doi/10.1145/3290342
Kataoka TUgawa TIwasaki HHaddad HWainwright RChbeir R(2018)A framework for constructing javascript virtual machines with customized datatype representationsProceedings of the 33rd Annual ACM Symposium on Applied Computing10.1145/3167132.3167266(1238-1247)Online publication date: 9-Apr-2018
https://dl.acm.org/doi/10.1145/3167132.3167266
Popov NCosenza BJuurlink BStogov DWu PHack S(2017)Static optimization in PHP 7Proceedings of the 26th International Conference on Compiler Construction10.1145/3033019.3033026(65-75)Online publication date: 5-Feb-2017
https://dl.acm.org/doi/10.1145/3033019.3033026
Sarimbekov AStadler LBulej LSewe APodzimek AZheng YBinder W(2016)Workload characterization of JVM languagesSoftware—Practice & Experience10.1002/spe.233746:8(1053-1089)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1002/spe.2337
Zhang WLarsen PBrunthaler SFranz M(2014)Accelerating iterators in optimizing AST interpretersACM SIGPLAN Notices10.1145/2714064.266022349:10(727-743)Online publication date: 15-Oct-2014
https://dl.acm.org/doi/10.1145/2714064.2660223
Kedlaya MRobatmili BCaşcaval CHardekopf B(2014)Deoptimization for dynamic language JITs on typed, stack-based virtual machinesACM SIGPLAN Notices10.1145/2674025.257620949:7(103-114)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1145/2674025.2576209
Zhang WLarsen PBrunthaler SFranz MBlack AMillstein T(2014)Accelerating iterators in optimizing AST interpretersProceedings of the 2014 ACM International Conference on Object Oriented Programming Systems Languages & Applications10.1145/2660193.2660223(727-743)Online publication date: 15-Oct-2014
https://dl.acm.org/doi/10.1145/2660193.2660223
Barany G(2014)Python Interpreter Performance DeconstructedProceedings of the Workshop on Dynamic Languages and Applications10.1145/2617548.2617552(1-9)Online publication date: 9-Jun-2014
https://dl.acm.org/doi/10.1145/2617548.2617552
Kedlaya MRobatmili BCaşcaval CHardekopf BHirzel MPetrank ETsafrir D(2014)Deoptimization for dynamic language JITs on typed, stack-based virtual machinesProceedings of the 10th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments10.1145/2576195.2576209(103-114)Online publication date: 1-Mar-2014
https://dl.acm.org/doi/10.1145/2576195.2576209
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

Media

Figures

Other

Tables

View Table of Contents