Nothing Special   »   [go: up one dir, main page]

skip to main content
article

An empirical evaluation of XQuery processors

Published: 01 April 2008 Publication History

Abstract

This paper presents an extensive and detailed experimental evaluation of XQuery processors. The study consists of running five publicly available XQuery benchmarks-the Michigan benchmark (MBench), XBench, XMach-1, XMark and X007-on six XQuery processors, three stand-alone (file-based) XQuery processors (Galax, Qizx/Open, Saxon-B) and three XML/XQuery database systems (BerkeleyDB/XML, MonetDB/XQuery, X-Hive/DB). Next to assessing and comparing the functionality, performance and scalability for the various systems, the major focus of this work is to report in detail about the experiences made while performing such an exhaustive study, to discuss all the problems that we encountered and how we solved them, and hence to hopefully provide some guidelines (or even a recipe) for performing reproducible large-scale experimental research and system evaluation.

References

[1]
L. Afanasiev, M. Franceschet, M. Marx, E. Zimuel, XCheck: a platform for benchmarking XQuery engines, in: VLDB, 2006, demo. {http://ilps.science.uva.nl/Resources/XCheck/}.
[2]
K. Runapongsa, J. Patel, H. Jagadish, Y. Chen, S. Al-Khalifa, The Michigan benchmark: a microbenchmark for XML query processing systems, in: EEXTT, 2002, {http://www.eecs.umich.edu/db/mbench/}.
[3]
S. Bressan, G. Dobbie, Z. Lacroix, M. Lee, Y. Li, U. Nambiar, B. Wadhwa, X007: applying 007 benchmark to XML query processing tool, in: CIKM, 2001, {http://www.comp.nus.edu.sg/~ebh/XOO7.html}.
[4]
B. Yao, T. Özsu, N. Khandelwal, XBench benchmark and performance testing of XML DBMSs, in: ICDE, 2004, {http://se.uwaterloo.ca/~ddbms/projects/xbench/}.
[5]
T. Böhme, E. Rahm, XMach-1: a benchmark for XML data management, in: BTW, 2001, {http://dbs.uni-leipzig.de/de/projekte/XML/XmlBenchmarking.html}.
[6]
A. Schmidt, F. Waas, M. Kersten, M. Carey, I. Manolescu, R. Busse, XMark: a benchmark for XML data management, in: VLDB, 2002, {http://xml-benchmark.org/}.
[7]
L. Afanasiev, M. Marx, An analysis of the current XQuery benchmarks, in: ExpDB, 2006.
[8]
P.A. Boncz, T. Grust, M. van Keulen, S. Manegold, J. Rittinger, J. Teubner, MonetDB/XQuery: a fast XQuery processor powered by a relational engine, in: SIGMOD, 2006, {http://monetdb-xquery.org/}.
[9]
X-Hive/DB, {http://www.x-hive.com/products/db/}.
[10]
Berkeley DB, XML, {http://www.sleepycat.com/products/bdbxml.html}.
[11]
Saxon-B, {http://saxon.sourceforge.net/}.
[12]
M. Fernández, J. Siméon, B. Choi, A. Marian, G. Sur, Implementing XQuery 1.0: the Galax experience, in: VLDB, 2003, {http://www.galaxquery.org/}.
[13]
Qizx/Open, {http://www.axyana.com/qizxopen/}.
[14]
S. Manegold, An empirical evaluation of XQuery processors, in: ExpDB, 2006, {http://www.cwi.nl/htbin/ins1/publications?request=abstract&key=Ma:EXPDB:06}.
[15]
eXist, {http://exist.sourceforge.net/}.
[16]
M. Franceschet, XPathMark: an XPath benchmark for XMark generated data, in: XSym, 2005.
[17]
L. Afanasiev, I. Manolescu, P. Michiels, MemBeR: a micro-benchmark repository for XQuery, XSym, 2005.

Cited By

View all
  • (2022)A Comprehensive Empirical Study of Query Performance Across GPU DBMSesACM SIGMETRICS Performance Evaluation Review10.1145/3547353.352264450:1(51-52)Online publication date: 7-Jul-2022
  • (2022)A Comprehensive Empirical Study of Query Performance Across GPU DBMSesProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/35080246:1(1-29)Online publication date: 28-Feb-2022
  • (2022)A Comprehensive Empirical Study of Query Performance Across GPU DBMSesAbstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems10.1145/3489048.3522644(51-52)Online publication date: 6-Jun-2022
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Publisher

Elsevier Science Ltd.

United Kingdom

Publication History

Published: 01 April 2008

Author Tags

  1. Benchmarks
  2. Database systems
  3. Performance evaluation
  4. XML
  5. XQuery
  6. XQuery processors

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 30 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2022)A Comprehensive Empirical Study of Query Performance Across GPU DBMSesACM SIGMETRICS Performance Evaluation Review10.1145/3547353.352264450:1(51-52)Online publication date: 7-Jul-2022
  • (2022)A Comprehensive Empirical Study of Query Performance Across GPU DBMSesProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/35080246:1(1-29)Online publication date: 28-Feb-2022
  • (2022)A Comprehensive Empirical Study of Query Performance Across GPU DBMSesAbstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems10.1145/3489048.3522644(51-52)Online publication date: 6-Jun-2022
  • (2022)Querying XML documents using Prolog enginesInformation Processing and Management: an International Journal10.1016/j.ipm.2019.05.01156:5(1753-1770)Online publication date: 20-Apr-2022

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media