column

The repeatability experiment of SIGMOD 2008

Authors:

D. ShashaAuthors Info & Claims

ACM SIGMOD Record, Volume 37, Issue 1

Pages 39 - 45

https://doi.org/10.1145/1374780.1374791

Published: 01 March 2008 Publication History

Get Access

Abstract

SIGMOD 2008 was the first database conference that offered to test submitters' programs against their data to verify the experiments published. This paper discusses the rationale for this effort, the community's reaction, our experiences, and advice for future similar efforts.

References

[1]

I. Manolescu and S. Manegold. Performance Evaluation in Database Research: Principles and Experience. In Proceedings of the IEEE International Conference on Data Engineering (ICDE), Cancun, Mexico, 2008. (Seminar/Tutorial). Slides are available from http://www.icde2008.org/ or from the authors.

Google Scholar

[2]

The Microsoft Research Conference Management Tool. https://cmt.research.microsoft.com.

Google Scholar

[3]

The MyReview Conference Management System. http://myreview.lri.fr.

Google Scholar

Cited By

View all

Ouared AAmrani MChadli ASchobbens P(2024)Deep variability modeling to enhance reproducibility of database performance testingCluster Computing10.1007/s10586-024-04533-027:8(11683-11708)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1007/s10586-024-04533-0
Deng WWang C(2023)CC-YOLO: Improved YOLOv5 based on CoordConv and SIOU for object detectionProceedings of the 2023 6th International Conference on Artificial Intelligence and Pattern Recognition10.1145/3641584.3641657(492-497)Online publication date: 22-Sep-2023
https://dl.acm.org/doi/10.1145/3641584.3641657
Athanassoulis MTriantafillou PAppuswamy RBordawekar RChandramouli BCheng XManolescu IPapakonstantinou YTatbul N(2022)Artifacts Availability & Reproducibility (VLDB 2021 Round Table)ACM SIGMOD Record10.1145/3552490.355251151:2(74-77)Online publication date: 29-Jul-2022
https://dl.acm.org/doi/10.1145/3552490.3552511
Show More Cited By

Index Terms

The repeatability experiment of SIGMOD 2008
1. General and reference
  1. Document types

Recommendations

Repeatability & workability evaluation of SIGMOD 2009

SIGMOD 2008 was the first database conference that offered to test submitters' programs against their data to verify the repeatability of the experiments published [1]. Given the positive feedback concerning the SIGMOD 2008 repeatability initiative, ...
SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data
SIGMOD'14 PhD Symposium: Proceedings of the 2014 SIGMOD PhD symposium

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

ACM SIGMOD Record Volume 37, Issue 1

March 2008

61 pages

ISSN:0163-5808

DOI:10.1145/1374780

Issue’s Table of Contents

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 2008

Published in SIGMOD Volume 37, Issue 1

Check for updates

Qualifiers

Column

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

29
Total Citations
View Citations
497
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Ouared AAmrani MChadli ASchobbens P(2024)Deep variability modeling to enhance reproducibility of database performance testingCluster Computing10.1007/s10586-024-04533-027:8(11683-11708)Online publication date: 1-Nov-2024
https://dl.acm.org/doi/10.1007/s10586-024-04533-0
Deng WWang C(2023)CC-YOLO: Improved YOLOv5 based on CoordConv and SIOU for object detectionProceedings of the 2023 6th International Conference on Artificial Intelligence and Pattern Recognition10.1145/3641584.3641657(492-497)Online publication date: 22-Sep-2023
https://dl.acm.org/doi/10.1145/3641584.3641657
Athanassoulis MTriantafillou PAppuswamy RBordawekar RChandramouli BCheng XManolescu IPapakonstantinou YTatbul N(2022)Artifacts Availability & Reproducibility (VLDB 2021 Round Table)ACM SIGMOD Record10.1145/3552490.355251151:2(74-77)Online publication date: 29-Jul-2022
https://dl.acm.org/doi/10.1145/3552490.3552511
Dittrich J(2022)The Big Data Analytics Group at Saarland UniversityDatenbank-Spektrum10.1007/s13222-022-00424-z22:3(269-272)Online publication date: 7-Oct-2022
https://doi.org/10.1007/s13222-022-00424-z
Mauerer WScherzinger S(2021)Nullius in Verba: Reproducibility for Database Systems Research, Revisited2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00270(2377-2380)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00270
Freire JBonnet PShasha D(2020)Exploring the coming repositories of reproducible experimentsProceedings of the VLDB Endowment10.14778/3402755.34028044:12(1494-1497)Online publication date: 3-Jun-2020
https://dl.acm.org/doi/10.14778/3402755.3402804
Braininger DMauerer WScherzinger S(2020)Replicability and Reproducibility of a Schema Evolution Study in Embedded DatabasesAdvances in Conceptual Modeling10.1007/978-3-030-65847-2_19(210-219)Online publication date: 3-Nov-2020
https://dl.acm.org/doi/10.1007/978-3-030-65847-2_19
Patel JDeshmukh HZhu JPotti NZhang ZSpehlmann MMemisoglu HSaurabh S(2019)QuickstepProceedings of the VLDB Endowment10.14778/3199517.319951811:6(663-676)Online publication date: 17-Jan-2019
https://dl.acm.org/doi/10.14778/3199517.3199518
Dubitzky WLopes PDavis JBerrar D(2019)The Open International Soccer Database for machine learningMachine Language10.1007/s10994-018-5726-0108:1(9-28)Online publication date: 1-Jan-2019
https://dl.acm.org/doi/10.1007/s10994-018-5726-0
Patel JDeshmukh HZhu JPotti NZhang ZSpehlmann MMemisoglu HSaurabh S(2018)QuickstepProceedings of the VLDB Endowment10.5555/3199517.319951811:6(663-676)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.5555/3199517.3199518
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Repeatability & workability evaluation of SIGMOD 2009

SIGMOD '08: Proceedings of the 2008 ACM SIGMOD international conference on Management of data

SIGMOD'14 PhD Symposium: Proceedings of the 2014 SIGMOD PhD symposium