Collaborative Data Science using Scalable Homoiconicity
Author: 
Holger PirkAuthors Info & Claims
Abstract
Motivation: Data science is increasingly collaborative. On the one hand, results need to be distributed, e.g., as interactive visualizations. On the other, collaboration in the data development process improves quality and timeliness. This can take many forms: partitioning a problem and working on aspects in parallel, exploring different solutions or reviewing someone else's work.
References
[1]
https://dvc.org, 2022.
[2]
https://www.dolthub.com, 2022.
[3]
Michael Ballantyne, Alexis King, and Matthias Felleisen. Macros for domain-specific languages. Proceedings of the ACM on Programming Languages, (OOPSLA), 2020.
[4]
Anant Bhardwaj, Souvik Bhattacherjee, Amit Chavan, Amol Deshpande, Aaron J Elmore, Samuel Madden, and Aditya G Parameswaran. Datahub: Collaborative data science & dataset version management at scale. arXiv preprint arXiv:1409.0798, 2014.
[5]
Elizabeth Dinella, Todd Mytkowicz, Alexey Svyatkovskiy, Christian Bird, Mayur Naik, and Shuvendu K Lahiri. Deepmerge: Learning to merge programs. arXiv preprint arXiv:2105.07569, 2021.
[6]
Juliana Freire, David Koop, Emanuele Santos, and Cl´audio T Silva. Provenance for computational tasks: A survey. Computing in Science & Engineering, 2008.
[7]
John MacCarthy. Recursive functions of symbolic expressions and their computation by machine. Comm. ACM, 1960.
[8]
Hui Miao, Amit Chavan, and Amol Deshpande. Provdb: Lifecycle management of collaborative analysis workflows. In Proceedings of the 2nd Workshop on Human-in-the-Loop Data Analytics, 2017.
[9]
Nitin Naik. Docker container-based big data processing system in multiple clouds for everyone. In 2017 IEEE International Systems Engineering Symposium (ISSE), pages 1--7. IEEE, 2017.
[10]
Marc Shapiro, Nuno Pregui¸ca, Carlos Baquero, and Marek Zawirski. Conflict-free replicated data types. In Symposium on Self-Stabilizing Systems, pages 386--400. Springer, 2011.
[11]
Marcelo Sousa, Isil Dillig, and Shuvendu K Lahiri. Verified three-way program merge. Proceedings of the ACM on Programming Languages, (OOPSLA), 2018.
[12]
Sam Tobin-Hochstadt, Vincent St-Amour, Ryan Culpepper, Matthew Flatt, and Matthias Felleisen. Languages as libraries. In Proceedings of the 32nd ACM SIGPLAN conference on Programming language design and implementation, 2011.
[13]
Liqi Xu, Silu Huang, SiLi Hui, Aaron J Elmore, and Aditya Parameswaran. Orpheusdb: a lightweight approach to relational dataset versioning. In Proceedings of the 2017 ACM International Conference on Management of Data, 2017. S
Recommendations
Collaborative visualization: definition, challenges, and research agenda
Special issue on State of the Field and New Research DirectionsThe conflux of two growing areas of technology - collaboration and visualization - into a new research direction, coLLaborative visualization, provides new research chaLLenges. TechnoLogy now aLLows us to easily connect and collaborate with one another - ...
Neither rocket science nor washing machine science, but computer science
ITiCSE '08: Proceedings of the 13th annual conference on Innovation and technology in computer science educationGreyer haired computer scientists can easily remember the glory days, but waves of recent publications and opinion seem to have seen clouds on our horizon.
But maybe we worry too much and too soon. Every fairytale heroine goes through a glum patch ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Copyright © 2023 Copyright is held by the owner/author(s).
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 25 January 2023
Published in SIGMOD Volume 51, Issue 4
Check for updates
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 71Total Downloads
- Downloads (Last 12 months)28
- Downloads (Last 6 weeks)1
Reflects downloads up to 24 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in