Cited By
View all- Gonzalez-Mora CTomas DGarrigos IZubcoff JMazon J(2020)Model-Driven Development of Web APIs to Access Integrated Tabular Open DataIEEE Access10.1109/ACCESS.2020.30364628(202669-202686)Online publication date: 2020
ToT for CSV: accessing open data CSV files through SQL
Pages 423 - 429
Abstract
Recently, the push for open data has been very strong, and more and more sources, such as governments are sharing data such as weather records or demographic statistics. The Remote Table Access (RTA) system allows the easy publication of data from a relational database, and its use through SQL-like queries by remote users. Still, the data currently being shared as open data comes in many formats, not always directly integrable with relational databases, and many sources publish data as raw CSV, XML or even PDF files. These files then need to be downloaded, parsed, and integrated with the final user's data, often in a relational database. In this work, we present Table on Top (ToT) for CSV, an extension of the RTA system that allows the easy publication and access of data contained in CSV files through RTA.
References
[1]
Shu Murakami, Yusuke Kosaka, Kento Goto, Motomichi Toyama, "RTA: Proposal of Direct Querying Mechanism to Public Type Table, DEIM2017 The 9th Forum on Data Engineering and Information Management(The 15th Annual Meeting of the Japan Database Society), Takayama Green Hotel, Gihu, March 2017.
[2]
Dennis Heimbigner, Boulder Dennis McLeod: "A federated architecture for information management", Journal of ACM Transactions on Information Systems (TOIS), 1985
[3]
Amit P. Sheth, James A. Larson: "Federated database systems for managing distributed, heterogeneous, and autonomous databases", Journal of ACM Computing Surveys (CSUR), 1990
[4]
Laszlo Dobos, Istvan Csabai: "Graywulf: A platform for federated scientific databases and services", Proceedings of the 25th International Conference on Scientific and Statistical Database Management Article (SSDBM) No.30, 2013
[5]
Youzhong Ma, Jia Rao, Weisong Hu, Xiaofeng Meng, Xu Han, Yu Zhang, Yunpeng Chai, Chunqiu Liu: "An Efficient Index for Massive IOT Data in Cloud Environment", Proceedings of the 21st ACM international conference on Information and knowledge management (CIKM) 2012
[6]
Jeff Shute, Radek Vingralek, Bart Samwel, Ben Handy, Chad Whipkey, Eric Rollins, Mircea Oancea, Kyle Littlefield, David Menestrina, Stephan Ellner, John Cieslewicz, Ian Rae, Traian Stancescu, Himani Apte: "F1: A Distributed SQL Database That Scales", Proceedings of the VLDB Endowment 2013
[7]
James C. Corbett, Jeffrey Dean, Michael Epstein, Andrew Fikes, Christopher Frost, J. J. Furman, Sanjay Ghemawat, Andrey Gubarev, Christopher Heiser, Peter Hochschild, Wilson Hsieh, Sebastian Kanthak, Eugene Kogan, Hongyi Li, Alexander Lloyd, Sergey Melnik, David Mwaura, David Nagle, Sean Quinlan, Rajesh Rao, Lindsay Rolig, Yasushi Saito, Michal Szymaniak, Christopher Taylor, Ruth Wang, Dale Woodford: "Spanner: Google's Globally Distributed Database", ACM Transactions on Computer Systems 2013
[8]
Postal code data: http://www.post.japanpost.jp/zipcode/download.html
[9]
Stock data: http://k-db.com/
[10]
JSQLParser: https://github.com/JSQLParser/JSqlParser
[11]
Microsoft RDA: https://msdn.microsoft.com/ja-jp/library/cc414853.aspx
[12]
FEDERATED storage engine: https://dev.mysql.com/doc/refman/5.6/ja/federated-storage-engine.html
[13]
postgres_fdw: https://www.postgresql.jp/document/9.3/html/postgres-fdw.html
[14]
Data.gov: http://data.gov/
[15]
Data.gov.uk: http://data.gov.uk/
[16]
Data.gov.jp: http://www.data.go.jp/
[17]
2014: The Year of CSV | News, Open Data Institute. [Online]. Available: https://theodi.org/blog/2014-the-year-of-csv. [Accessed: 15-Jul-2016].
[18]
T. Davies, R. M. Sharif, and J. M. Alonso, "Open Data Barometer Global Report," World Wide Web Found., 2015.
[19]
Y. Shafranovich, "Common format and MIME type for comma-separated values (CSV) files," 2005.
[20]
Till Dohmen, Hannes Muhleisen, Peter Boncz "Multi-Hypothesis CSV Parsing", SSDBM '17 Proceedings of the 29th International Conference on Scientific and Statistical Database Management Article No. 16
[21]
Wirawit Chaochaisit, Ken Sakamura, Noboru Koshizuka, Masahiro Bessho, "CSV-X: A Linked Data Enabled Schema Language, Model, and Processing Engine for Non-Uniform CSV", iThings/GreenCom/CPSCom/SmartData 2016: 795--804
[22]
Local government open data CKAN https://ckan.open-governmentdata.org/dataset/
Index Terms
- ToT for CSV: accessing open data CSV files through SQL
Recommendations
Design and Implementation of a CSV Validation System
ICAIT'2018: Proceedings of the 3rd International Conference on Applications in Information TechnologyThe need for error checking is essential in our daily activities, as the saying goes "to err is human". This issue becomes problematic when it involves hidden errors. Depending on the hidden errors, in critical systems this can lead to a tragedy or ...
Querying relational databases through XSLT
XML has been accepted as a universal format for data interchange and publication. It can be applied in the applications in which the data of a database needs to be viewed in XML format so that the data being viewed takes more semantics and is easily ...
Development of an XML-document compaction method to improve data-processing performance
XML (Extensible Markup Language) is the global standardized form for representing digital data. It is flexible and extensible, but on the other hand uses vast amounts of main memory for data processing, thus representing a burden. In order to resolve ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2019
709 pages
ISBN:9781450371797
DOI:10.1145/3366030
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
In-Cooperation
- JKU: Johannes Kepler Universität Linz
- @WAS: International Organization of Information Integration and Web-based Applications and Services
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 22 February 2020
Check for updates
Author Tags
Qualifiers
- Short-paper
- Research
- Refereed limited
Conference
iiWAS2019
iiWAS2019: The 21st International Conference on Information Integration and Web-based Applications & Services
December 2 - 4, 2019
Munich, Germany
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- View Citations1Total Citations
- 97Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)0
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
Cited By
View all- Gonzalez-Mora CTomas DGarrigos IZubcoff JMazon J(2020)Model-Driven Development of Web APIs to Access Integrated Tabular Open DataIEEE Access10.1109/ACCESS.2020.30364628(202669-202686)Online publication date: 2020
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in