research-article

Implementation of execution history in non-relational databases for feedback-guided job modeling

Authors:

Sushan Chakraborty,

Madhulina Sarkar,

Nandini MukherjeeAuthors Info & Claims

CUBE '12: Proceedings of the CUBE International Information Technology Conference

Pages 476 - 482

https://doi.org/10.1145/2381716.2381806

Published: 03 September 2012 Publication History

Get Access

Abstract

A feedback-guided Resource Requirement Prediction technique has been described in [2]. An Execution History is built and maintained for all the jobs which are executed in a large distributed system like Grid. When a new job arrives, its clones are sought for in the Execution History and if clones are found, relevant performance information are retrieved and used for estimating resource requirements. In this paper, we focus on the implementation details of Execution History. Instead of using relational databases, here we have used NoSQL database, MongoDB. The reasons for using MongoDB are discussed. Techniques for storing and retrieving data from the Execution History are also described. Overheads for such operations are measured and presented in the result part of this paper.

References

[1]

Cattell R. 2011. Scalable SQL and NoSQL data stores. SIGMOD Rec. 39, 4 (May 2011), pages 12--27

Digital Library

Google Scholar

[2]

Sarkar M., Roy S. and Mukherjee N. 2010. Feedback-guided Analysis for Resource Requirements in Large Distributed System. In Proceedings of 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing (CCGrid 2010). 596--597.

Digital Library

Google Scholar

[3]

Rees R. An introduction to NoSQL databases. ThoughtWorks. http://www.thoughtworks.com/articles/nosql-comparison #Types-of-NoSQL-datastores

Google Scholar

[4]

MongoDB. http://www.mongodb.org

Google Scholar

[5]

Roy S., Mukherjee N. 2010. Multi-agent Framework for Performance-based Resource Management in Computational grid environment. Journal of Multiagent and Grid Systems, 6, 1 (January 2010), 25--53, IOS Press Amsterdam, The Netherlands.

Digital Library

Google Scholar

[6]

NoSQL: Your Ultimate Guide to the Non - Relational Universe. http://nosql-database.org/

Google Scholar

[7]

Bhat U. and Jadhav S. 2010. Moving Towards Non-Relational Databases. International Journal of ComputerApplications (0975 - 8887), 1, 13 (February 2010) 40--46,. Published By Foundation of Computer Science.

Google Scholar

[8]

Lakshman A. and Malik P. 2010. Cassandra: a decentralized structured storage system. Operating Systems Review 44, 2, 35--40.

Digital Library

Google Scholar

[9]

Apache Hbase, http://hbase.apache.org

Google Scholar

[10]

Sarkar M., Chudamani S., Roy S. and Mukherjee N. A Hybrid Clone Detection Technique for Estimation of Resource Requirements of a Job. Communicated.

Google Scholar

[11]

Sarkar M, Roy S. and Mukherjee N. 2011. Prediction of resource requirement using feedback on job execution performance. In Procedia Computer Science, 3 (2011), 1271--1276.

Crossref

Google Scholar

[12]

Ganglia, web site: http://ganglia.sourceforge.net/

Google Scholar

Cited By

View all

Alsaig AAlsaig AMohammad MAlagar V(2014)Storing and Managing Context and Context HistoryContext-Aware Systems and Applications10.1007/978-3-319-14227-2_4(35-46)Online publication date: 10-Apr-2014
https://doi.org/10.1007/978-3-319-14227-2_4
Alsaig AAlsaig AMohammad MAlagar V(2014)Storing and Managing Context and Context HistoryContext-Aware Systems and Applications10.1007/978-3-319-05939-6_4(35-46)Online publication date: 10-Apr-2014
https://doi.org/10.1007/978-3-319-05939-6_4

Index Terms

Implementation of execution history in non-relational databases for feedback-guided job modeling
1. Information systems
  1. Data management systems
    1. Database design and models
    2. Database management system engines
  2. Information retrieval
    1. Information retrieval query processing

Recommendations

Modeling MongoDB with Relational Model
EIDWT '13: Proceedings of the 2013 Fourth International Conference on Emerging Intelligent Data and Web Technologies

Relational databases have been prevailing for the last two decades, with features of clear semantics and ease of use with SQL supported by the underlying theory, relational algebra. Relational databases provide good support for structural data ...
Model Transformation From Object Relational Database to NoSQL Document Database
NISS '19: Proceedings of the 2nd International Conference on Networking, Information Systems & Security

With the high increase of data growing, NoSQL databases play a key role in storing large amount of data, to gain flexibility and scalability many industries are now replacing their relational and object relational databases by adopting NoSQL database ...
A Unified SQL Middleware for NoSQL Databases
ICBDC '18: Proceedings of the 3rd International Conference on Big Data and Computing

With the popularity of smart mobile devices and the development of big data, NoSQL databases came into being. Compared to the traditional relational databases, NoSQL databases have the advantages of unstructured storage, high availability and high ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

CUBE '12: Proceedings of the CUBE International Information Technology Conference

September 2012

879 pages

ISBN:9781450311854

DOI:10.1145/2381716

General Chair:
Vidyasagar Potdar
Curtin University, Australia
,
Program Chair:
Debajyoti Mukhopadhyay
Maharashtra Institute of Technology, India

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 September 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CUBE '12

Sponsor:

CUOT

CUBE '12: CUBE International IT Conference & Exhibition

September 3 - 5, 2012

Pune, India

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
262
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Alsaig AAlsaig AMohammad MAlagar V(2014)Storing and Managing Context and Context HistoryContext-Aware Systems and Applications10.1007/978-3-319-14227-2_4(35-46)Online publication date: 10-Apr-2014
https://doi.org/10.1007/978-3-319-14227-2_4
Alsaig AAlsaig AMohammad MAlagar V(2014)Storing and Managing Context and Context HistoryContext-Aware Systems and Applications10.1007/978-3-319-05939-6_4(35-46)Online publication date: 10-Apr-2014
https://doi.org/10.1007/978-3-319-05939-6_4

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Modeling MongoDB with Relational Model

Model Transformation From Object Relational Database to NoSQL Document Database

A Unified SQL Middleware for NoSQL Databases

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations