research-article

A new approach to performance optimization of mashups via data flow refactoring

Authors:

Jie Liu,

Jun Wei,

Dan Ye,

Tao HuangAuthors Info & Claims

Internetware '10: Proceedings of the Second Asia-Pacific Symposium on Internetware

Article No.: 6, Pages 1 - 8

https://doi.org/10.1145/2020723.2020729

Published: 03 November 2010 Publication History

Get Access

Abstract

Mashup tools allow end users graphically build complex mashups using pipes to connect web data sources into a data flow. Because end users are of poor technical expertise, the designed data flows may be inefficient. This paper targets on enhancing the performance of mashups via automatically refactoring the structure of its data flows. First a set of operational semantics features are selected for annotating the operators in data flows and refactoring rules are defined to generate all candidate semantics equivalent data flows. Then a heuristic algorithm is described for accurately searching the data flow of minimal execution time by constructing a partially ordered set of data flows based on their cost estimation. This approach is applicable to general mashup data flows without knowing complete operational semantics of their operators and the efficiency improvement is demonstrated by experiments.

References

[1]

Sebastien, M., Franck, C., Mireille, B. et al.: Web Services Composition: Mashups Driven Orchestration Definition. In: International Conference on Computational Intelligence for Modelling, Control and Automation, pp. 284--289. IEEE Computer Society, Los Alamitos, CA, USA (2008)

Digital Library

Google Scholar

[2]

Yahoo Pipes, http://pipes.yahoo.com

Google Scholar

[3]

Alkis, S., Panos, V., Timos, S.: State-Space Optimization of ETL Workflows. IEEE Transactions on Knowledge and Data Engineering. 17(10), 1404--1419 (2005)

Digital Library

Google Scholar

[4]

Alkis, S., Kevin, W., Umeshwar, D. et al.: Optimizing ETL Workflows for Fault-Tolerance. In: 26th IEEE International Conference on Data Engineering, pp. 385--396. IEEE Press, New York (2010)

Google Scholar

[5]

Giusy, D. L., Hakim, H., Hye-young, P. et al: Data integration in mashups. SIGMOD Record. 38(1), 59--66 (2009)

Digital Library

Google Scholar

[6]

Serge, A., Ohad, G., Tova, M.: Modeling the mashup space. In: 10th ACM workshop on Web information and data management, pp. 87--94. ACM, New York (2008)

Digital Library

Google Scholar

[7]

Serge, A., Ohad, G., Tova, M.: Autocompletion for mashups. In: 25th IEEE International Conference on Data Engineering, pp. 1479--1482. ACM, New York (2009)

Digital Library

Google Scholar

[8]

Biorm, B., Cesare, P.: Let It Flow: Building Mashups with Data Processing Pipelines. In: ICSOC 2007 Workshops, pp. 15--28. Springer-Verlag, Berlin, Heidelberg (2007)

Google Scholar

[9]

Osama, A. H., Lakshmish, R., John, A. M.: MACE: A Dynamic Caching Framework for Mashups. In: 7th IEEE International Conference on Web Service, pp. 75--82. IEEE Computer Society, Washington, DC, USA (2009)

Digital Library

Google Scholar

[10]

Eric, W., Peng, L., Brett, C.: Web service mashup middleware with partitioning of xml pipelines. In: 7th IEEE International Conference on Web Service, pp. 91--98. IEEE Computer Society, Washington, DC, USA (2009)

Digital Library

Google Scholar

[11]

Dong, L., Ralph, D.: The Reverse C10K Problem for Server-Side Mashups. In: ICSOC 2008 International Workshops, pp. 166--177. Springer-Verlag, Berlin, Heidelberg (2008)

Google Scholar

[12]

Tsangaris, M., Kakaletris, G., Kllapi, H. et al.: Dataflow Processing and Optimization on Grid and Cloud Infrastructures. Bulletin of the Technical Committee on Data Engineering. 32(1), 67--74 (2009)

Google Scholar

Cited By

View all

Chambers CScaffidi C(2018)Impact and utility of smell-driven performance tuning for end-user programmersJournal of Visual Languages and Computing10.1016/j.jvlc.2015.01.00228:C(176-194)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1016/j.jvlc.2015.01.002
Chambers CScaffidi C(2018)Utility and accuracy of smell-driven performance analysis for end-user programmersJournal of Visual Languages and Computing10.1016/j.jvlc.2014.10.01726:C(1-14)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1016/j.jvlc.2014.10.017

Index Terms

A new approach to performance optimization of mashups via data flow refactoring

Recommendations

An optimization strategy for mashups performance based on relational algebra
APWeb'12: Proceedings of the 14th Asia-Pacific international conference on Web Technologies and Applications

Recently, mashups as a new type of application have gained tremendous popularity, which provide opportunities of creating personalized Web applications using Internet-based resources to end-users. Meanwhile, the performance of mashups can not be ...
Linked open data in sensor data mashups
SSN'09: Proceedings of the 2nd International Conference on Semantic Sensor Networks - Volume 522

Sensors and the real-time data they produce are novel sources of information which need to be integrated into the SemanticWeb at very large scale. Most of the time such data is locked inside specific applications and only accessible within ...
Data description and data access mechanism in distributed workflow system
InfoScale '07: Proceedings of the 2nd international conference on Scalable information systems

Aiming at the problem that the existing workflow management systems are not effective in describing and establishing data flow, conceptions of interior data flow and exterior data flow are introduced in this paper. Based on analyzing characteristics of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

Internetware '10: Proceedings of the Second Asia-Pacific Symposium on Internetware

November 2010

159 pages

ISBN:9781450306942

DOI:10.1145/2020723

Conference Chairs:
Hong Mei,
Jian Lv,
Program Chairs:
Xuandong Li,
Zhi Jin

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministry of Science and Technology of the People's Republic of China
National Science and Technology Major Project of China

Conference

Internetware 2010

Sponsor:

Internetware 2010: The Second Asia-Pacific Symposium on Internetware

November 3 - 4, 2010

Suzhou, China

Acceptance Rates

Overall Acceptance Rate 55 of 111 submissions, 50%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
90
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Chambers CScaffidi C(2018)Impact and utility of smell-driven performance tuning for end-user programmersJournal of Visual Languages and Computing10.1016/j.jvlc.2015.01.00228:C(176-194)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1016/j.jvlc.2015.01.002
Chambers CScaffidi C(2018)Utility and accuracy of smell-driven performance analysis for end-user programmersJournal of Visual Languages and Computing10.1016/j.jvlc.2014.10.01726:C(1-14)Online publication date: 27-Dec-2018
https://dl.acm.org/doi/10.1016/j.jvlc.2014.10.017

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

An optimization strategy for mashups performance based on relational algebra

Linked open data in sensor data mashups

Data description and data access mechanism in distributed workflow system