article

Partial execution of Mashup Plans during modeling time

Authors:

Michael Behringer,

Bernhard MitschangAuthors Info & Claims

Computer Science - Research and Development, Volume 33, Issue 3-4

Pages 341 - 352

https://doi.org/10.1007/s00450-017-0388-x

Published: 01 August 2018 Publication History

Abstract

Workflows and workflow technologies are an approved means to orchestrate services while supporting parallelism, error handling, and asynchronous messaging. A special case workflow technology is applied to are Data Mashups. In Data Mashups, workflows orchestrate services that specialize on data processing. The workflow model itself specifies the order data is processed in. Due to the fact that Data Mashups aim for usability of domain-experts with limited IT and programming knowledge, they oftentimes offer a layer on top that abstracts from the concrete workflow model and technology. This model is then transformed into an executable workflow model. However, transforming and executing the model as a whole leads to efficiency issues. In this paper, we introduce an approach to execute part of this model during modeling time. More precisely, once a specific part is modeled, it is transformed into an executable workflow fragment and executed in the backend. Consequently, once the user created the whole model, the execution time seems to be much shorter for the user because most of the model has already been processed. Furthermore, through our approach, access to intermediate results is enabled at modeling time already.

References

[1]

Aghaee S, Pautasso C (2013) Live mashup tools: challenges and opportunities. In: Proceedings of the 1st international workshop on live programming, LIVE 2013, San Francisco, California, USA, 19 May 2013, pp 1---4.

Digital Library

[2]

Altintas I, Barney O, Jaeger-Frank E (2006) Provenance collection support in the Kepler scientific workflow system. In: Proceedings of the 2006 international conference on provenance and annotation of data, IPAW'06. Springer, Berlin, pp 118---132.

Digital Library

[3]

Altintas I, Berkley C, Jaeger E, Jones M, Ludascher B, Mock S (2004) Kepler: an extensible system for design and execution of scientific workflows. In: Proceedings of the 16th international conference on scientific and statistical database management, 2004, pp 423---424.

Digital Library

[4]

Andrews T, Curbera F, Dholakia H, Goland Y, Klein J, Leymann F, Liu K, Roller D, Smith D, Thatte S et al (2003) Business process execution language for web services. online

[5]

Apache: Ant. http://ant.apache.org

[6]

Apache: Spark. online. http://spark.apache.org/

[7]

Apache: Tomcat application server. online. http://tomcat.apache.org/

[8]

Behringer M, Hirmer P, Mitschang B (2017) Towards interactive data processing and analytics--putting the human in the center of the loop. In: Proceedings of the 19th international conference on enterprise information systems (ICEIS)

[9]

Cohn D et al (2009) Business artifacts: a data-centric approach to modeling business operations and processes. Bull IEEE Comput Soc Tech Comm Data Eng 32:3---9

[10]

Daniel F, Koschmider A, Nestler T, Roy M, Namoun A (2010) Toward process mashups: key ingredients and open research challenges. In: Proceedings of the 3rd and 4th international workshop on web APIs and services mashups, mashups '09/'10, Ayia Napa, Cyprus, December 1, 2010/Orlando, Florida, USA, 25 October 2009, pp 9:1---9:8.

Digital Library

[11]

Daniel F, Matera M (2014) Mashups--concepts, models and architectures. In: Data-centric systems and applications. Springer.

[12]

Hirmer P (2016)Flexible execution and modeling of data processing and integration flows. In: Barzen J, Khalaf R, Leymann F, Mitschang B (eds) Proceedings of the 10th advanced summer school on service oriented computing. IBM Research Report, pp 26---40. http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=INPROC-2016-30&engl=0

[13]

Hirmer P, Behringer M (2017) Second international rapid mashup challenge, RMC 2016, Lugano, Switzerland, 6 June 2016. Revised Selected Papers, chap. FlexMash 2.0--flexible modeling and execution of Data Mashups. Springer International Publishing, Cham, pp 10---29.

[14]

Hirmer P, Mitschang B (2016) Rapid mashup development tools: first international rapid mashup challenge, RMC 2015, Rotterdam, The Netherlands, 23 June 2015. Revised selected papers, chap. FlexMash--flexible data mashups based on pattern-based model transformation. Springer International Publishing, Cham, pp 12---30.

[15]

Hirmer P, Mitschang B (2016) TOSCA4Mashups: enhanced method for on-demand data mashup provisioning. Comput Sci Res Dev, pp 1---10. http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=ART-2016-13&engl=0

Digital Library

[16]

Hirmer P, Reimann P, Wieland M, Mitschang B (2015) Extended techniques for flexible modeling and execution of Data Mashups. In: Proceedings of the 4th international conference on data management technologies and applications (DATA)

Digital Library

[17]

Hirmer P, Wieland M, Breitenbücher U, Mitschang B (2016) Automated sensor registration, binding and sensor data provisioning. In: Proceedings of the CAiSE'16 forum, at the 28th international conference on advanced information systems engineering (CAiSE 2016), CEUR workshop proceedings, vol 1612, pp 81---88. CEUR-WS.org, Ljubljana, Slovenia (2016). http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=INPROC-2016-22&engl=0

[18]

jsPlumb: online. http://jsplumbtoolkit.com/

[19]

Leymann F, Roller D (2000) Production workflow--concepts and techniques. PTR Prentice Hall. http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=BOOK-2000-01&engl=0

Digital Library

[20]

Ludäscher B, Altintas I, Berkley C, Higgins D, Jaeger E, Jones M, Lee EA, Tao J, Zhao Y (2006) Scientific workflow management and the kepler system: research articles. Concurr Comput Pract Exp. 18(10):1039---1065

Digital Library

[21]

Meunier R (1995) The pipes and filters architecture. In: Coplien JO, Schmidt DC (eds) Pattern languages of program design. ACM Press/Addison-Wesley Publishing Co., New York, pp 427---440

Digital Library

[22]

MongoDB: online. https://www.mongodb.com/

[23]

Node-RED: online. http://nodered.org/

[24]

Notation B.P.M (2006) Object management group, Needham, MA, USA, vol 2, no 2

[25]

OASIS Standard (2013) Topology and orchestration specification for cloud applications Version 1.0. http://docs.oasis-open.org/tosca/TOSCA/v1.0/os/TOSCA-v1.0-os.html

[26]

OASIS TOSCA primer (2013). http://docs.oasis-open.org/tosca/tosca-primer/v1.0/cnd01/tosca-primer-v1.0-cnd01.pdf

[27]

Papazoglou MP, Traverso P, Dustdar S, Leymann F (2007) Service-oriented computing: state of the art and research challenges. Computer 40(11):38---45.

Digital Library

[28]

Pautasso C, Alonso G (2003) Visual composition of web services. In: 2003 IEEE symposium on human centric computing languages and environments (HCC 2003), 28---31 October 2003, Auckland, New Zealand, pp 92---99.

Digital Library

[29]

Pautasso C, Alonso G (2005) The jopera visual composition language. J Vis Lang Comput 16(1---2):119---152.

Digital Library

[30]

Sonntag M, Karastoyanova D (2011) Enforcing the repeated execution of logic in workflows. In: Proceedings of the 1st international conference on business intelligence and technology (BUSTECH 2011), Rome, Italy, 2011. IARIA, pp 1---6. http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=INPROC-2011-56&engl=0

[31]

Sonntag M, Karastoyanova D (2012) Ad hoc iteration and re-execution of activities in workflows. Int J Adv Softw 5(1 & 2):91---109. http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=ART-2012-10&engl=0

[32]

Sonntag M, Karastoyanova D (2013) Model-as-you-go: an approach for an advanced infrastructure for scientific workflows. J Grid Comput 11(3):553---583. http://www2.informatik.uni-stuttgart.de/cgi-bin/NCSTRL/NCSTRL_view.pl?id=ART-2013-06&engl=0

Digital Library

[33]

Sun Y et al (2014) Modeling data for business processes. In: Proceedings of the 30th IEEE international conference on data engineering (ICDE), Chicago, USA

[34]

Thusoo A, Sarma JS, Jain N, Shao Z, Chakka P, Anthony S, Liu H, Wyckoff P, Murthy R (2009) Hive: a warehousing solution over a map-reduce framework. Proc VLDB Endow 2(2):1626---1629.

Digital Library

[35]

Typescript: JavaScript that scales. online. https://www.typescriptlang.org/

Cited By

Behringer MHirmer P(2023)Interactive Data Mashups for User-Centric Data AnalysisProceedings of the 35th International Conference on Scientific and Statistical Database Management10.1145/3603719.3603742(1-4)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3603719.3603742

Recommendations

Adaptive workflow nets for grid computing
PaCT'07: Proceedings of the 9th international conference on Parallel Computing Technologies

Existing grid applications commonly use workflows for the orchestration of grid services. Existing workflow models however suffer from the lack of adaptivity. In this paper we define Adaptive Grid Workflow nets (AGWF nets) appropriate for modeling grid ...
CD-HIT Workflow Execution on Grids Using Replication Heuristics
CCGRID '08: Proceedings of the 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid

Grid Computing has proven to be a solution for big workflow execution, especially in Bioinformatics. However, Grid nature itself introduces overheads that make its use in many cases an unfeasible solution if considering wall-time. Different heuristics ...
A service-based approach for the execution of scientific workflows in grids
CF '10: Proceedings of the 7th ACM international conference on Computing frontiers

Scientific workflows may be deployed on heterogeneous distributed environments, including Grid resources whose access is not straightforward when it is non compliant with the specific Grid middleware. This paper addresses this complexity and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computer Science - Research and Development

Computer Science - Research and Development Volume 33, Issue 3-4

August 2018

70 pages

ISSN:1865-2034

Issue’s Table of Contents

Copyright © Copyright © 2018 Springer-Verlag GmbH Germany, part of Springer Nature.

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 01 August 2018

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Behringer MHirmer P(2023)Interactive Data Mashups for User-Centric Data AnalysisProceedings of the 35th International Conference on Scientific and Statistical Database Management10.1145/3603719.3603742(1-4)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3603719.3603742

View Options

View options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents