Planning and Scheduling Data Processing Workflows in the Cloud with Quality-of-Data Constraints

1. Bartholomew, D.: Qemu: a multihost, multitarget emulator. Linux J. 2006(145), 3 (2006)

   Google Scholar 

2. Blythe, J., Jain, S., Deelman, E., Gil, Y., Vahi, K., Mandal, A., Kennedy, K.: Task scheduling strategies for workflow-based applications in grids. In: Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid (CCGRID 2005), pp. 759–767. IEEE Computer Society, Washington, DC (2005)

   Google Scholar 

3. Brown, D.A., Brady, P.R., Dietz, A., Cao, J., Johnson, B., McNabb, J.: A case study on the use of workflow technologies for scientific analysis: Gravitational wave data analysis. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Workflows for e-Science. Springer, London (2007)

   Google Scholar 

4. Chen, W.-N., Zhang, J.: An ant colony optimization approach to a grid workflow scheduling problem with various qos requirements. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 39(1), 29–43 (2009)

   Article  Google Scholar 

5. Costa, F., Silva, J.N., Veiga, L., Ferreira, P.: Large-scale volunteer computing over the internet. J. Internet Services and Applications 3(3), 329–346 (2012)

   Article  Google Scholar 

6. Couvares, P., Kosar, T., Roy, A., Weber, J., Wenger, K.: Workflow management in condor. In: Taylor, I.J., Deelman, E., Gannon, D.B., Shields, M. (eds.) Workflows for e-Science, pp. 357–375. Springer, Heidelberg (2007)

   Chapter  Google Scholar 

7. Deelman, E., et al.: Managing large-scale workflow execution from resource provisioning to provenance tracking: The cybershake example. In: Proceedings of the Second IEEE International Conference on e-Science and Grid Computing, E-SCIENCE 2006, p. 14. IEEE Computer Society, Washington, DC (2006)

   Chapter  Google Scholar 

8. Eder, J., Panagos, E., Rabinovich, M.: Time constraints in workflow systems. In: Jarke, M., Oberweis, A. (eds.) CAiSE 1999. LNCS, vol. 1626, pp. 286–300. Springer, Heidelberg (1999)

   Chapter  Google Scholar 

9. Esteves, S., Silva, J.N., Veiga, L.: Fluchi: a quality-driven dataflow model for data intensive computing. Journal of Internet Services and Applications 4(1), 12 (2013)

   Article  Google Scholar 

10. George, L.: HBase: The Definitive Guide, 1st edn. O’Reilly Media (2011)

    Google Scholar 

11. Hoffa, C., Mehta, G., Freeman, T., Deelman, E., Keahey, K., Berriman, B., Good, J.: On the use of cloud computing for scientific workflows. In: EEE Fourth International Conference on eScience, 2008, pp. 640–645 (2008)

    Google Scholar 

12. Li, X., Plale, B., Vijayakumar, N., Ramachandran, R., Graves, S., Conover, H.: Real-time storm detection and weather forecast activation through data mining and events processing. Earth Science Informatics

    Google Scholar 

13. Mandal, A., Kennedy, K., Koelbel, C., Marin, G., Mellor-Crummey, J., Liu, B., Johnsson, L.: Scheduling strategies for mapping application workflows onto the grid. In: Proceedings of the 14th IEEE International Symposium on High Performance Distributed Computing, HPDC-2014, pp. 125–134 (2005)

    Google Scholar 

14. Mao, M., Humphrey, M.: Auto-scaling to minimize cost and meet application deadlines in cloud workflows. In: 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC), pp. 1–12 (2011)

    Google Scholar 

15. Oliveira, P., Ferreira, P., Veiga, L.: Gridlet economics: Resource management models and policies for cycle-sharing systems. In: Riekki, J., Ylianttila, M., Guo, M. (eds.) GPC 2011. LNCS, vol. 6646, pp. 72–83. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

16. Puterman, M.L.: Markov Decision Processes: Discrete Stochastic Dynamic Programming, 1st edn. John Wiley & Sons, Inc., New York (1994)

    Book  MATH  Google Scholar 

17. Richards, M., Ghanem, M., Osmond, M., Guo, Y., Hassard, J.: Grid-based analysis of air pollution data. Ecological Modelling 194(1-3), 274–286 (2006)

    Article  Google Scholar 

18. Shi, Z., Dongarra, J.J.: Scheduling workflow applications on processors with different capabilities. Future Gener. Comput. Syst. 22(6), 665–675 (2006)

    Article  Google Scholar 

19. Simão, J., Veiga, L.: Qoe-jvm: An adaptive and resource-aware java runtime for cloud computing. In: OTM Conferences, vol. 2, pp. 566–583 (2012)

    Google Scholar 

20. Veiga, L., Rodrigues, R., Ferreira, P.: Gigi: An ocean of gridlets on a “grid-for-the-masses”. In: CCGRID, pp. 783–788. IEEE Computer Society (2007)

    Google Scholar 

21. Wieczorek, M., Prodan, R., Fahringer, T.: Scheduling of scientific workflows in the askalon grid environment. SIGMOD Rec. 34(3), 56–62 (2005)

    Article  Google Scholar 

22. Wu, Z., Liu, X., Ni, Z., Yuan, D., Yang, Y.: A market-oriented hierarchical scheduling strategy in cloud workflow systems. The Journal of Supercomputing 63, 256–293 (2013)

    Article  Google Scholar 

23. Yih, Y., Thesen, A.: Semi-Markov Decision Models for Real-time Scheduling. Research memorandum. School of Industrial Engineering, Purdue University (1991)

    Google Scholar 

24. Yu, J., Buyya, R.: A taxonomy of scientific workflow systems for grid computing. SIGMOD Rec. 34(3), 44–49 (2005)

    Article  Google Scholar 

25. Yu, J., Buyya, R., Tham, C.K.: Cost-based scheduling of scientific workflow application on utility grids. In: Proceedings of the First International Conference on e-Science and Grid Computing, E-SCIENCE 2005, pp. 140–147. IEEE Computer Society, Washington, DC (2005)

    Google Scholar 

Download references