research-article

HydroCompute: : An open-source web-based computational library for hydrology and environmental sciences

Authors:

Carlos Erazo Ramirez,

Ibrahim DemirAuthors Info & Claims

Volume 175, Issue C

https://doi.org/10.1016/j.envsoft.2024.106005

Published: 01 April 2024 Publication History

Abstract

We present HydroCompute, a high-performance client-side computational library specifically designed for web-based hydrological and environmental science applications. Leveraging state-of-the-art technologies in web-based scientific computing, the library facilitates both sequential and parallel simulations, optimizing computational efficiency. Employing multithreading via web workers, HydroCompute enables the porting and utilization of various engines, including WebGPU, Web Assembly, and native JavaScript code. Furthermore, the library supports local data transfers through peer-to-peer communication using WebRTC. The flexible architecture and open-source nature of HydroCompute provide effective data management and decision-making capabilities, allowing users to integrate their own code into the framework. To demonstrate the capabilities of the library, we conducted two case studies: a benchmarking study assessing the performance of different engines and a real-time data processing and analysis application for the state of Iowa. The results exemplify HydroCompute's potential to enhance computational efficiency and contribute to the interoperability and advancement of hydrological and environmental sciences.

Highlights

•

HydroCompute is a web-based high-performance library designed specifically for hydrology and environmental sciences.

•

Developed to leverage local multithreading in both CPU and GPU, resulting in significantly performance improvements.

•

The library enables computational efficiency in both sequential and parallel simulations, catering to diverse modeling needs.

•

Using technologies such as Web Workers, WebAssembly, WebGPU, and WebRTC, the library facilitates efficient data manipulation.

•

Through the developed case studies, the library demonstrates its relevance and applicability in the field of hydrology.

References

[1]

E. Angel, D. Shreiner, Interactive Computer Graphics with WebGL, Addison-Wesley Professional, 2014.

Digital Library

[2]

M. Asgari, W. Yang, J. Lindsay, B. Tolson, M.M. Dehnavi, A review of parallel computing applications in calibrating watershed hydrologic models, Environ. Model. Software 151 (2022),.

Digital Library

[3]

A.M. Castronova, L. Brazil, M. Leon, J.S. Horsburgh, D. Tarboton, CUAHSI tools and services for managing research data, HydroShare (2019),.

[4]

L. Cunha, K. Jennings, A. Wood, N. Mizukami, F. Ogden, X. Feng, Y. Liu, S. Peckham, J. Garrett, J. Frame, S. Cui, D. Johnson, D. Mattern, J. Johnson, N. Frazier, R. Bartel, B. Avant, R. McDaniel, M. Williamson, Next Generation National Water Model: Strategy and Preliminary Performance of Initial Model Formulations, 2021 AGU Fall Meeting Abstracts, 2021, https://ui.adsabs.harvard.edu/abs/2021AGUFM.H54G.04C.

[5]

I. Demir, H. Conover, W.F. Krajewski, B.C. Seo, R. Goska, Y. He, M.F. McEniry, S.J. Graves, W. Petersen, Data-enabled field experiment planning, management, and research using cyberinfrastructure, J. Hydrometeorol. 16 (3) (2015) 1155–1170,.

[6]

I. Demir, R. Szczepanek, Optimization of river network representation data models for web‐based systems, Earth Space Sci. 4 (6) (2017) 336–347,.

[7]

I. Demir, S. Galelli, Next generation hydroinformatics applications in water resources research and education, in: ICWRER 2022 9^th International Conference on Water Resources and Environment Research, 2022.

[8]

I. Demir, M.B. Beck, GWIS: a prototype information system for Georgia watersheds, in: Georgia Water Resources Conference: Regional Water Management Opportunities, UGA, Athens, GA, US, 2009.

[9]

I. Demir, F. Jiang, R.V. Walker, A.K. Parker, M.B. Beck, Information systems and social legitimacy scientific visualization of water quality, in: 2009 IEEE International Conference on Systems, Man and Cybernetics, IEEE, 2009, pp. 1067–1072.

[10]

ECMA International, ECMAScript 2015 Specification, 2015, https://262.ecma-international.org/6.0/.

[11]

C. Erazo Ramirez, Y. Sermet, I. Demir, HydroLang markup language: community-driven web components for hydrological analyses, J. Hydroinf. 25 (4) (2023) 1171–1187,.

[12]

C. Erazo Ramirez, Y. Sermet, F. Molkenthin, I. Demir, HydroLang: an open-source web-based programming framework for hydrological sciences, Environ. Model. Software 157 (2022),.

Digital Library

[13]

G. Ewing, C. Erazo Ramirez, A. Vaidya, I. Demir, Client-side web-based model coupling using basic model interface for hydrology and water resources, J. Hydroinf. (2024),.

[14]

G. Ewing, R. Mantilla, W. Krajewski, I. Demir, Interactive hydrological modelling and simulation on client-side web systems: an educational case study, J. Hydroinf. 24 (6) (2022) 1194–1206,.

[15]

H. Freitas, C. Mendes, Parallelization of a Large-Scale Watersheds Hydrological Model Using CPU and GPU, 2018,.

[16]

C. Gerard, TensorFlow.js, in: C. Gerard (Ed.), Practical Machine Learning in JavaScript: TensorFlow.Js for Web Developers, Apress, 2021, pp. 25–43,.

[17]

A. Gerasoulis, T. Yang, A comparison of clustering heuristics for scheduling directed acyclic graphs on multiprocessors, J. Parallel Distr. Comput. 16 (4) (1992) 276–291,.

[18]

J.L.P. Goodall, D. Scott, Interoperability Between the Basic Modeling Interface (BMI) and the Open Modeling Interface (OpenMI): A Step toward Building The Earth System Bridge For Modeling Framework Interoperability International Congress on Environmental Modelling and Software, 2016, Toulouse https://scholarsarchive.byu.edu/iemssconference/2016/Stream-A/28/.

[19]

J.S. Horsburgh, M.M. Morsy, A.M. Castronova, J.L. Goodall, T. Gan, H. Yi, M.J. Stealey, D.G. Tarboton, HydroShare: sharing diverse environmental data types and models as social objects with application to the hydrology domain, JAWRA J. Am. Water Resour. Assoc. 52 (4) (2016) 873–889,.

[20]

A. Hu, I. Demir, Real-time flood mapping on client-side web systems using HAND model, Hydrology 8 (2) (2021),.

[21]

Q. Huang, Z. Huang, P. Werstein, M. Purvis, GPU as a General Purpose Computing Resource. International Conference on Parallel and Distributed Computing, Applications and Technologies, 2008.

[22]

R. Hunger, Floating Point Operations in Matrix-Vector Calculus: Technical Report, Technische Universität München, 2007, https://mediatum.ub.tum.de/doc/625604/625604.

[23]

N.T. Kottegoda, R. Rosso, Applied Statistics for Civil and Environmental Engineers, Wiley-Blackwell, 2008.

[24]

Z. Li, I. Demir, A comprehensive web-based system for flood inundation map generation and comparative analysis based on height above nearest drainage, Sci. Total Environ. 828 (2022),.

[25]

Z. Li, J. Mount, I. Demir, Accounting for uncertainty in real-time flood inundation mapping using HAND model: Iowa case study, Nat. Hazards 112 (1) (2022) 977–1004,.

[26]

Z. Li, I. Demir, U-net-based semantic classification for flood extent extraction using SAR imagery and GEE platform: a case study for 2019 central US flooding, Sci. Total Environ. 869 (2023),.

[27]

P. Maloszewski, A. Zuber, Principles and practice of calibration and validation of mathematical models for the interpretation of environmental tracer data in aquifers, Adv. Water Resour. 16 (3) (1993) 173–190,.

[28]

S. McDonald, I.N. Mohammed, J.D. Bolten, S. Pulla, C. Meechaiya, A. Markert, E.J. Nelson, R. Srinivasan, V. Lakshmi, Web-based decision support system tools: the soil and water assessment tool online visualization and analyses (SWATOnline) and NASA earth observation data downloading and reformatting tool (NASAaccess), Environ. Model. Software 120 (2019),.

[29]

OpenGIS, Open Modelling Interface (OpenMI) Interface Standard, OGC Standards, 2014.

[30]

Thomas C. Peterson, Russell S. Vose, An overview of the Global Historical Climatology Network temperature data base, Bull. Am. Meteorol. Soc. 78 (12) (1997) 2837–2849.

[31]

M.M. Reed, S.W. Carol, S. Steve, V. Jan, V. Harry, D.W.E. Clemens Simmer, Proof of concept of regional scale hydrologic simulations at hydrologic resolution utilizing massively parallel computer resources, Water Resour. Res. 46 (2010),.

[32]

R. Rönngren, R. Ayani, A comparative study of parallel and sequential priority queue algorithms, ACM Trans. Model Comput. Simulat 7 (2) (1997) 157–209,.

Digital Library

[33]

A. Rossberg, B.L. Titzer, A. Haas, D.L. Schuff, D. Gohman, L. Wagner, A. Zakai, J.F. Bastien, M. Holman, Bringing the web up to speed with WebAssembly, Commun. ACM 61 (12) (2018) 107–115,.

Digital Library

[34]

A.J. Rueda, J.M. Noguera, A. Luque, A comparison of native GPU computing versus OpenACC for implementing flow-routing algorithms in hydrological applications, Comput. Geosci. 87 (2016) 91–100,.

Digital Library

[35]

M. Segal, K. Akeley, The OpenGL Graphics System: A Specification (Version 1.1), 1999.

[36]

J. Shaake, S. Cong, Q. Duan, U.S. MOPEX DATA SET. NOAA National Weather Service, 2009, https://hydrology.nws.noaa.gov/pub/gcip/mopex/US_Data/Documentation.

[37]

M. Sit, I. Demir, Democratizing deep learning applications in earth and climate sciences on the web: EarthAIHub, Appl. Sci. 13 (5) (2023) 3185,.

[38]

M. Sit, Y. Sermet, I. Demir, Optimized watershed delineation library for server-side and client-side web applications, Open Geospatial Data, Softw. Standards 4 (1) (2019),.

[39]

B. Stojanović, N. Milivojević, M. Ivanović, D. Divac, Dot net platform for distributed evolutionary algorithms with application in Hydroinformatics, Adv. Syst. Anal., Softw. Eng., High Performance Comput. (2014) 362–386,.

[40]

N.R. Swain, Tethys Platform: A Development and Hosting Platform for Water Resources Web Apps, Ph.D., Brigham Young University, United States -- Utah, 2015, (Publication Number 28105506).

[41]

U.o. Tennessee, Message-Passing Interface Standard MPI, MPI Forum, 2021.

[42]

M.M. Trompouki, L. Kosmidis, Towards General Purpose Computations on Low-End Mobile GPUs. 2016 Design, Automation & Test in Europe Conference & Exhibition, 2016.

[43]

U.S. Geological Survey, National Water Information System Data, Accessed 2023 via HIS Central, 2023, http://hiscentral.cuahsi.org.

[44]

A.V. Vecchia, Periodic autoregressive-moving average (Parma) modeling with applications to water resources, J. Am. Water Resour. Assoc. 21 (5) (1985) 721–730,.

[45]

E.R. Vivoni, G. Mascaro, S. Mniszewski, P. Fasel, E.P. Springer, V.Y. Ivanov, R.L. Bras, Real-world hydrologic assessment of a fully-distributed hydrological model in a parallel computing environment, J. Hydrol. 409 (1–2) (2011) 483–496,.

[46]

V. Volkov, J. Demmel, Benchmarking GPUs to tune dense linear algebra. 2008 SC, in: International Conference for High Performance Computing, Networking, Storage and Analysis, 2008,.

[47]

T. Wagener, J. Kollat, Numerical and visual evaluation of hydrological and environmental models using the Monte Carlo analysis toolbox, Environ. Model. Software 22 (7) (2007) 1021–1033,.

Digital Library

[48]

W3C, WebAssembly Standard, 2019, https://www.w3.org/TR/wasm-core-1/.

[49]

W3C, Web Workers Standard, 2021, https://www.w3.org/TR/2021/NOTE-workers-20210128/.

[50]

W3C, WebGPU – Working Draft Standard, 2023, https://www.w3.org/TR/webgpu/.

[51]

W3C, WebRTC: Real-Time Communication in Browsers, 2023, https://www.w3.org/TR/webrtc/.

[52]

Y. Wu, T. Li, L. Sun, J. Chen, Parallelization of a hydrological model using the message passing interface, Environ. Model. Software 43 (2013) 124–132,.

Digital Library

[53]

H. Xu, I. Demir, C. Koylu, M. Muste, A web-based geovisual analytics platform for identifying potential contributors to culvert sedimentation, Sci. Total Environ. 692 (2019) 806–817,.

[54]

B. Zhang, M. Chen, Z. Ma, Z. Zhang, S. Yue, D. Xiao, Z. Zhu, Y. Wen, G. Lü, An online participatory system for SWMM-based flood modeling and simulation, Environ. Sci. Pollut. Control Ser. 29 (5) (2022) 7322–7343,.

[55]

B.B. Zhou, X. Qu, R.P. Brent, Effective scheduling in a mixed parallel and sequential computing environment, in: Proceedings of the Sixth Euromicro Workshop on Parallel and Distributed Processing - PDP '98, 1998.

[56]

D. Zuo, G. Kan, H. Sun, H. Zhang, K. Liang, Improving computational efficiency of GLUE method for hydrological model uncertainty and parameter estimation using CPU-GPU hybrid high performance computer cluster, Nat. Hazards Earth Syst. Sci. Discuss. 2021 (2021) 1–33,.

Cited By

Erazo Ramirez CSermet YShahid MDemir I(2024)HydroRTCEnvironmental Modelling & Software10.1016/j.envsoft.2024.106068178:COnline publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1016/j.envsoft.2024.106068

Recommendations

To Re-experience the Web: A Framework for the Transformation and Replay of Archived Web Pages
When replaying an archived web page, or memento, the fundamental expectation is that the page should be viewable and function exactly as it did at the archival time. However, this expectation requires web archives upon replay to modify the page and its ...
Subsidence study for non-crushable containers in slit trenches at the Savannah River site
SpringSim '08: Proceedings of the 2008 Spring simulation multiconference

Using PC-based PorFlow™ Version 5.97, this study addresses the issue of waste and cover subsidence caused by corrosion of the non-crushable waste containers defined as containers with significant void space that will not be stabilized by dynamic ...
A GIS tool for hydrogeological water balance evaluation on a regional scale in semi-arid environments

A GIS tool to evaluate hydrogeological water balance based on a mass-balance model applied to surface and subsurface systems is discussed. The tool is designed for managers responsible for groundwater resource planning during conditions of water ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Environmental Modelling & Software

Environmental Modelling & Software Volume 175, Issue C

Apr 2024

319 pages

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 April 2024

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Erazo Ramirez CSermet YShahid MDemir I(2024)HydroRTCEnvironmental Modelling & Software10.1016/j.envsoft.2024.106068178:COnline publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1016/j.envsoft.2024.106068

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents