Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3093338.3093381acmotherconferencesArticle/Chapter ViewAbstractPublication PagespearcConference Proceedingsconference-collections
research-article

High Performance Computing Enabled Simulation of the Food-Water-Energy System: Simulation of Intensively Managed Landscapes

Published: 09 July 2017 Publication History

Abstract

Domain science experts are commonly limited by computational efficiency of their code and hardware resources available for execution of desired simulations. Here, we detail a collaboration between domain scientists focused on simulating an ensemble of climate and human management decisions to drive environmental (e.g., water quality) and economic (e.g., crop yield) outcomes. Briefly, the domain scientists developed a message passing interface to execute the formerly serial code across a number of processors, anticipating significant performance improvement by moving to a cluster computing environment from their desktop machines. The code is both too complex to efficiently re-code from scratch and has a shared codebase that must continue to function on desktop machines as well as the parallel implementation. However, inefficiencies in the code caused the LUSTRE filesystem to bottleneck performance for all users. The domain scientists collaborated with Indiana University's Science Applications and Performance Tuning and High Performance File System teams to address the unforeseen performance limitations. The non-linear process of testing software advances and hardware performance is a model of the failures and successes that can be anticipated in similar applications. Ultimately, through a series of iterative software and hardware advances the team worked collaboratively to increase performance of the code, cluster, and file system to enable more than 100-fold increases in performance. As a result, the domain science is able to assess ensembles of climate and human forcing on the model, and sensitivities of ecologically and economically important outcomes of intensively managed agricultural landscapes.

References

[1]
Allinea Software. Allinea MAP - C/C++ profiler and Fortran profiler for high performance Linux code. https://www.allinea.com/products/map accessed on Jun 5, 2017.
[2]
Justin E. Bagley, Jesse Miller, and Carl J. Bernacchi. 2015. Biophysical impacts of climate-smart agriculture in the Midwest United States. Plant, cell & environment 38, 9 (2015), 1913--1930.
[3]
Shuwei Dai, Martha D. Shulski, Kenneth G. Hubbard, and Eugene S. Takle. 2016. A spatiotemporal analysis of Midwest US temperature and precipitation trends during the growing season from 1980 to 2013. International Journal of Climatology 36, 1 (2016), 517--525.
[4]
Caroline A. Davis, Adam S. Ward, Amy J. Burgin, Terrance D. Loecke, Diego A. Riveros-Iregui, Douglas J. Schnoebelen, Craig L. Just, Steven A. Thomas, Larry J. Weber, and Martin A. St Clair. 2014. Antecedent moisture controls on stream nitrate flux in an agricultural watershed. Journal of environmental quality 43, 4 (2014), 1494--1503.
[5]
Sarah C. Davis, William J. Parton, Stephen J. Del Grosso, Cindy Keough, Ernest Marx, Paul R. Adler, and Evan H. DeLucia. 2012. Impact of second-generation biofuel agriculture on greenhouse-gas emissions in the corn-growing regions of the US. Frontiers in Ecology and the Environment 10, 2 (2012), 69--74.
[6]
Simon D. Donner and Christopher J. Kucharik. 2008. Corn-based ethanol production compromises goal of reducing nitrogen export by the Mississippi River. Proceedings of the National Academy of Sciences 105, 11 (2008), 4513--4518.
[7]
Jonathan A. Foley, I. Colin Prentice, Navin Ramankutty, Samuel Levis, David Pollard, Steven Sitch, and Alex Haxeltine. 1996. An integrated biosphere model of land surface processes, terrestrial carbon balance, and vegetation dynamics. Global Biogeochemical Cycles 10, 4 (1996), 603--628.
[8]
L. Guanter, Y. Zhang, M. Jung, J. Joiner, M. Voigt, J.A. Berry, and M.S. Moran. 2014. Global and time-resolved monitoring of crop photosynthesis with chlorophyl fluorescence. Proceedings of the National Academy of Sciences 111, 14 (April 2014), E1327--E1333.
[9]
J. Hatfield, C. Swanston, M. Janowiak, R. Steele, J. Hempel, J. Bochicchio, W. Hall, M. Cole, S. Hestvik, and J. Whitaker. 2015. Midwest and Northern Forests Regional Climate Hub Assessment of Climate Change Vulnerability and Adaptation and Mitigation Strategies, edited by T. United States Department of Agriculture (2015).
[10]
Hypoxia Task Force. 2015. Mississippi River/Gulf of Mexico Hypoxia Task Force 2015 Report to Congress, 98 pp. (August 2015).
[11]
Indiana University. Big Red II at Indiana University. https://kb.iu.edu/d/bcqt accessed on March 13, 2017.
[12]
Indiana University. The Data Capacitor II and DC-WAN high-speed file systems at Indiana University. https://kb.iu.edu/d/avvh accessed on March 13, 2017.
[13]
Christopher J. Kucharik and Kristofor R. Brye. 2003. Integrated BIosphere Simulator (IBIS) yield and nitrate loss predictions for Wisconsin maize receiving varied amounts of nitrogen fertilizer. Journal of environmental quality 32, 1 (2003), 247--268.
[14]
Christopher J. Kucharik, Andy VanLoocke, John D. Lenters, and Melissa M. Motew. 2013. Miscanthus establishment and overwintering in the Midwest USA: a regional modeling study of crop residue management on critical minimum soil temperatures. PloS one 8, 7 (2013), e68847.
[15]
Philip E. Morefield, Stephen D. LeDuc, Christopher M. Clark, and Richard Iovanna. 2016. Grasslands, wetlands, and agriculture: the fate of land expiring from the Conservation Reserve Program in the Midwestern United States. Environmental Research Letters 11, 9 (2016), 094005.
[16]
Melissa M. Motew and Christopher J. Kucharik. 2013. Climate-induced changes in biome distribution, NPP, and hydrology in the Upper Midwest US: A case study for potential vegetation. Journal of Geophysical Research: Biogeosciences 118, 1 (2013), 248--264.
[17]
National Research Council et al. 2008. Water implications of biofuels production in the United States. National Academies Press. pp. 76.
[18]
National Research Council et al. 2011. Adapting to the impacts of climate change. National Academies Press.
[19]
Monte R. O'Neal, M.A. Nearing, Roel C. Vining, Jane Southworth, and Rebecca A. Pfeifer. 2005. Climate change impacts on soil erosion in Midwest United States with changes in crop management. Catena 61, 2 (2005), 165--184.
[20]
Paratools. Vampir. http://www.paratools.com/Vampir accessed on March 13, 2017.
[21]
Deepak K. Ray, Nathaniel D. Mueller, Paul C. West, and Jonathan A. Foley. 2013. Yield trends are insufficient to double global crop production by 2050. PloS one 8, 6 (June 2013), e66428.
[22]
Cynthia Rosenzweig, Francesco N. Tubiello, Richard Goldberg, Evan Mills, and Janine Bloomfield. 2002. Increased crop damage in the US from excess precipitation under climate change. Global Environmental Change 12, 3 (2002), 197--202.
[23]
Karen R. Ryberg, Wei Lin, and Aldo V. Vecchia. 2012. Impact of climate variability on runoff in the North-Central United States. Journal of Hydrologic Engineering 19, 1 (2012), 148--158.
[24]
Jane Southworth, J.C. Randolph, M. Habeck, O.C. Doering, R.A. Pfeifer, D. Gangadhar Rao, and J.J. Johnston. 2000. Consequences of future climate change and changing climate variability on maize yields in the midwestern United States. Agriculture, Ecosystems & Environment 82, 1 (2000), 139--158.
[25]
Kayla J. Steffens and K.J. Franz. 2012. Late 20th-century trends in Iowa watersheds: an investigation of observed and modelled hydrologic storages and fluxes in heavily managed landscapes. International Journal of Climatology 32, 9 (2012), 1373--1391.
[26]
William Stowe. 2016. Swimming Upstream: Des Moines Water Works Asks for Agricultural Accountability in A State that Claims to Feed the World. ROOT-STALK --- A Prairie Journal of Culture, Science and the Arts 2, 1 (2016), 32--37. https://ojs.grinnell.edu/index.php/prairiejournal/article/view/312
[27]
Virtual Institute-High Productivity Supercomputing. VI-HPS: Score-p. http://www.vi-hps.org/projects/score-p accessed on March 13, 2017.
[28]
Tracy E. Twine, Jarod J. Bryant, Katherine T. Richter, Carl J. Bernacchi, Kelly D. McConnaughay, Sherri J. Morris, and Andrew D.B. Leakey. 2013. Impacts of elevated CO2 concentration on the productivity and surface energy budget of the soybean and maize agroecosystem in the Midwest USA. Global change biology 19, 9 (2013), 2838--2852.
[29]
Peter C. Van Metre, Jeffrey W. Frey, MaryLynn Musgrove, Naomi Nakagaki, Sharon Qi, Barbara J. Mahler, Michael E. Wieczorek, and Daniel T. Button. 2016. High Nitrate Concentrations in Some Midwest United States Streams in 2013 after the 2012 Drought. Journal of Environmental Quality 45, 5 (2016), 1696--1704.
[30]
Andy Vanloocke, Carl J. Bernacchi, and Tracy E. Twine. 2010. The impacts of Miscanthus× giganteus production on the Midwest US hydrologic cycle. Gcb Bioenergy 2, 4 (2010), 180--191.
[31]
Andy VanLoocke, Tracy E. Twine, Christopher J. Kucharik, and Carl J. Bernacchi. 2016. Assessing the potential to decrease the Gulf of Mexico hypoxic zone with Midwest US perennial cellulosic feedstock production. GCB Bioenergy (2016).
[32]
Andy VanLoocke, Tracy E. Twine, Marcelo Zeri, and Carl J. Bernacchi. 2012. A regional comparison of water use efficiency for miscanthus, switchgrass and maize. Agricultural and Forest Meteorology 164 (2012), 82--95.
[33]
Berkley J. Walker, Andy VanLoocke, Carl J. Bernacchi, and Donald R. Ort. 2016. The costs of photorespiration to food production now and in the future. Annual review of plant biology 67 (2016), 107--129.
[34]
Donald J. Wuebbles and Katharine Hayhoe. 2004. Climate Change Projections for the United States Midwest. Mitigation and Adaptation Strategies for Global Change 9, 4 (2004), 335--363.
[35]
Qichun Yang, Hanqin Tian, Marjorie A.M. Friedrichs, Charles S. Hopkinson, Chaoqun Lu, and Raymond G. Najjar. 2015. Increased nitrogen export from eastern North America to the Atlantic Ocean due to climatic and anthropogenic changes during 1901--2008. Journal of Geophysical Research: Biogeosciences 120, 6 (2015), 1046--1068. 2014JG002763.

Cited By

View all
  • (2022)Terrestrial Ecosystem Modeling with IBIS: Progress and Future VisionJournal of Resources and Ecology10.5814/j.issn.1674-764x.2022.01.00113:1Online publication date: 1-Jan-2022
  • (2022) A machine learning approach to water quality forecasts and sensor network expansion: Case study in the Wabash River Basin, United States Hydrological Processes10.1002/hyp.1461936:6Online publication date: 14-Jun-2022
  • (2018)Phogo: A low cost, free and “maker” revisit to LogoComputers in Human Behavior10.1016/j.chb.2017.09.02980:C(428-440)Online publication date: 1-Mar-2018

Index Terms

  1. High Performance Computing Enabled Simulation of the Food-Water-Energy System: Simulation of Intensively Managed Landscapes

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    PEARC '17: Practice and Experience in Advanced Research Computing 2017: Sustainability, Success and Impact
    July 2017
    451 pages
    ISBN:9781450352727
    DOI:10.1145/3093338
    • General Chair:
    • David Hart
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 09 July 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Agro-IBIS
    2. agro-ecosystem
    3. benchmarking
    4. case study
    5. computer cluster
    6. filesystems
    7. hpc
    8. lustre
    9. meta-data
    10. modeling
    11. mpi
    12. parallel computing
    13. performance
    14. scaling
    15. vampir

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    PEARC17

    Acceptance Rates

    PEARC '17 Paper Acceptance Rate 54 of 79 submissions, 68%;
    Overall Acceptance Rate 133 of 202 submissions, 66%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)3
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 25 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2022)Terrestrial Ecosystem Modeling with IBIS: Progress and Future VisionJournal of Resources and Ecology10.5814/j.issn.1674-764x.2022.01.00113:1Online publication date: 1-Jan-2022
    • (2022) A machine learning approach to water quality forecasts and sensor network expansion: Case study in the Wabash River Basin, United States Hydrological Processes10.1002/hyp.1461936:6Online publication date: 14-Jun-2022
    • (2018)Phogo: A low cost, free and “maker” revisit to LogoComputers in Human Behavior10.1016/j.chb.2017.09.02980:C(428-440)Online publication date: 1-Mar-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media