research-article

Parallelization of ensemble neural networks for spatial land-use modeling

Authors:

Jean-Claude ThillAuthors Info & Claims

LBSN '12: Proceedings of the 5th ACM SIGSPATIAL International Workshop on Location-Based Social Networks

Pages 48 - 54

https://doi.org/10.1145/2442796.2442808

Published: 06 November 2012 Publication History

Abstract

Artificial neural networks have been widely applied to spatial modeling and knowledge discovery because of their high-level intelligence and flexibility. Their highly parallel and distributed structure makes them inherently suitable for parallel computing. As the technology of parallel and high-performance computing evolves and computing resources become more widely available, new opportunities exist for spatial neural network models to benefit from this advancement in terms of better handling computational and data intensity associated with spatial problems. In this study, we present a hybrid parallel ensemble neural network approach for modeling spatial land-use change. Our approach combines the shared-memory paradigm and the embarrassingly parallel method by leveraging the power of multicore computer clusters. The efficacy of this approach is demonstrated by the parallelization of Fuzzy ARTMAP neural network models, which have been extensively used in land-use modeling applications. We adopt an ensemble structure of neural networks to train multiple models in parallel and make use of the entire dataset simultaneously. We evaluate the proposed parallelization approach by examining performance variation of training datasets with alternative sizes. Experimental results reveal great potential of higher performance achievement when our hybrid parallel computing approach is applied to large spatial modeling problems.

References

[1]

Adhvaryn, P. S., Panchal, M. 2012. A review on diverse ensemble methods for classification. IOSR Journal of Computer Engineering. 1, 4, 27--32.

[2]

Almeida, C. M., Gleriani, J. M., Castejon, E. F., and Soares-Filho, B. S. 2008. Using neural networks and cellular automata for modelling intra-urban land-use dynamics. International Journal of Geographical Information Science. 22, 9, 943--963.

Digital Library

[3]

Baldi, P. and Hornik, K. 1989. Neural networks and principal component analysis: Learning from examples without local minima. Neural Networks. 2, 53--58.

Digital Library

[4]

Carpenter, G., Grossberg, S., Markuzon, S., Martens, N., Reynolds, J., and Rosen, D. 1992. Fuzzy ARTMAP: a neural network architecture for incremental supervised learning of analog multidimensional maps. IEEE Transactions on Neural Networks. 3, 698--713.

Digital Library

[5]

Chapman, B., Jost, G. and van der Pas, R. 2008. Using OpenMP: portable shared memory parallel programming. MIT Press, Cambridge, MA.

[6]

Civco, D. L. 1993. Artificial neural networks for land-cover classification and mapping. International Journal of Geographical Information Systems. 7, 2, 173--186.

[7]

Fischer, M. M. and Gopal, S. 1994. Artificial neural networks: A new approach to modeling interregional telecommunication flows. Journal of Regional Science. 34, 4, 503--527.

[8]

Fischer, M. M. and Gopal, S. 1996. Spectral pattern recognition and fuzzy ARTMAP: design features, system dynamics and real world simulations. In Proceedings of EUFIT'96, Fourth European Congress on Intelligent Technologies and Soft Computing. Aachen; Elite Foundation, 1664--1668.

[9]

Fischer, M. M., Gopal, S., Staufer, P. and Sternnocher, K. 1997. Evaluation of neural pattern classifiers for a remote sensing application. Geographical Systems. 4, 2, 221--235.

[10]

Fischer M. M. 2002. Learning in neural spatial interaction model: A statistical perspective. Journal of Geographical Systems. 4, 3, 287--299.

[11]

Fischer, M. M., Reismann, M. and Hlavackova-Schindler, K. 2003. Neural network modeling of constrained spatial interaction flows: Design, estimation and performance issues. Journal of Regional Science. 43, 1, 35--61.

[12]

Gopal, S. and Fischer, M. M. 1997. Fuzzy ARTMAP--a neural classifier for multispectral image classification. In Recent Developments in Spatial Analysis. Spatial Statistics, Behavioral Modeling and Computational Intelligence, M. M. Fischer and A. Getis, Ed. Springer Verlag, Berlin. 306--335.

[13]

Hansen, L. K. and Salomon, P. 1990. Neural network ensembles. IEEE Transactions on Pattern Analysis and Machine Intelligence. 12, 10, 993--1001.

Digital Library

[14]

Krogh, A. and Vedelsby, J. 1995. Neural network ensembles cross validation, and active learning. In Advances in Neural Information Processing Systems, G. Tesauro, D. S. Touretzky, and T. K. Leen, Ed. MIT Press, Cambridge, MA, 231--238.

[15]

Kuncheva, L. I. and Whitaker, C. J. 2003. Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Machine Learning. 51, 2, 181--207.

Digital Library

[16]

Li, X. and Yeh, A. G. 2002. Neural-network-based cellular automata for simulating multiple land use changes using GIS. International Journal of Geographical Information Science. 16, 4, 323--343.

[17]

Li, W., Raskin, R. and Goodchild, M. F. 2012. Semantic similarity measurement based on knowledge mining: an artificial neural net approach. International Journal of Geographical Information Science. 26, 8, 1415--1435.

Digital Library

[18]

Lin, Y-P., Chu, H-J., Wu, C-F. and Verburg, P. H. 2011. Predictive ability of logistic regression, auto-logistic regression and neural network models in empirical land use change modeling -- a case study. International Journal of Geographical Information Science. 25, 1, 65--87.

Digital Library

[19]

Liu, W., Seto, K., Wu, E. Y., Gopal, S. and Woodcock, C. E. 2004. ART-MMAP: a neural network approach to subpixel classification. IEEE Transactions on Geoscience and Remote Sensing. 42, 1976--1983.

[20]

Liu, W. and Seto, K. C. 2008. Using the ART-MMAP neural network to model and predict urban growth: a spatiotemporal data mining approach. Environment and Planning B: Planning and Design. 35, 2, 296--317.

[21]

Mozolin, M., Thill, J-C. and Usery, E. L. 2000. Trip Distribution Forecasting with Multilayer Perceptron Neural Networks: A Critical Evaluation. Transportation Research Part B. 34, 53--73.

[22]

Pijanowski, B. C., Brown, D. G., Shellito, B. and Manik, G. A. 2002. Using neural networks and GIS to forecast land use changes: a land transformation model. Computers, Environment and Urban Systems. 26, 553--575.

[23]

Pijanowski, B. C., Pithadia, S., Shellito, B. A. and Alexandridis, K. 2005. Calibrating a neural network-based urban change model for two metropolitan areas of the Upper Midwest of the United States. International Journal of Geographical Information Science. 19, 2, 197--215.

[24]

Rigol, J. P., Jarvis, C. H. and Stuart, N. 2001. Artificial neural networks as a tool for spatial interpolation. International Journal of Geographical Information Science. 15, 4, 323--343.

[25]

Rizzo, D. M. and Dougherty, D. E. 1994. Characterization of acquifer properties using artificial neural networks: neural kriging. Water Resources Research. 30, 483--497.

[26]

Rogers, L. L. and Dowla, F. U. 1994. Optimization of groundwater remediation using artificial neural networks with parallel solute transport modeling. Water Resources Research. 30, 2, 457--481.

[27]

Seto, K. and Liu, W. 2003. Comparing ARTMAP neural network with the maximum-likelihood classifier for detecting urban change. Photogrammetric Engineering&Remote Sensing. 69, 9, 981--990.

[28]

Smith, J. and Eli, R. N. 1995. Neural network models of rainfall-runoff process. Journal of Water Resources Planning and Management. 121, 499--509

[29]

Tang, W., Malanson, G. P., and Entwisle, B. 2009. Simulated village locations in Thailand: A multi-scale model including a neural network approach. Landscape Ecology. 24, 4, 557--575.

[30]

Wang, J. and Mountrakis, G. 2011. Developing a multi-network urbanization model: A case study of urban growth in Denver, Colorado. International Journal of Geographical Information Science. 25, 2, 229--253.

Digital Library

[31]

Wang, S. and Liu, Y. 2009. TeraGrid GIScience Gateway: Bridging cyberinfrastructure and GIScience. International Journal of Geographical Information Science. 23, 5, 631--656.

Digital Library

[32]

Wilkinson, B. and Allen, M., 2005. Parallel programming: techniques and applications using networked workstations and parallel computers. Pearson/Prentice Hall, Upper Saddle River, NJ.

[33]

Yan, J. and Thill, J-C. 2009. Visual data mining in spatial interaction analysis with self-organizing maps. Environment and Planning B: Planning and Design. 36, 466--486

[34]

http://www.epa.gov/mrlc/change.html

Cited By

Deng JDesjardins MDelmelle E(2019)An interactive platform for the analysis of landscape patterns: a cloud-based parallel approachAnnals of GIS10.1080/19475683.2019.161555025:2(99-111)Online publication date: 14-May-2019
https://doi.org/10.1080/19475683.2019.1615550
Clarke K(2019)Mathematical Foundations of Cellular Automata and Complexity TheoryThe Mathematics of Urban Morphology10.1007/978-3-030-12381-9_8(163-170)Online publication date: 24-Mar-2019
https://doi.org/10.1007/978-3-030-12381-9_8
Clarke K(2017)Land Use Change Modeling with SLEUTH: Improving Calibration with a Genetic AlgorithmGeomatic Approaches for Modeling Land Change Scenarios10.1007/978-3-319-60801-3_8(139-161)Online publication date: 28-Oct-2017
https://doi.org/10.1007/978-3-319-60801-3_8
Show More Cited By

Index Terms

Parallelization of ensemble neural networks for spatial land-use modeling
1. Computing methodologies
  1. Modeling and simulation

Recommendations

Implementation and evaluation of shared-memory communication and synchronization operations in MPICH2 using the Nemesis communication subsystem

This paper presents the implementation of MPICH2 over the Nemesis communication subsystem and the evaluation of its shared-memory performance. We describe design issues as well as some of the optimization techniques we employed. We conducted a ...
A multi-level parallelization concept for high-fidelity multi-block solvers
SC '97: Proceedings of the 1997 ACM/IEEE conference on Supercomputing

The integration of high-fidelity Computational Fluid Dynamics (CFD) analysis tools with the industrial design process benefits greatly from the robust implementations that are transportable across a wide range of computer architectures. In the present ...
A scalable pipelined architecture for real-time computation of MLP-BP neural networks

In this paper a novel architecture for implementing multi-layer perceptron (MLP) neural networks on field programmable gate arrays (FPGA) is presented. The architecture presents a new scalable design that allows variable degrees of parallelism in order ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

LBSN '12: Proceedings of the 5th ACM SIGSPATIAL International Workshop on Location-Based Social Networks

November 2012

67 pages

ISBN:9781450316989

DOI:10.1145/2442796

Program Chairs:
Gabriel Ghinita
University of Massachusetts at Boston
,
Jennifer Neville
Purdue University
,
Shawn Newsam
University of California at Merced

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSPATIAL: ACM Special Interest Group on Spatial Information

In-Cooperation

SIGGRAPH: ACM Special Interest Group on Computer Graphics and Interactive Techniques

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 November 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation

Conference

SIGSPATIAL'12

Sponsor:

SIGSPATIAL

SIGSPATIAL'12: SIGSPATIAL 2012 International Conference on Advances in Geographic Information Systems

November 6, 2012

California, Redondo Beach

Acceptance Rates

Overall Acceptance Rate 8 of 15 submissions, 53%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
164
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 16 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Deng JDesjardins MDelmelle E(2019)An interactive platform for the analysis of landscape patterns: a cloud-based parallel approachAnnals of GIS10.1080/19475683.2019.161555025:2(99-111)Online publication date: 14-May-2019
https://doi.org/10.1080/19475683.2019.1615550
Clarke K(2019)Mathematical Foundations of Cellular Automata and Complexity TheoryThe Mathematics of Urban Morphology10.1007/978-3-030-12381-9_8(163-170)Online publication date: 24-Mar-2019
https://doi.org/10.1007/978-3-030-12381-9_8
Clarke K(2017)Land Use Change Modeling with SLEUTH: Improving Calibration with a Genetic AlgorithmGeomatic Approaches for Modeling Land Change Scenarios10.1007/978-3-319-60801-3_8(139-161)Online publication date: 28-Oct-2017
https://doi.org/10.1007/978-3-319-60801-3_8
Gong ZThill JLiu W(2015)ART-P-MAP Neural Networks Modeling of Land-Use Change: Accounting for Spatial Heterogeneity and UncertaintyGeographical Analysis10.1111/gean.1207747:4(376-409)Online publication date: 8-May-2015
https://doi.org/10.1111/gean.12077
Ebenezer RManoj PJoseph HVisumathi J(2013)AI image recognizing agent through a scalable neural network2013 International Conference on Human Computer Interactions (ICHCI)10.1109/ICHCI-IEEE.2013.6887773(1-6)Online publication date: Aug-2013
https://doi.org/10.1109/ICHCI-IEEE.2013.6887773

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten