Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3347146.3359370acmconferencesArticle/Chapter ViewAbstractPublication PagesgisConference Proceedingsconference-collections
research-article

A General Framework for Human-Machine Digitization of Geographic Regions from Remotely Sensed Imagery

Published: 05 November 2019 Publication History

Abstract

Digitization of geographic regions, such as bodies of water, from remotely sensed imagery is a highly demanded yet arduous task. Though many automatic approaches for such digitization exist, they are typically geared towards specific regions of interest and sensing platforms, requiring complex workflow specification, parameter tuning, and/or manual training set creation. Moreover, the automatic digitization is performed all at once, making correction overwhelming when the result is not fully accurate. In this study, a general-purpose methodology that aims to greatly reduce the burden of geographic region digitization is proposed. This methodology specifies an interface for a human-machine team that exploits an incremental approach via online and active learning. With no prior training data or workflow definition, an effective pixel-level classifier is built in stride with a human user's adjustments to the machine's automatic vertex placement via novel interactive piecewise-linear contours. Several contour implementations specifically tailored towards geographic regions are presented along with results showing the effectiveness of each implementation. These contours work by spatially constraining the placement of vertices such that a machine implementation may effectively classify and train on pixel-level data for vertex placement after human verification or correction. An implementation of the methodology that uses a K nearest neighbors classifier and a simple instance-based estimation of uncertainty is presented along with several automatic vertex insertaion and placement strategies. Results show that the presented implementation succeeds in helping the user effectively annotate with no prior training data, yielding a vertex placement accuracy of 84% overall. Finally, conclusions and current research directions initiated from our findings are discussed.

References

[1]
David Acuna, Huan Ling, Amlan Kar, and Sanja Fidler. Efficient interactive annotation of segmentation datasets with polygon-rnn+ +. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 859--868, 2018.
[2]
Naomi S Altman. An introduction to kernel and nearest-neighbor nonparametric regression. The American Statistician, 46(3):175--185, 1992.
[3]
Favyen Bastani, Songtao He, Sofiane Abbar, Mohammad Alizadeh, Hari Balakrishnan, Sanjay Chawla, and Sam Madden. Machine-assisted map editing. In Proceedings of the 26th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pages 23--32. ACM, 2018.
[4]
Jon Louis Bentley. Multidimensional binary search trees used for associative searching. Communications of the ACM, 18(9):509--517, 1975.
[5]
Marcy Bidney and Nathan Piekielek. In defense of the map library. Journal of Map& Geography Libraries, 14(1):1--8, 2018.
[6]
JS Blundell and DW Opitz. Object recognition and feature extraction from imagery: The feature analyst® approach. International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences, 36(4):C42, 2006.
[7]
Russell A Brown. Building a balanced kd tree in o (kn log n) time. arXiv preprint arXiv:1410.5420, 2014.
[8]
Vicent Caselles, Francine Catté, Tomeu Coll, and Françoise Dibos. A geometric model for active contours in image processing. Numerische mathematik, 66(1):1--31, 1993.
[9]
Yi-Ying Chen, Wei Huang, Wei-Hong Wang, Jehn-Yih Juang, Jing-Shan Hong, Tomomichi Kato, and Sebastiaan Luyssaert. Reconstructing taiwan's land cover changes between 1904 and 2015 from historical maps and satellite images. Scientific reports, 9(1):3643, 2019.
[10]
Laurent D Cohen. On active contour models and balloons. CVGIP: Image understanding, 53(2):211--218, 1991.
[11]
Marius Cordts, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler, Rodrigo Benenson, Uwe Franke, Stefan Roth, and Bernt Schiele. The cityscapes dataset for semantic urban scene understanding. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 3213--3223, 2016.
[12]
Neil D D'Souza, Joseph M Reinhardt, and Eric A Hoffman. Asap: interactive quantification of 2d airway geometry. In Medical Imaging 1996: Physiology and Function from Multidimensional Images, volume 2709, pages 180--197. International Society for Optics and Photonics, 1996.
[13]
David Flanders, Mryka Hall-Beyer, and Joan Pereverzoff. Preliminary evaluation of ecognition object-based software for cut block delineation and feature extraction. Canadian Journal of Remote Sensing, 29(4):441--452, 2003.
[14]
Meghan Halabisky, L Monika Moskal, and Sonia A Hall. Object-based classification of semi-arid wetlands. Journal of Applied Remote Sensing, 5(1):053511, 2011.
[15]
Rob A Holman and J Stanley. The history and technical capabilities of argus. Coastal engineering, 54(6-7):477--491, 2007.
[16]
MS Horritt, DC Mason, DM Cobby, IJ Davenport, and PD Bates. Waterline mapping in flooded vegetation from airborne sar imagery. Remote Sensing of Environment, 85(3):271--281, 2003.
[17]
Mohammad D Hossain and Dongmei Chen. Segmentation for object-based image analysis (obia): A review of algorithms and challenges from remote sensing perspective. ISPRS Journal of Photogrammetry and Remote Sensing, 150:115--134, 2019.
[18]
Ajay J Joshi, Fatih Porikli, and Nikolaos Papanikolopoulos. Coverage optimized active learning for k-nn classifiers. In 2012 IEEE International Conference on Robotics and Automation, pages 5353--5358. IEEE, 2012.
[19]
Jin-Woo Kim, Zhong Lu, Hyongki Lee, CK Shum, Christopher M Swarzenski, Thomas W Doyle, and Sang-Ho Baek. Integrated analysis of palsar/radarsat-1 insar and envisat altimeter data for mapping of absolute water level changes in louisiana wetlands. Remote Sensing of Environment, 113(11):2356--2365, 2009.
[20]
Yansheng Li, Xin Huang, and Hui Liu. Unsupervised deep feature learning for urban village detection from high-resolution remote sensing images. Photogrammetric Engineering & Remote Sensing, 83(8):567--579, 2017.
[21]
Steven Lobregt and Max A Viergever. A discrete dynamic contour model. IEEE transactions on medical imaging, 14(1):12--24, 1995.
[22]
Derek R Magee and Roger D Boyle. Building shape models from image sequences using piecewise linear approximation. In BMVC, pages 1--11, 1998.
[23]
Mohammad Modava and Gholamreza Akbarizadeh. Coastline extraction from sar images using spatial fuzzy clustering and the active contour method. International journal of remote sensing, 38(2):355--370, 2017.
[24]
Cole Payne, Santosh Panda, and Anupma Prakash. Remote sensing of river erosion on the colville river, north slope alaska. Remote Sensing, 10(3):397, 2018.
[25]
Darius Phiri and Justin Morgenroth. Developments in landsat land cover classification methods: A review. Remote Sensing, 9(9):967, 2017.
[26]
Demetri Terzopoulos, John Platt, Alan Barr, and Kurt Fleischer. Elastically deformable models. ACM Siggraph Computer Graphics, 21(4):205--214, 1987.
[27]
Thomas C van Dijk and Alexander Wolff. Algorithmically-guided user interaction. In Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, page 11. ACM, 2017.

Cited By

View all
  • (2023)Closed-Loop Uncertainty: The Evaluation and Calibration of Uncertainty for Human–Machine Teams under Data DriftEntropy10.3390/e2510144325:10(1443)Online publication date: 12-Oct-2023
  • (2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
  • (2023)Optimization of a Human-Machine Team for Geographic Region DigitizationHuman Interface and the Management of Information10.1007/978-3-031-35129-7_32(444-460)Online publication date: 9-Jul-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGSPATIAL '19: Proceedings of the 27th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
November 2019
648 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 November 2019

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. geographic region digitization
  2. human-centered machine learning
  3. human-machine teams

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

SIGSPATIAL '19
Sponsor:

Acceptance Rates

SIGSPATIAL '19 Paper Acceptance Rate 34 of 161 submissions, 21%;
Overall Acceptance Rate 257 of 1,238 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)16
  • Downloads (Last 6 weeks)2
Reflects downloads up to 22 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Closed-Loop Uncertainty: The Evaluation and Calibration of Uncertainty for Human–Machine Teams under Data DriftEntropy10.3390/e2510144325:10(1443)Online publication date: 12-Oct-2023
  • (2023)What is Human-Centered about Human-Centered AI? A Map of the Research LandscapeProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580959(1-23)Online publication date: 19-Apr-2023
  • (2023)Optimization of a Human-Machine Team for Geographic Region DigitizationHuman Interface and the Management of Information10.1007/978-3-031-35129-7_32(444-460)Online publication date: 9-Jul-2023
  • (2022)The Coastal Imaging Research Network (CIRN)Remote Sensing10.3390/rs1403045314:3(453)Online publication date: 18-Jan-2022
  • (2021)Designing Interactive Machine Learning Systems for GIS ApplicationsEngineering Artificially Intelligent Systems10.1007/978-3-030-89385-9_9(147-158)Online publication date: 17-Nov-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media