Journal Article10.1016/J.PARCO.2003.04.001
Distributed frameworks and parallel algorithms for processing large-scale geographic data
Ken A. Hawick,Paul Coddington,H. A. James +2 more
- 01 Oct 2003
- Vol. 29, Iss: 10, pp 1297-1333
TL;DR: A historical review of work in this area over the last decade leads us to believe parallel computing will continue to play an important role in GIS and speculate on algorithmic and systems issues for the future.
read more
Abstract: The number of applications that require parallel and high-performance computing techniques has diminished in recent years due to to the continuing increase in power of PC, workstation and mono-processor systems. However, Geographic information systems (GIS) still provide a resource-hungry application domain that can make good use of parallel techniques. We describe our work with geographical systems for environmental and defence applications and some of the algorithms and techniques we have deployed to deliver high-performance prototype systems that can deal with large data sets. GIS applications are often run operationally as part of decision support systems with both a human interactive component as well as large scale batch or server-based components. Parallel computing technology embedded in a distributed system therefore provides an ideal and practical solution for multi-site organisations and especially government agencies who need to extract the best value from bulk geographic data.We describe the distributed computing approaches we have used to integrate bulk data and metadata sources and the grid computing techniques we have used to embed parallel services in an operational infrastructure. We describe some of the parallel techniques we have used: for data assimilation; for image and map data processing; for data cluster analysis; and for data mining. We also discuss issues related to emerging standards for data exchange and design issues for integrating together data in a distributed ownership system. We include a historical review of our work in this area over the last decade which leads us to believe parallel computing will continue to play an important role in GIS. We speculate on algorithmic and systems issues for the future.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
State of the Art: Coordinated & Multiple Views in Exploratory Visualization
Jonathan C. Roberts
- 02 Jul 2007
TL;DR: This paper provides the "state of the art' of CMV, it describes areas that should be developed further and looks at what the future may hold for coordinated and multiple views.
Parallel computing works
TL;DR: Parallel Computing Works! by G.C.C Fox, R.D. Williams, and P. c. Messina is a guide to parallel computing in the 21st Century.
Towards an integrated GIS-based coastal forecast workflow
Gabrielle Allen,Philip Bogden,Gerry Creager,Chirag Dekate,Carola Jesch,Hartmut Kaiser,Jon McLaren,William Perrie,Gregory W. Stone,Xiongping Zhang +9 more
TL;DR: The use of GIS within the SCOOP program for the 2005 hurricane season is described, along with details of the data-driven distributed dataflow and workflow, which results in geospatial products.
91
Geographical information system parallelization for spatial big data processing: a review
TL;DR: The general evolution of the GIS architecture is presented which includes main two parallel GIS architectures based on high performance computing cluster and Hadoop cluster and the current spatial data partition strategies, key methods to realize Parallel GIS in the view of data decomposition and progress of the special parallel Gis algorithms are summarized.
81
High-performance computing tools for the integrated assessment and modelling of social-ecological systems
TL;DR: The potential of a range of high-performance computing hardware and software tools to overcome computational barriers and transform the ability to address global challenges through integrated assessment and modelling is evaluated.
64
References
The Elements of Statistical Learning: Data Mining, Inference, and Prediction
TL;DR: The Elements of Statistical Learning: Data Mining, Inference, and Prediction as discussed by the authors is a popular book for data mining and machine learning, focusing on data mining, inference, and prediction.
15.4K
The GRID: Blueprint for a New Computing Infrastructure
TL;DR: The main purpose is to update the designers and users of parallel numerical algorithms with the latest research in the field and present the novel ideas, results and work in progress and advancing state-of-the-art techniques in the area of parallel and distributed computing for numerical and computational optimization problems in scientific and engineering application.
5K
Kriging: a method of interpolation for geographical information systems
M. A. Oliver,Richard Webster +1 more
TL;DR: Kriging is the method of interpolation deriving from regionalized variable theory that depends on expressing spatial variation of the property in terms of the variogram, and it minimizes the prediction errors which are themselves estimated.
2K
•Book
Parallel Computing Works
Roy Williams,Guiseppe C. Messina,Geoffrey C. Fox,Paul Messina +3 more
- 15 May 1994
TL;DR: This chapter discusses synchronous applications, the Zipcode Message-Passing System, and the DIME Programming Environment, which simplifies the development of asynchronous applications.
292
Parallel computing works
TL;DR: Parallel Computing Works! by G.C.C Fox, R.D. Williams, and P. c. Messina is a guide to parallel computing in the 21st Century.