TY - JOUR
T1 - Per-point processing for detailed urban solar estimation with aerial laser scanning and distributed computing
AU - Vo, Anh Vu
AU - Laefer, Debra F.
AU - Smolic, Aljosa
AU - Zolanvari, S. M.Iman
N1 - Funding Information:
The Hadoop cluster testing was possible through sub-allocation “TG-IRI180015” from the Extreme Science and Engineering Discovery Environment (XSEDE) supported by National Science Foundation grant ACI-1548562 ( Towns et al., 2014 ), along with the superb technical support of the staff at Pittsburg Supercomputing Center during testing setup. Additional thanks goes to NYU’s outstanding IT High Performance Computing staff in support of local resources and services. The authors would also like to thank Dr. Andy Karpf for his advice on an earlier version of the solar radiation measurement experiment. Permission to use the street-level ground truth photos was granted by The Streets of Dublin photography. The authors are also grateful for the FME academic license from Safe Software, which has been extensively used for data format transformation in this work. The work by Zolanvari and Smolic was supported in part by a research grant from Science Foundation Ireland under the Grant Number 15/RP/2776 . The Dublin data were acquired with funding from the European Research Council [ ERC-2012-StG-307836 ] and additional funding from Science Foundation Ireland [ 12/ERC/I2534 ].
Publisher Copyright:
© 2019
PY - 2019/9
Y1 - 2019/9
N2 - This paper presents a complete data processing pipeline for improved urban solar potential estimation by applying solar irradiation estimation directly to individual aerial laser scanning (ALS) points in a distributed computing environment. Solar potential is often measured by solar irradiation – the amount of the Sun's radiant energy received at the Earth's surface over a period of time. To overcome previous limits of solar radiation estimations based on either two-and-a-half-dimensional raster models or overly simplistic, manually-generated, geometric models, an alternative approach is proposed using dense, urban aerial laser scanning data to enable the incorporation of the true, complex, and heterogeneous elements common in most urban areas. The approach introduces a direct, per-point analysis to fully exploit all details provided by the input point cloud data. To address the resulting computational demands required by the thousands of calculations needed per point for a full-year analysis, a distributed data processing strategy is employed that introduces an atypical data partition strategy. The scalability and performance of the approach are demonstrated on a 1.4-billion-point dataset covering more than 2 km2 of Dublin, Ireland. The reliability and realism of the simulation results are rigorously confirmed with (1) an aerial image collected concurrently with the laser scanning, (2) a terrestrial image acquired from an online source, and (3) a four-day, direct solar radiation collection experiment.
AB - This paper presents a complete data processing pipeline for improved urban solar potential estimation by applying solar irradiation estimation directly to individual aerial laser scanning (ALS) points in a distributed computing environment. Solar potential is often measured by solar irradiation – the amount of the Sun's radiant energy received at the Earth's surface over a period of time. To overcome previous limits of solar radiation estimations based on either two-and-a-half-dimensional raster models or overly simplistic, manually-generated, geometric models, an alternative approach is proposed using dense, urban aerial laser scanning data to enable the incorporation of the true, complex, and heterogeneous elements common in most urban areas. The approach introduces a direct, per-point analysis to fully exploit all details provided by the input point cloud data. To address the resulting computational demands required by the thousands of calculations needed per point for a full-year analysis, a distributed data processing strategy is employed that introduces an atypical data partition strategy. The scalability and performance of the approach are demonstrated on a 1.4-billion-point dataset covering more than 2 km2 of Dublin, Ireland. The reliability and realism of the simulation results are rigorously confirmed with (1) an aerial image collected concurrently with the laser scanning, (2) a terrestrial image acquired from an online source, and (3) a four-day, direct solar radiation collection experiment.
KW - Apache Spark
KW - Big data
KW - Distributed computing
KW - Laser scanning
KW - Point cloud
KW - Solar potential
UR - http://www.scopus.com/inward/record.url?scp=85068822163&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85068822163&partnerID=8YFLogxK
U2 - 10.1016/j.isprsjprs.2019.06.009
DO - 10.1016/j.isprsjprs.2019.06.009
M3 - Article
AN - SCOPUS:85068822163
SN - 0924-2716
VL - 155
SP - 119
EP - 135
JO - ISPRS Journal of Photogrammetry and Remote Sensing
JF - ISPRS Journal of Photogrammetry and Remote Sensing
ER -