Master of Science (M.S.), University of Dayton, 2022, Electrical and Computer Engineering
Remote sensing has seen significant attention due to advances in technology and access to data. A current challenge is classifying land regions by their usage – residential, industrial, forest, etc. Scope is very important, too large of an area would lead to multiple classes being present in one scene, and too small of an area would not contain enough contextual information to accurately determine a scene. To further complicate matters, there are multiple similar objects all present in different classes, for example trees are found in residential, forest, and park classes.
Deep learning is a current technology that is successful with problems at this level of ambiguity. The most straight-forward approach to address this level of complexity is to use remote sensing images to classify land regions. However, deep learning using 2D images has its downsides, especially when analyzing aerial data, namely, it lacks 3-dimensional information such as depth. Similarly, there are also 3D deep learning architectures with different weaknesses, i.e., longer processing times and lack of intensity information.
As access to processing hardware and remote sensing data continues to increase, there is a pressing need to leverage the strengths of both modalities. This can be done in one of three ways: (1) a data-level fusion, where data modalities are fused together directly; (2) a feature-level fusion, where features are fused after data modalities are processed individually; or (3) a decision-level fusion, where predictions are made using each modality independently, until, ultimately, they are fused into one final decision. In this work, we utilize a feature-level fusion because our dataset (comprised of lidar and RGB scenes) have very different types of information; after analysis, we found that each modality was better suited to different sections of our data, which we could harness using a feature-level fusion.
Furthermore, to improve on these results, an accurate regist (open full item for complete abstract)
Committee: Vijayan Asari (Advisor); Andrew Stokes (Committee Member); Theus Aspiras (Committee Member); Eric Balster (Committee Member)
Subjects: Artificial Intelligence; Computer Engineering; Computer Science; Remote Sensing