Ensemble of deep learning‐based multimodal remote sensing image classification model on unmanned aerial vehicle networks

Gyanendra Prasad Joshi, Fayadh Alenezi, Gopalakrishnan Thirumoorthy, Ashit Kumar Dutta, Jinsang You

Research output: Contribution to journalArticlepeer-review

32 Citations (Scopus)


Recently, unmanned aerial vehicles (UAVs) have been used in several applications of environmental modeling and land use inventories. At the same time, the computer vision‐based remote sensing image classification models are needed to monitor the modifications over time such as vegetation, inland water, bare soil or human infrastructure regardless of spectral, spatial, temporal, and radiometric resolutions. In this aspect, this paper proposes an ensemble of DL‐based multimodal land cover classification (EDL‐MMLCC) models using remote sensing images. The EDL‐MMLCC technique aims to classify remote sensing images into the different cloud, shades, and land cover classes. Primarily, median filtering‐based preprocessing and data augmentation techniques take place. In addition, an ensemble of DL models, namely VGG‐19, Capsule Network (CapsNet), and MobileNet, is used for feature extraction. In addition, the training process of the DL models can be enhanced by the use of hosted cuckoo optimization (HCO) algorithm. Finally, the salp swarm algorithm (SSA) with regularized extreme learning machine (RELM) classifier is applied for land cover classification. The design of the HCO algorithm for hyperparameter optimization and SSA for parameter tuning of the RELM model helps to increase the classification outcome to a maximum level considerably. The proposed EDL‐MMLCC technique is tested using an Amazon dataset from the Kaggle repository. The experimental results pointed out the promising performance of the EDL‐MMLCC technique over the recent state of art approaches.

Original languageEnglish
Article number2984
Issue number22
Publication statusPublished - 01-11-2021

All Science Journal Classification (ASJC) codes

  • General Mathematics


Dive into the research topics of 'Ensemble of deep learning‐based multimodal remote sensing image classification model on unmanned aerial vehicle networks'. Together they form a unique fingerprint.

Cite this