Semantic Segmentation with Enhanced Temporal Smoothness Using CRF in Aerial Videos

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

UAV videos are attracting widespread interest due to their cost effectiveness and wide applications in monitoring environmental changes, disaster management etc. Recently, computer vision algorithms are utilized to analyse UAV videos and act as decision support systems. To this end, the context of the scene plays a prominent role in improving the performance of the decision support systems. The context of the video scenes is generally realized by using a video semantic segmentation algorithm. The success of video semantic segmentation algorithms relies on temporal consistency for which estimation of temporal correspondence is a necessity. Optical flow based methods are popularly used in literature for establishing temporal correspondence which are expensive for video semantic segmentation. In this regard, a new Conditional Random Field frame work is presented in this paper for UAV video semantic segmentation. A new pairwise potential energy term is proposed which uses long range temporal information required for temporally consistent labels. Further, the proposed method selectively applies CRF inference which reduces the CRF computation and is independent of optical flow estimation. The proposed algorithm achieved an mIoU of 0.89 on ManipalUAVid dataset.

Original languageEnglish
Title of host publicationProceedings of the IEEE Madras Section International Conference 2021, MASCON 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781665404051
DOIs
Publication statusPublished - 2021
Event2021 IEEE Madras Section International Conference, MASCON 2021 - Chennai, India
Duration: 27-08-202128-08-2021

Publication series

NameProceedings of the IEEE Madras Section International Conference 2021, MASCON 2021

Conference

Conference2021 IEEE Madras Section International Conference, MASCON 2021
Country/TerritoryIndia
CityChennai
Period27-08-2128-08-21

All Science Journal Classification (ASJC) codes

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Semantic Segmentation with Enhanced Temporal Smoothness Using CRF in Aerial Videos'. Together they form a unique fingerprint.

Cite this