TY - JOUR
T1 - Texture based prototypical network for few-shot semantic segmentation of forest cover
T2 - Generalizing for different geographical regions
AU - Puthumanaillam, Gokul
AU - Verma, Ujjwal
N1 - Funding Information:
Dr. Verma received his Ph.D. from Télecom ParisTech, University of Paris-Saclay, Paris, France, in Image Analysis and his M.S. (Research) from IMT Atlantique (France) in Signal and Image Processing. Dr. Verma is currently an Associate Professor and Head of the Department of Electronics and Communication Engineering at Manipal Institute of Technology, Bengaluru, India. His research interests include Computer Vision and Machine Learning; focusing on variational methods in image segmentation, deep learning methods for scene understanding, and semantic segmentation of aerial images. He is a recipient of the ”ISCA Young Scientist Award 2017–18” by the Indian Science Congress Association (ISCA), a professional body under the Department of Science and Technology, Government of India. Dr. Verma is the Co-Lead for the Working Group on Machine/Deep Learning for Image Analysis (WG-MIA) of the Image Analysis and Data Fusion Technical Committee (IADF TC) of the IEEE Geoscience and Remote Sensing Society. He is Guest Editor for Special Stream in IEEE Geoscience and Remote Sensing Letters and a reviewer for several journals (IEEE Transactions on Image Processing, IEEE Transactions on Geoscience and Remote Sensing, IEEE Geoscience and Remote Sensing Letters). He is also a Sectional Recorder for the ICT Section of the Indian Science Congress Association for 2020–22. Dr. Verma is a Life Member of the Indian Science Congress Association.
Publisher Copyright:
© 2023 Elsevier B.V.
PY - 2023/6/14
Y1 - 2023/6/14
N2 - Forest plays a vital role in reducing greenhouse gas emissions and mitigating climate change, besides maintaining the world's biodiversity. The existing satellite-based forest monitoring system utilizes supervised learning approaches limited to a particular region and depends on manually annotated data to identify forest. This work envisages forest identification as a few-shot semantic segmentation task to achieve generalization across different geographical regions. The proposed few-shot segmentation approach incorporates a texture attention module in the prototypical network to highlight the texture features of the forest. Indeed, the forest exhibits a characteristic texture different from other classes, such as road, water, etc. In this work, the proposed approach is trained for identifying tropical forests of South Asia and adapted to determine the temperate forest of Central Europe with the help of a few (one image for 1-shot) manually annotated support images of the temperate forest. An IoU of 0.62 for forest class (1-way 1-shot) was obtained using the proposed method, which is significantly higher (0.46 for PANet) than the existing few-shot semantic segmentation approach. Besides, the experimental results demonstrate that the inclusion of the texture attention module in the existing prototypical few-shot segmentation methods (PFENet and ASGNet) results in a more accurate forest identification. These results indicate that the proposed approach can generalize across geographical regions for forest identification, creating an opportunity to develop a global forest cover identification tool.
AB - Forest plays a vital role in reducing greenhouse gas emissions and mitigating climate change, besides maintaining the world's biodiversity. The existing satellite-based forest monitoring system utilizes supervised learning approaches limited to a particular region and depends on manually annotated data to identify forest. This work envisages forest identification as a few-shot semantic segmentation task to achieve generalization across different geographical regions. The proposed few-shot segmentation approach incorporates a texture attention module in the prototypical network to highlight the texture features of the forest. Indeed, the forest exhibits a characteristic texture different from other classes, such as road, water, etc. In this work, the proposed approach is trained for identifying tropical forests of South Asia and adapted to determine the temperate forest of Central Europe with the help of a few (one image for 1-shot) manually annotated support images of the temperate forest. An IoU of 0.62 for forest class (1-way 1-shot) was obtained using the proposed method, which is significantly higher (0.46 for PANet) than the existing few-shot semantic segmentation approach. Besides, the experimental results demonstrate that the inclusion of the texture attention module in the existing prototypical few-shot segmentation methods (PFENet and ASGNet) results in a more accurate forest identification. These results indicate that the proposed approach can generalize across geographical regions for forest identification, creating an opportunity to develop a global forest cover identification tool.
UR - http://www.scopus.com/inward/record.url?scp=85152597380&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85152597380&partnerID=8YFLogxK
U2 - 10.1016/j.neucom.2023.03.062
DO - 10.1016/j.neucom.2023.03.062
M3 - Article
AN - SCOPUS:85152597380
SN - 0925-2312
VL - 538
JO - Neurocomputing
JF - Neurocomputing
M1 - 126201
ER -