Feedback-assisted automatic target and clutter discrimination using a Bayesian convolutional neural network for improved explainability in SAR applications

dc.contributor.authorBlomerus, Nicholas Daniel
dc.contributor.authorCilliers, Jacques
dc.contributor.authorNel, Willie
dc.contributor.authorBlasch, Erik
dc.contributor.authorDe Villiers, Johan Pieter
dc.contributor.emailpieter.devilliers@up.ac.zaen_US
dc.date.accessioned2023-07-13T10:53:13Z
dc.date.available2023-07-13T10:53:13Z
dc.date.issued2022-12
dc.descriptionDATA AVAILABILITY STATEMENT : The NATO-SET 250 dataset is not publicly available; however, the MSTAR dataset can be found at the following url: https://www.sdms.afrl.af.mil/index.php?collection=mstar (accessed on 5 January 2022).en_US
dc.description.abstractIn this paper, a feedback training approach for efficiently dealing with distribution shift in synthetic aperture radar target detection using a Bayesian convolutional neural network is proposed. After training the network on in-distribution data, it is tested on out-of-distribution data. Samples that are classified incorrectly with high certainty are fed back for a second round of training. This results in the reduction of false positives in the out-of-distribution dataset. False positive target detections challenge human attention, sensor resource management, and mission engagement. In these types of applications, a reduction in false positives thus often takes precedence over target detection and classification performance. The classifier is used to discriminate the targets from the clutter and to classify the target type in a single step as opposed to the traditional approach of having a sequential chain of functions for target detection and localisation before the machine learning algorithm. Another aspect of automated synthetic aperture radar detection and recognition problems addressed here is the fact that human users of the output of traditional classification systems are presented with decisions made by “black box” algorithms. Consequently, the decisions are not explainable, even to an expert in the sensor domain. This paper makes use of the concept of explainable artificial intelligence via uncertainty heat maps that are overlaid onto synthetic aperture radar imagery to furnish the user with additional information about classification decisions. These uncertainty heat maps facilitate trust in the machine learning algorithm and are derived from the uncertainty estimates of the classifications from the Bayesian convolutional neural network. These uncertainty overlays further enhance the users’ ability to interpret the reasons why certain decisions were made by the algorithm. Further, it is demonstrated that feeding back the high-certainty, incorrectly classified out-of-distribution data results in an average improvement in detection performance and a reduction in uncertainty for all synthetic aperture radar images processed. Compared to the baseline method, an improvement in recall of 11.8%, and a reduction in the false positive rate of 7.08% were demonstrated using the Feedback-assisted Bayesian Convolutional Neural Network or FaBCNN.en_US
dc.description.departmentElectrical, Electronic and Computer Engineeringen_US
dc.description.librarianhj2023en_US
dc.description.sponsorshipThe Radar and Electronic Warfare department at the CSIR.en_US
dc.description.urihttp://www.mdpi.com/journal/remotesensingen_US
dc.identifier.citationBlomerus, N.; Cilliers, J.; Nel, W.; Blasch, E.; de Villiers, P. Feedback-Assisted Automatic Target and Clutter Discrimination Using a Bayesian Convolutional Neural Network for Improved Explainability in SAR Applications. Remote Sensing 2022, 14, 6096. https://doi.org/10.3390/rs14236096.en_US
dc.identifier.issn2072-4292 (online)
dc.identifier.other10.3390/rs14236096
dc.identifier.urihttp://hdl.handle.net/2263/91411
dc.language.isoenen_US
dc.publisherMDPIen_US
dc.rights© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.en_US
dc.subjectFeedback-assisted Bayesian convolutional neural network (FaBCNN)en_US
dc.subjectBayesian convolutional neural network (BCNN)en_US
dc.subjectExplainable artificial intelligence (XAI)en_US
dc.subjectDeep machine learningen_US
dc.subjectEpistemic uncertaintyen_US
dc.subjectUncertainty estimationen_US
dc.subjectAutomatic target recognition (ATR)en_US
dc.subjectSynthetic aperture radar (SAR)en_US
dc.subjectSDG-09: Industry, innovation and infrastructureen_US
dc.titleFeedback-assisted automatic target and clutter discrimination using a Bayesian convolutional neural network for improved explainability in SAR applicationsen_US
dc.typeArticleen_US

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Blomerus_FeedBackAssisted_2022.pdf
Size:
13.19 MB
Format:
Adobe Portable Document Format
Description:
Article

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: