DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer

Large oil-immersed transformers have metal-enclosed shells, making it difficult to visually inspect the internal insulation condition. Visual inspection of internal defects is carried out using a self-developed micro-robot in this work. Carbon trace is the main visual characteristic of internal insu...

Full description

Saved in:
Bibliographic Details
Main Authors: Liqing Liu, Hongxin Ji, Junji Feng, Xinghua Liu, Chi Zhang, Chun He
Format: Article
Language:English
Published: MDPI AG 2024-12-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/25/1/43
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841549031125286912
author Liqing Liu
Hongxin Ji
Junji Feng
Xinghua Liu
Chi Zhang
Chun He
author_facet Liqing Liu
Hongxin Ji
Junji Feng
Xinghua Liu
Chi Zhang
Chun He
author_sort Liqing Liu
collection DOAJ
description Large oil-immersed transformers have metal-enclosed shells, making it difficult to visually inspect the internal insulation condition. Visual inspection of internal defects is carried out using a self-developed micro-robot in this work. Carbon trace is the main visual characteristic of internal insulation defects. The characteristics of carbon traces, such as multiple sizes, diverse morphologies, and irregular edges, pose severe challenges for segmentation accuracy and inference speed. In this paper, a feasible real-time network (deformable-spatial-Canny segmentation network, DSC-SeNet) was designed for carbon trace segmentation. To improve inference speed, a lightweight unilateral feature extraction framework is constructed based on a shallow feature sharing mechanism, which is designed to provide feature input for both semantic path and spatial path. Meanwhile, the segmentation model is improved in two aspects for better segmentation accuracy. For one aspect, to better perceive diverse morphology and edge features of carbon trace, three measures, including deformable convolution (DFC), Canny edge operator, and spatial feature refinement module (SFRM), were adopted for feature perception, enhancement, and aggregation, respectively. For the other aspect, to improve the fusion of semantic features and spatial features, coordinate attention feature aggregation (CAFA) is designed to reduce feature aggregation loss. Experimental results showed that the proposed DSC-SeNet outperformed state-of-the-art models with a good balance between segmentation accuracy and inference speed. For a 512 × 512 input, it achieved 84.7% mIoU, which is 6.4 percentage points higher than that of the baseline short-term dense convolution network (STDC), with a speed of 94.3 FPS on an NVIDIA GTX 2050Ti. This study provides technical support for real-time segmentation of carbon traces and transformer insulation assessment.
format Article
id doaj-art-e5390f22d550400e9e996861a97e6d82
institution Kabale University
issn 1424-8220
language English
publishDate 2024-12-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj-art-e5390f22d550400e9e996861a97e6d822025-01-10T13:20:40ZengMDPI AGSensors1424-82202024-12-012514310.3390/s25010043DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed TransformerLiqing Liu0Hongxin Ji1Junji Feng2Xinghua Liu3Chi Zhang4Chun He5State Grid Tianjin Electric Power Research Institute, Tianjin 300180, ChinaSchool of Electrical Engineering, China University of Mining and Technology, Xuzhou 221116, ChinaState Grid Tianjin Electric Power Research Institute, Tianjin 300180, ChinaSchool of Electrical Engineering, China University of Mining and Technology, Xuzhou 221116, ChinaState Grid Tianjin Electric Power Research Institute, Tianjin 300180, ChinaState Grid Tianjin Electric Power Research Institute, Tianjin 300180, ChinaLarge oil-immersed transformers have metal-enclosed shells, making it difficult to visually inspect the internal insulation condition. Visual inspection of internal defects is carried out using a self-developed micro-robot in this work. Carbon trace is the main visual characteristic of internal insulation defects. The characteristics of carbon traces, such as multiple sizes, diverse morphologies, and irregular edges, pose severe challenges for segmentation accuracy and inference speed. In this paper, a feasible real-time network (deformable-spatial-Canny segmentation network, DSC-SeNet) was designed for carbon trace segmentation. To improve inference speed, a lightweight unilateral feature extraction framework is constructed based on a shallow feature sharing mechanism, which is designed to provide feature input for both semantic path and spatial path. Meanwhile, the segmentation model is improved in two aspects for better segmentation accuracy. For one aspect, to better perceive diverse morphology and edge features of carbon trace, three measures, including deformable convolution (DFC), Canny edge operator, and spatial feature refinement module (SFRM), were adopted for feature perception, enhancement, and aggregation, respectively. For the other aspect, to improve the fusion of semantic features and spatial features, coordinate attention feature aggregation (CAFA) is designed to reduce feature aggregation loss. Experimental results showed that the proposed DSC-SeNet outperformed state-of-the-art models with a good balance between segmentation accuracy and inference speed. For a 512 × 512 input, it achieved 84.7% mIoU, which is 6.4 percentage points higher than that of the baseline short-term dense convolution network (STDC), with a speed of 94.3 FPS on an NVIDIA GTX 2050Ti. This study provides technical support for real-time segmentation of carbon traces and transformer insulation assessment.https://www.mdpi.com/1424-8220/25/1/43oil-immersed transformerdischarge carbon tracesemantic segmentationdeformable convolutioncanny edge detectionreal-time processing
spellingShingle Liqing Liu
Hongxin Ji
Junji Feng
Xinghua Liu
Chi Zhang
Chun He
DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer
Sensors
oil-immersed transformer
discharge carbon trace
semantic segmentation
deformable convolution
canny edge detection
real-time processing
title DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer
title_full DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer
title_fullStr DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer
title_full_unstemmed DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer
title_short DSC-SeNet: Unilateral Network with Feature Enhancement and Aggregation for Real-Time Segmentation of Carbon Trace in the Oil-Immersed Transformer
title_sort dsc senet unilateral network with feature enhancement and aggregation for real time segmentation of carbon trace in the oil immersed transformer
topic oil-immersed transformer
discharge carbon trace
semantic segmentation
deformable convolution
canny edge detection
real-time processing
url https://www.mdpi.com/1424-8220/25/1/43
work_keys_str_mv AT liqingliu dscsenetunilateralnetworkwithfeatureenhancementandaggregationforrealtimesegmentationofcarbontraceintheoilimmersedtransformer
AT hongxinji dscsenetunilateralnetworkwithfeatureenhancementandaggregationforrealtimesegmentationofcarbontraceintheoilimmersedtransformer
AT junjifeng dscsenetunilateralnetworkwithfeatureenhancementandaggregationforrealtimesegmentationofcarbontraceintheoilimmersedtransformer
AT xinghualiu dscsenetunilateralnetworkwithfeatureenhancementandaggregationforrealtimesegmentationofcarbontraceintheoilimmersedtransformer
AT chizhang dscsenetunilateralnetworkwithfeatureenhancementandaggregationforrealtimesegmentationofcarbontraceintheoilimmersedtransformer
AT chunhe dscsenetunilateralnetworkwithfeatureenhancementandaggregationforrealtimesegmentationofcarbontraceintheoilimmersedtransformer