河北水利电力学院学报

河北水利电力学院学报 ›› 2020, Vol. 30 ›› Issue (4): 10-18.DOI: 10.16046/j.cnki.issn2096-5680.2020.04.002

• 技术理论与应用 • 上一篇    下一篇

基于多光谱多尺度类激活映射的弱监督缺陷分割

陈海永１，黄　迪１，庞　悦２，杜太行３   

  1. 1:河北工业大学人工智能与数据科学学院
    2:中国电子科技集团公司第十八研究所
    3:河北省工业机械手控制与可靠性技术创新中心
  • 收稿日期:2020-08-27 出版日期:2020-12-31 发布日期:2021-01-30
  • 作者简介:陈海永(1980-)，男，博士，博士生导师，河北工业大学人工智能与数据科学学院教授，主要从事机器视觉与智能制造方面研究，E-mail:haiyong.chen@hebut.edu.cn
  • 基金资助:
     国家自然科学基金项目(61873315)

Weakly Supervised Defect Segmentation Based on Multi-spectral and Multi-scale Class Activation Maps

CHEN Hai-yong1,HUANG Di 1,PANG Yue2,DU Tai-hang3   

  1. 1.College of Artificial Intelligence and Data Science,Hebei University of Technology,300131,Tianjin,China;
    2.The 18th Research Institute of China Electronics Technology Corporation,300385,Tianjin,China;
    3.Hebei Province Technology Innovation Center of Industrial Manipulator Control and Reliability,061001,Cangzhou,Hebei,China

  • Received:2020-08-27 Online:2020-12-31 Published:2021-01-30

PDF

摘要： 光伏电池外观缺陷种类多、大小和形状差异较大,标注成本高,这为缺陷分割任务带来困难。为了提高光伏电池外观缺陷的分割性能,文中提出一种基于多光谱多尺度类激活映射的弱监督深度学习网络模型(MMCAM-Net)。首先,提出了多光谱深度学习网络结构,实现了光谱信息的多通道融合,增强了MMCAM-Net网络的精细化特征提取能力;其次,设计了多尺度网络结构,实现缺陷信息的高级特征和低级特征融合,增强了MMCAM-Net的缺陷全局与局部信息提取能力;最后,使用图像级标签的数据集来训练MMCAM-Net,实现了光伏电池表面缺陷的弱监督分割。实验结果表明,该网络模型的缺陷分割平均IoU提高了15%-20%,取得了较好的效果。

关键词:  , 类激活映射, 多尺度, 多光谱, 缺陷分割, 光伏电池

Abstract: There are many kinds of defects in the surface of solar cells,with large differences in size and shape,and high labeling cost,which brings difficulties to the task of defect segmentation.In order to improve the segmentation performance of solar cell surface defects,this paper proposes a novel weakly supervised deep learning network with multi-spectral multi-scale class activation mapping,called MMCAMNet.Firstly,a multi-spectral deep learning network structure is proposed,which realizes the multi-channel fusion of spectral information,and enhances the feature extraction capability of the MMCAM-Net.Secondly,a multi-scale network structure is designed to achieve high-level and low-level defect feature fusion and improve MMCAM-Net＇s defect global and local information extraction capabilities.Finally,the image-level label data set is used to train MMCAM-Net,which realizes weakly supervised segmentation of solar cell surface defects.Experimental results show that the IoU of the network model has increased by 15%-20%,and satisfactory results are gained.

Key words: class activation mapping, multi-scale, multispectral, defect detection, solar cells

中图分类号: