基于多模态张量融合的焊接质量检测方法

    Welding Quality Detection Method Based on Multimodal Tensor Fusion

    • 摘要: 焊接是一个多因素影响的耦合过程,仅凭单一类型焊接数据检测焊接质量的方式是不充分的。为了满足工业实时性与嵌入式设备的要求,目前基于深度学习的焊接质量检测模型被设计得十分简单,没有发挥出深度学习方法的性能。针对以上问题,提出了基于多模态张量融合的焊接质量检测方法。提出焊接数据集精细划分方案,以解决焊接状态的类内差异;采用MobileNetV2瓶颈模块作为特征提取单元降低模型的参数量;通过各焊接模态子网分别提取不同模态的焊接特征,然后通过张量融合将焊接多模态特征耦合,并提出张量注意力模块,能抑制张量融合产生的大量冗余信息。将本模型在焊接多模态数据集上进行实验。结果表明,提出的多模态张量融合质量检测模型较单模态模型的准确率更高,张量融合、张量注意力模块均提高了模型的准确率。

       

      Abstract: Welding is a coupling process influenced by many factors, it is not enough to detect the welding quality only by single type of welding data.Moreover, the current welding quality detection model based on deep learning is designed to meet the requirements of industrial real-time and embedded equipment, which does not give full play to the performance of deep learning.Aiming at the above problems, a welding quality detection method based on multimodal tensor fusion was proposed.The welding data set fine division scheme was proposed to solve the difference of welding status classification within class; MobileNetV2 bottleneck module was used as feature extraction unit to reduce the parameters of the model.The welding features of different modes were extracted from each welding modal subnetwork, and then the welding multimodal features were coupled by tensor fusion, and a tensor attention module was proposed, which can suppress a large amount of redundant information generated by tensor fusion.The model was tested on a welding multimodal data set.The results show that the proposed multimodal tensor fusion quality detection model has higher accuracy than the single-modal model, and the tensor fusion and the tensor attention module increase the accuracy of the model.

       

    /

    返回文章
    返回