基于BERT-BiLSTM-CRF模型的煤矿人员违章领域命名实体研究

    Research on named entities for violations by coal mine personnel in the field based on BERT-BiLSTM-CRF model

    • 摘要: 为满足智慧矿山建设中煤矿人员违章领域智能语义搜索、智能化问答、可视化安全决策等实际需求,首先,设计并建立BERT-BiLSTM-CRF融合模型;其次,构建专用煤矿人员违章语料集,完成了实体界定与标注;最后,选取Word2vec-LSTM、BiLSTM-CRF、BERT-CRF、BERT-BiLSTM-CRF四种典型模型开展对照实验,以精确率、召回率、准确率与F1值为核心评价指标。实验结果表明,本文所提BERTBi-LSTM-CRF模型在各项指标上均优于对比模型,与传统Word2vec-LSTM模型相比优势尤为显著,证明BERT语义编码与BiLSTM时序建模的组合能够更精准地捕捉煤矿违章文本的专业语义与上下文结构。该研究可为煤矿人员违章领域知识图谱的自动化构建提供理论支持。

       

      Abstract: To realize the functions of intelligent semantic search, intelligent question answering, and visual decision-making in the field of coal mine personnel violations, this paper first establishes a named entity recognition model and a sequence annotation model for coal mine personnel violations based on BERT-BiLSTM-CRF. Then, a corpus for named entity recognition of coal mine personnel violations is constructed, and the corresponding named entity annotations are obtained. Finally, four models, namely Word2vec-LSTM, BiLSTM-CRF, BERT-CRF, and BERT-BiLSTM-CRF, are employed to conduct named entity recognition experiments. The precision, recall, accuracy, and F1-score of the four models are obtained and compared. A deep learning-based named entity recognition model (BERT-BiLSTM-CRF) for the coal mine violation domain is proposed and verified on the self-built coal mine violation corpus. The results demonstrate that, compared with the Word2vec-LSTM model, the BERT-BiLSTM-CRF model presents obvious advantages in terms of precision, accuracy, recall, and F1-score. The combination of BERT and BiLSTM contributes to a better recognition performance on named entities related to coal mine personnel violations. This study can provide theoretical support for the automatic construction of a knowledge graph in the field of coal mine personnel violations.

       

    /

    返回文章
    返回