收藏切换
Noise Detection for Distant Supervised Named Entity Recognition
收藏切换
Jiacheng Wang1, Kai Wang1, Haofen Wang2, Wen Du3, Zhidong He3, Tong Ruan1, *, Jingping Liu1
Journal of Computer Research and Development | 2024, 61(4) : 916 - 928
Less
收藏切换
Journal of Computer Research and Development | 2024, 61(4): 916-928
• Artificial Intelligence •
Noise Detection for Distant Supervised Named Entity Recognition
Full
Jiacheng Wang1, Kai Wang1, Haofen Wang2, Wen Du3, Zhidong He3, Tong Ruan1, *, Jingping Liu1
Affiliations
  • 1School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237
  • 2College of Design and Innovation, Tongji University, Shanghai 200092
  • 3DS Information Technology Co., Ltd., Shanghai 200032
  • born in 2000. Master candidate. His main research interests include machine learning and information extraction

    born in 1997. Master candidate. His main research interests include machine learning and data mining

    born in 1982. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include knowledge graph, natural language processing, and data mining

    born in 1975. Professoriate senior engineer. His main research interests include big data and artificial intelligence

    born in 1989. PhD, senior engineer. His main research interests include complex networks and knowledge graph

    born in 1973. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include knowledge graph, data mining, and data quality assessment

    born in 1991. PhD, lecturer. His main research interests include knowledge graph and natural language processing

About Author:

born in 2000. Master candidate. His main research interests include machine learning and information extraction

born in 1997. Master candidate. His main research interests include machine learning and data mining

born in 1982. PhD, professor, PhD supervisor. Senior member of CCF. His main research interests include knowledge graph, natural language processing, and data mining

born in 1975. Professoriate senior engineer. His main research interests include big data and artificial intelligence

born in 1989. PhD, senior engineer. His main research interests include complex networks and knowledge graph

born in 1973. PhD, professor, PhD supervisor. Member of CCF. Her main research interests include knowledge graph, data mining, and data quality assessment

born in 1991. PhD, lecturer. His main research interests include knowledge graph and natural language processing

Published: 2024-04-01 doi: 10.7544/issn1000-1239.202220999
Outline
收藏切换

On distantly supervised named entity recognition (NER), there are many reinforcement learning based approaches, which exploit the powerful decision-making ability of reinforcement learning to detect noise from the automatically labeled data generated by distant supervision. However, the structures of the policy network models used are typically simple, which results in a weak ability to recognize noisy instances. Furthermore, correct instances are identified at sentence level, resulting in part of the useful information in the sentence being discarded. In this paper, we propose a new reinforcement learning based method for distantly supervised NER, named RLTL-DSNER, which can detect correct instances at token level from noisy data generated by distant supervision, proposing to reduce the negative impact of noisy instances on distantly supervised NER model. Specifically, we introduce a tag confidence function to identify correct instances accurately. In addition, we propose a novel pretraining strategy for the NER model. This strategy can provide accurate state representations and effective reward values for the initial training of the reinforcement learning model. The pre-training strategy can help guide it to update in the right direction. We conduct experiments on four datasets to verify the superiority of the RLTL-DSNER method, gaining 4.28% F1 improvement on NEWS dataset over state-of-the-art methods.

named entity recognition  /  distant supervision  /  deep reinforcement learning  /  noise detection  /  pre-training strategy
王嘉诚, 王凯, 王昊奋, 杜渂, 何之栋, 阮彤, 刘井平. 面向远程监督命名实体识别的噪声检测. 计算机研究与发展, 2024 , 61 (4) : 916 -928 . DOI: 10.7544/issn1000-1239.202220999
Jiacheng Wang, Kai Wang, Haofen Wang, Wen Du, Zhidong He, Tong Ruan, Jingping Liu. Noise Detection for Distant Supervised Named Entity Recognition[J]. Journal of Computer Research and Development, 2024 , 61 (4) : 916 -928 . DOI: 10.7544/issn1000-1239.202220999
Year 2024 volume 61 Issue 4
84
41
Cite this Article
BibTeX
Article Info
doi: 10.7544/issn1000-1239.202220999
  • Receive Date:2022-12-07
  • Online Date:2026-11-17
  • Published:2024-04-01
Article Data
Affiliations
History
  • Received:2022-12-07
  • Revised:2023-06-30
Affiliations
    1School of Information Science and Engineering, East China University of Science and Technology, Shanghai 200237
    2College of Design and Innovation, Tongji University, Shanghai 200092
    3DS Information Technology Co., Ltd., Shanghai 200032
References
Share
https://castjournals.cast.org.cn/joweb/jsjyjyfz/EN/10.7544/issn1000-1239.202220999
Share to
QR

Scan QR to access full text

Cite this article
BibTeX
Citations
表12种不同金属材料的力学参数
科
Family
属数
Number of
genus
种数
Number of
species
占总种数比例
Percentage of
total species (%)
属
Genus
种数
Number of
species
占总种数比例
Percentage of total
species (%)
鹅膏菌科Amanitaceae 2 11 5.26 鹅膏菌属 Amanita 10 4.78
小菇科 Mycenaceae 2 12 5.74 丝盖伞属 Inocybe 5 2.39
多孔菌科 Polyporaceae 8 14 6.70 蜡蘑属 Laccaria 5 2.39
红菇科 Russulaceae 3 23 11.00 小皮伞属 Marasmius 6 2.87
小菇属 Mycena 11 5.26
光柄菇属 Pluteus 5 2.39
红菇属 Russula 17 8.13
栓菌属 Trametes 5 2.39
关闭全屏
  • BibTeX
  • EndNote
  • RefWorks
  • TxT