信息网络安全

信息网络安全 ›› 2016, Vol. 16 ›› Issue (5): 64-70.doi: 10.3969/j.issn.1671-1122.2016.05.010

• 技术研究 • 上一篇    下一篇

基于句义成分的短文本表示方法研究

尚海, 罗森林, 韩磊, 张笈()   

  1. 北京理工大学信息系统及安全对抗实验中心,北京 100081
  • 收稿日期:2016-03-14 出版日期:2016-05-20 发布日期:2020-05-13
  • 作者简介:

    尚海（1990—）,男,江苏,硕士研究生,主要研究方向为文本安全;罗森林（1968—）,男,河北,教授,博士,主要研究方向为信息安全、数据挖掘、文本安全;韩磊（1985—）,男,河北,博士研究生,主要研究方向为自然语言处理;张笈（1968—）,男,陕西,副教授,博士,主要研究方向为信息安全。

  • 基金资助:
    国家242信息安全计划[2005C48]

Research on Short Text Representation Based on Sentential Semantic Components

Hai SHANG, Senlin LUO, Lei HAN, Ji ZHANG()   

  1. Information System and Security & Countermeasures Experimental Center, Beijing Institute of Technology, Beijing 100081, China
  • Received:2016-03-14 Online:2016-05-20 Published:2020-05-13

RichHTML

1

PDF (PC)

102

摘要：

随着移动互联网和信息技术的迅速发展,评论、微博等短文本数量呈现爆炸式增长。短文本数据少,文本特征稀疏,亟需有效的短文本表示方法来提升针对短文本的文本分类、文本聚类、热点发现、舆情分析等应用的效果。针对短文本特征稀疏问题,文章提出融合句义成分的短文本表示方法。该方法考虑短文本的语义信息,在保证特征空间维度不变的同时,结合句义成分和主题模型构建语义相关词语,再利用句义结构模型的话题和述题构建主题选择判定规则,选择语义相关词语扩充到短文本中,减少短文本表示向量中的0值特征。文章基于Sogou文本分类语料库,选择3个类别数据进行文本分类实验,并利用5折交叉方法选定模型参数。结果表明,文中方法对短文本分类的精确度达到0.7958,结果优于对比的短文本表示方法。因此,利用语义相关词语丰富短文本的语义信息,能够有效缓解短文本特征稀疏问题。文中短文本表示方法可以有效提高短文本分类等具体应用效果。

关键词: 文本表示, 句义成分, 主题模型, 文本分类

Abstract:

With the development of mobile Internet and information technology, short text data such as commentary, microblog, has explosive growth. The sparseness of short text requires an effective algorithm of short text representation to improve the results of text clustering and classification, hot event detection and public opinion analysis, etc. This paper proposes an algorithm of short text representation based on sentential semantic components. Without changing the dimension of feature space, the method utilizes the sentential semantic components and topic model to obtain the semantic correlated words, and expands the short text with those words according to the topic selection rules. It reduces the zero-value dimension of in the text representation feature vectors. This paper implements short text classification experiments based on the Sogou corpus. The results show that the accuracy of short text classification reaches 0.7958, which is better than other methods. In summary, the proposed short text representation method, expanding short text with the semantic correlated words, can mitigate the sparseness problem effectively and improve the performance of short text classification.

Key words: text representation, sentential semantic components, topic model, text classification

中图分类号: