graviti logo产品公开数据集关于我们
登录
349
0
17
NLPCC2016
创建来自Hello Dataset / Robert
概要
代码
活动

Overview

Word is the fundamental unit in natural language understanding. However, Chinese sentences consists of the continuous Chinese characters without natural delimiters. Therefore, Chinese word segmentation has become the first mission of Chinese natural language processing, which identifies the sequence of words in a sentence and marks the boundaries between words.

Different with the popular used news dataset, we use more informal texts from Sina Weibo. The training and test data consist of micro-blogs from various topics, such as finance, sports, entertainment, and so on.

Data Collection

The data are collected from Sina Weibo. Both the training and test files are UTF-8 encoded. Besides the training data, we also provide the background data, from which the training and test data are drawn. The purpose of providing the background data is to find the more sophisticated features by the unsupervised way.

Citation

@InProceedings{qiu2016overview,
  Title                    = {Overview of the {NLPCC-ICCPOL} 2016 Shared Task: Chinese Word
Segmentation for Micro-blog Texts},
  Author                   = {Xipeng Qiu and Peng Qian and Zhan Shi},
  Booktitle                = {Proceedings of The Fifth
Conference on Natural Language Processing and Chinese Computing \& The Twenty Fourth
International Conference on Computer Processing of Oriental Languages},
  Year                     = {2016}
}

License

Custom

数据集信息
应用场景NLP
标注类型Text
LicenseCustom
更新时间2021-03-24 22:50:04
数据概要
数据格式Text
数据数量0
已标注数量0
文件大小39KB
版权归属方
NLP Group at Fudan University
标注方
未知
了解更多和支持
立即开始构建AI
免费开始联系我们