61 lines
2.0 KiB
Markdown
61 lines
2.0 KiB
Markdown
---
|
||
title: Natural Language Processing
|
||
localeTitle: 自然语言处理
|
||
---
|
||
## 自然语言处理（NLP）
|
||
|
||
正如维基百科所说，“自然语言处理（NLP）是计算机科学，信息工程和人工智能的一个子领域，涉及计算机与人类（自然）语言之间的相互作用，特别是如何对计算机进行编程以处理和分析大量数据自然语言数据。“ 简单来说，这是一个由人类产生的自然语言被计算机感知的过程。
|
||
|
||
### NLP面临的挑战
|
||
|
||
#### 1.轻松或大部分解决
|
||
```
|
||
*Spam detection
|
||
*Part of Speech Tagging
|
||
*Named Entity Recognition
|
||
```
|
||
|
||
#### 2.中级或取得良好进展
|
||
```
|
||
*Sentiment analysis
|
||
*Coreference resolution
|
||
*Word sense disambiguation
|
||
*Parsing
|
||
*Machine Translation
|
||
*Information Translation
|
||
```
|
||
|
||
#### 3.很难还是还需要很多工作
|
||
```
|
||
*Text Summarization
|
||
*Machine dialog system
|
||
```
|
||
|
||
### 常用技巧
|
||
```
|
||
*Structure extraction
|
||
*Identify and mark sentence, phrase, and paragraph boundaries
|
||
*Language identification
|
||
*Tokenization
|
||
*Acronym normalization and tagging
|
||
*Lemmatization / Stemming
|
||
*Entity extraction
|
||
*Phrase extraction
|
||
```
|
||
|
||
### 常用的图书馆
|
||
```
|
||
*NLTK, the most widely-mentioned NLP library for Python.
|
||
*SpaCy, an industrial-strength NLP library built for performance.
|
||
*Gensim, a library for document similarity analysis.
|
||
*TextBlob, a user-friendly and intuitive NLTK interface.
|
||
*CoreNLP from stanford group
|
||
*PolyGlot, a natural language pipeline that supports massive multilingual applications.
|
||
```
|
||
|
||
#### 更多信息：
|
||
|
||
进一步阅读：
|
||
|
||
* 点击[此处](https://medium.com/@gon.esbuyo/get-started-with-nlp-part-i-d67ca26cc828)查看有关NLP介绍的文章。
|
||
* 单击[此处](https://en.wikipedia.org/wiki/Natural_language_processing)查看Wikipedia参考。 |