Text Analytics

Text Analytics is the process of converting unstructured text data into meaningful data for analysis, to measure customer opinions, product reviews, feedback, to provide search facility, sentimental analysis and entity modeling to support fact based decision making. Text analysis uses many linguistic, statistical, and machine learning techniques.
http://www.predictiveanalyticstoday.com/text-analytics/

Text Analytics Process Flow

Training and serving NLP models using Spark MLlib

https://www.oreilly.com/ideas/training-and-serving-nlp-models-using-spark-mllib

a basic feature pipeline

a high-level diagram of the main tools

Artificial intelligence and cognitive computing: the what, why and where

http://www.i-scoop.eu/artificial-intelligence-cognitive-computing/

• 1 The historical issue with artificial intelligence – is cognitive better?
• 2 Artificial intelligence in context: how it interacts with other transformational technologies
  • 2.1 The interconnectedness of 3rd platform technologies and artificial intelligence
  • 2.2 Cognitive systems: an innovation accelerator
• 3 Cognitive computing and AI powering digital evolutions: from enabling IoT and making sense of unstructured big data to next stage security
  • 3.1 AI and the Internet of Things
  • 3.2 The future of security is intelligent too
  • 3.3 Cognitive and the age of data and analytics
  • 3.4 AI/cognitive and unstructured data/content
• 4 The value of artificial intelligence – conclusion and next steps
• 5 The waves of artificial intelligence: from concept and research to business reality and ethical discussion
• 6 Intelligence and artificial intelligence – what’s in a name?

Artificial intelligence is many things

image: Narrative Science via InformationWeek

NLP survy

Gate-vs-UIMA-vs-OpenNLP
https://app.assembla.com/spaces/extraction-of-cost-data/wiki/Gate-vs-UIMA-vs-OpenNLP

NLP相關資源
https://handong1587.github.io/deep_learning/2015/10/09/nlp.html

NLP 笔记--徐阿衡

http://www.shuang0420.com/categories/NLP/

NLP 笔记 - Sentiment Analysis
06-01
论文笔记 - Learning to Extract Conditional Knowledge for Question Answering using Dialogue
05-24
NLP 笔记 - Text Summarization
05-10
NLP 笔记 - Machine Translation
05-01
NLP笔记 - NLU之意图分类
04-27
NLP 笔记 - Compositional Semantics
04-13
NLP笔记 - Relation Extraction


Deep Learning for NLP course
oxford: https://github.com/oxford-cs-deepnlp-2017/lectures

The course provides a deep excursion into cutting-edge research in deep learning applied to NLP. The final project will involve training a complex recurrent neural network and applying it to a large scale NLP problem.
http://cs224d.stanford.edu/syllabus.html
http://cs224d.stanford.edu/

How to Generate a Good Word Embedding? (source code)
Folder embedding contains all embedding algorithms we used in this paper.

Folder evaluation contains all evaluation tasks in the paper.
https://github.com/licstar/compare

Blog文章

• Deep Learning in NLP
• 维基百科简体中文语料的获取
• 《How to Generate a Good Word Embedding?》导读

http://licstar.net/archives/category/%E8%87%AA%E7%84%B6%E8%AF%AD%E8%A8%80%E5%A4%84%E7%90%86

Using NLP, Machine Learning & Deep Learning Algorithms to Extract Meaning from Text
https://www.infoq.com/presentations/nlp-machine-learning-meaning-text

NLP频道
https://liweinlp.com/?p=29
http://blog.sciencenet.cn/blog-362400-902391.html

立委博士，自然語言處理（NLP）資深架構師，Pinciple Scientist, jd-valley, Netbase前首席科學家，期間指揮團隊研發了18種語言的理解和應用系統。特別是漢語和英語，具有世界一流的分析（parsing）精度，並且做到魯棒、線速，scale up to大數據，語義落地到數據挖掘和問答產品。Cymfony前研發副總，曾榮獲第一屆問答系統第一名（TREC-8 QA Track），並贏得17個美國國防部的信息抽取項目（PI for 17 SBIRs）。立委NLP工作的應用方向包括大數據輿情挖掘、客戶情報、信息抽取、知識圖譜、問答系統、智能助理、語義搜索等等。

Introduction to NLP Architecture
https://www.linkedin.com/pulse/introduction-nlp-architecture-wei-li
   

Introduction to Natural Language Processing (NLP) 2016
The field of study that focuses on the interactions between human language and computers is called Natural Language Processing, or NLP for short. 
http://blog.algorithmia.com/introduction-natural-language-processing-nlp/

FinTech Industry

31 Hottest FinTech Startups Defining the New York FinTech Industry
7 Most Important Things You Should Know About the Global FinTech Industry
How Banks Are Joining Hands With FinTech Firms to Serve Customers
Industry report - FinTech patents: where finance meets technology

31 Hottest FinTech Startups Defining the New York FinTech Industry
https://letstalkpayments.com/31-hottest-fintech-startups-defining-the-new-york-fintech-industry/

自然語言處理常用工具及選擇匯總

NLP Tools (http://www.coli.uni-saarland.de/~csporled/page.php?id=tools)
General

• NLTK: the Natural Language Processing Toolkit
• WEKA: easy to use toolkit to play around with different machine learning algorithms
• CoNLL shared task data: annotated data sets for a number of NLP tasks in a number of languages

Web Crawler
Information Retrieval
Language Identification
Pre-processing (Sentence Splitters, Tokenisers, POS Taggers, Lemmatisers, Morphological Analysers)
Syntactic Analysis, Parsers
Text Mining / Information Extraction
Semantic Analysis
Webpages with further information on NLP resources

Dive Into NLTK (http://textminingonline.com/dive-into-nltk-part-i-getting-started-with-nltk)

NLTK is the most famous Python Natural Language Processing Toolkit, here I will give a detail tutorial about NLTK.

• Part I: Getting Started with NLTK (this article)
• Part II: Sentence Tokenize and Word Tokenize
• Part III: Part-Of-Speech Tagging and POS Tagger
• Part IV: Stemming and Lemmatization
• Part V: Using Stanford Text Analysis Tools in Python
• Part VI: Add Stanford Word Segmenter Interface for Python NLTK
• Part VII: A Preliminary Study on Text Classification
• Part VIII: Using External Maximum Entropy Modeling Libraries for Text Classification
• Part IX: From Text Classification to Sentiment Analysis
• Part X: Play With Word2Vec Models based on NLTK Corpus

Biomedical natural language processing
包含各種語言模型的來源和工具

• Word vectors: vector representations of words
• N-gram counts: counts of word sequence occurrences
• Language models: models of word sequence probabilities

http://bio.nlplab.org/


Awesome Community-Curated NLP List
https://github.com/alvations/awesome-community-curated-nlp

用于自然语言处理的Java或Python
https://gxnotes.com/article/51044.html

A curated list of resources for NLP (Natural Language Processing) for Chinese 中文自然语言处理相关资料
https://github.com/crownpku/awesome-chinese-nlp

1. Chinese NLP Toolkits 中文NLP工具

• Toolkits 综合NLP工具包
• 常用的英文或支持多语言的NLP工具包
• Chinese Word Segment 中文分词
• Information Extraction 信息提取
• QA & Chatbot 问答和聊天机器人

2. Corpus 中文语料
3. Organizations 相关中文NLP组织和会议
4. Learning Materials 学习资料


Natural Language Processing Tools (http://www.phontron.com/nlptools.php)

• Dependency Parser(依存語法分析器)
• Finite State Models（有限狀態模型）
• 一般NLP庫（通用NLP工具）
• Language Modeling（語言模型）
• Machine Learning（機器學習）
• Machine Translation Alignment（機器翻譯對齊）
• Machine Translation Decoder（機器翻譯解碼）
• Machine Translation Evaluation（機器翻譯評測）
• Morphological Analysis（形態分析）
• Phrase Structure Parsing（短語結構語法分析器）
• Pronunciation Estimation（發音估計？）
• Speech Recognition（語音識別）

Open-source NLP software

http://entopix.com/so-you-need-to-understand-language-data-open-source-nlp-software-can-help.html

Python NLTK Tools List for Natural Language Processing (NLP)
http://www.datasciencecentral.com/profiles/blogs/python-nlp-tools

Some of the most popular NLP/NLU platforms

• IBM's Watson Conversation Service
• Microsoft LUIS
• Google Natural Language API
• Wit.ai
• Api.ai
• Alexa Skills Kit
• Recast.AI
• Pat

http://www.cio.com/article/3107609/internet-of-things/these-platforms-will-make-your-bots-language-intelligent.html

Natural Language Processing

https://www.celi.it/en/technology/natural-language-processing/

Steps in NLP
https://www.tutorialspoint.com/artificial_intelligence/artificial_intelligence_natural_language_processing.htm

other: https://www.tekkkies.com/soft-computing-techniques-and-applications/

Machine Learning vs. Natural Language Processing
https://www.lexalytics.com/lexablog/2012/machine-learning-vs-natural-language-processing-part-1

1 Building Natural Language Generation Systems Robert Dale and Ehud Reiter. - ppt download

1 Building Natural Language Generation Systems Robert Dale and Ehud Reiter. - ppt download

Text Analytics and Natural Language Processing in the Era of Big Data

What is Text Analytics Good For?
Text analytics spans across virtually all verticals. We frequently come across text analytics use cases in finance, insurance, media, and retail industries, but even oil and gas companies can derive value from text analytics. The table on the right outlines verticals and their most frequent text analytics use-cases. Next, we will describe some of these verticals and use-cases in more detail.

https://blog.pivotal.io/data-science-pivotal/features/text-analytics-and-natural-language-processing-in-the-era-of-big-data

3 Key Capabilities Necessary

What is Natural Language Generation?

http://resources.narrativescience.com/h/i/124944227-what-is-natural-language-generation