Most popular nlp repositories and open source projects

Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.

argos-translate

Open-source offline translation library written in Python

150   2051   2051  

pytextrank

Python implementation of TextRank algorithms ("textgraphs") for phrase...

336   2015   2015  

daily-interview

Datawhale成员整理的面经，内容包括机器学习，CV，NLP，推荐，开发等，欢迎...

387   2006   2006  

Chinese-CLIP

Chinese version of CLIP which achieves Chinese cross-modal retrieval a...

241   1999   1999  

Getting-Things-Done-with-Pytorch

Jupyter Notebook tutorials on solving real-world problems with Machine...

574   1993   1993  

The-NLP-Pandect

A comprehensive reference for all topics related to Natural Language P...

276   1981   1981  

HarvestText

文本挖掘和预处理工具（文本清洗、新词发现、情感分析、实体识别链接、关键...

314   1978   1978  

CodeSearchNet

Datasets, tools, and benchmarks for representation learning of code.

365   1963   1963  

rust-bert

Rust native ready-to-use NLP pipelines and transformer-based models (B...

164   1933   1933  

sling

SLING - A natural language frame semantics parser

280   1931   1931  

promptsource

Toolkit for creating, sharing and using natural language prompts.

271   1926   1926  

Introduction-NLP

HanLP作者的新书《自然语言处理入门》详细笔记！业界良心之作，书中不是枯...

533   1924   1924  

unstructured

Open source libraries and APIs to build custom preprocessing pipelines...

127   1890   1890  

named_entity_recognition

中文命名实体识别（包括多种模型：HMM，CRF，BiLSTM，BiLSTM+CRF的具体实现...

512   1853   1853  

PyTorchNLPBook

Code and data accompanying Natural Language Processing with PyTorch pu...

773   1851   1851  

DeepLearningForNLPInPytorch

An IPython Notebook tutorial on deep learning for natural language pro...

456   1850   1850  

awesome-bert

bert nlp papers, applications and github resources, including the new...

350   1814   1814  

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

102   1801   1801  

ABSA-PyTorch

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的...

503   1791   1791  

BERT-NER-Pytorch

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

398   1785   1785  

NLP-Interview-Notes

该仓库主要记录 NLP 算法工程师相关的面试题

457   1785   1785  

AliceMind

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeN...

281   1777   1777  

kaggle-CrowdFlower

1st Place Solution for CrowdFlower Product Search Results Relevance Co...

674   1751   1751  

DeepLearn

Implementation of research papers on Deep Learning+ NLP+ CV in Python...

373   1748   1748  

ecco

Explain, analyze, and visualize NLP language models. Ecco creates inte...

131   1740   1740  

ChineseGLUE

Language Understanding Evaluation benchmark for Chinese: datasets, bas...

246   1732   1732  

ChineseNLP

Datasets, SOTA results of every fields of Chinese NLP

276   1724   1724  

adapter-transformers

Huggingface Transformers + Adapters = ❤️

283   1721   1721  

NLPer-Arsenal

收录NLP竞赛策略实现、各任务baseline、相关竞赛经验贴（当前赛事、往期赛...

225   1719   1719  

NLP-Models-Tensorflow

Gathers machine learning and Tensorflow deep learning models for NLP p...

719   1711   1711  

awesome-chatgpt

🧠 A curated list of awesome ChatGPT resources, including libraries, SD...

124   1706   1706  

sparseml

Libraries for applying sparsification recipes to neural networks with...

122   1695   1695  

zero_nlp

中文nlp解决方案(大模型、数据、模型、训练、推理)

225   1693   1693  

gpt2-ml

GPT2 for Multiple Languages, including pretrained models. GPT2 多语言...

333   1690   1690  

FARM

:house_with_garden: Fast & easy transfer learning for NLP. Harvesting...

235   1674   1674  

EasyNLP

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

204   1670   1670  

cakechat

CakeChat: Emotional Generative Dialog System

859   1663   1663  

NeuroNER

Named-entity recognition using neural networks. Easy-to-use and state-...

487   1658   1658  

transfer-learning-conv-ai

🦄 State-of-the-Art Conversational AI with Transfer Learning

420   1655   1655  

news-please

news-please - an integrated web crawler and information extractor for...

379   1655   1655  

lightning-flash

Your PyTorch AI Factory - Flash enables you to easily configure and ru...

199   1653   1653  

Awesome-pytorch-list-CNVersion

Awesome-pytorch-list 翻译工作进行中......

401   1647   1647  

RL4LMs

A modular RL library to fine-tune language models to human preferences

155   1646   1646  

Research

novel deep learning research works with PaddlePaddle

804   1629   1629  

awesome_Chinese_medical_NLP

中文医学NLP公开资源整理：术语集/语料库/词向量/预训练模型/知识图谱/命名...

315   1623   1623  

TextInfoExp

自然语言处理实验（sougou数据集），TF-IDF，文本分类、聚类、词向量、情感...

776   1615   1615  

graph4nlp

Graph4nlp is the library for the easy use of Graph Neural Networks for...

198   1596   1596  

magnitude

A fast, efficient universal vector embedding utility package.

115   1592   1592  

Chinese-XLNet

Pre-Trained Chinese XLNet（中文XLNet预训练模型）

278   1575   1575  

Recognizers-Text

Microsoft.Recognizers.Text provides recognition and resolution of numb...

423   1574   1574