nlp
Natural language processing (NLP) is a field of computer science that studies how computers and humans interact. In the 1950s, Alan Turing published an article that proposed a measure of intelligence, now called the Turing test. More modern techniques, such as deep learning, have produced results in the fields of language modeling, parsing, and natural-language tasks.
Repositories (1483)
The Self-Coding System for Your App — Alan AI SDK for Web
👩🏫 Advanced NLP with spaCy: A free online course
⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
A modular RL library to fine-tune language models to human preferences
🧠 A curated list of awesome ChatGPT resources, including libraries, SDKs, APIs, and more. 🌟 Please consider supporting this project by giving it a s...
Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec,...
Large Concept Models: Language modeling in a sentence representation space
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
Rasa Core is now part of the Rasa repo: An open source machine learning framework to automate text-and voice-based conversations
Beautiful visualizations of how language differs among document types.
Assist in organizing your piles of documents, resulting from scanners, e-mails and other sources with miminal effort.
A curated list of pretrained sentence and word embedding models
中文命名实体识别（包括多种模型：HMM，CRF，BiLSTM，BiLSTM+CRF的具体实现）
Library to scrape and clean web pages to create massive datasets.
HanLP作者的新书《自然语言处理入门》详细笔记！业界良心之作，书中不是枯燥无味的公式罗列，而是用白话阐述的通俗易懂的算法模型。从基本概念出发，逐步介绍中...
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取
TigerBot: A multi-language multi-task LLM
Multi-Task Deep Neural Networks for Natural Language Understanding
NLP, before and after spaCy
Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)
收录NLP竞赛策略实现、各任务baseline、相关竞赛经验贴（当前赛事、往期赛事、训练赛）、NLP会议时间、常用自媒体、GPU推荐等，持续更新中
Basic Utilities for PyTorch Natural Language Processing (NLP)
[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)
Python implementation of TextRank algorithms ("textgraphs") for phrase extraction
Unsupervised Data Augmentation (UDA)
Official repository of the xLSTM.
EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit
Fast State-of-the-Art Static Embeddings
Master Federated Learning in 2 Hours—Run It on Your PC!
Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models
Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。
Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)
Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of...
Deep Learning Chinese Word Segment
Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L
ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab
🤖 A powerful, lightweight JavaScript library + interactive CLI for ChatGPT
A comprehensive reference for all topics related to Natural Language Processing
An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)
A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).
An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.
A community-driven collection of RAG (Retrieval-Augmented Generation) frameworks, projects, and resources. Contribute and explore the evolving RAG eco...
A full spaCy pipeline and models for scientific/biomedical documents.
中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3
An IPython Notebook tutorial on deep learning for natural language processing, including structure prediction.
🌸 Learn Japanese grammar with TypeScript
SLING - A natural language frame semantics parser
ContextGem: Effortless LLM extraction from documents
💫 Models for the spaCy Natural Language Processing (NLP) library