nlp

A modular RL library to fine-tune language models to human preferences

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec,...

ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators

🧠 A curated list of awesome ChatGPT resources, including libraries, SDKs, APIs, and more. 🌟 Please consider supporting this project by giving it a s...

Large Concept Models: Language modeling in a sentence representation space

Rasa Core is now part of the Rasa repo: An open source machine learning framework to automate text-and voice-based conversations

Beautiful visualizations of how language differs among document types.

A curated list of pretrained sentence and word embedding models

中文命名实体识别（包括多种模型：HMM，CRF，BiLSTM，BiLSTM+CRF的具体实现）

TigerBot: A multi-language multi-task LLM

HanLP作者的新书《自然语言处理入门》详细笔记！业界良心之作，书中不是枯燥无味的公式罗列，而是用白话阐述的通俗易懂的算法模型。从基本概念出发，逐步介绍中...

Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取

Multi-Task Deep Neural Networks for Natural Language Understanding

Library to scrape and clean web pages to create massive datasets.

Chinese NER(Named Entity Recognition) using BERT(Softmax, CRF, Span)

收录NLP竞赛策略实现、各任务baseline、相关竞赛经验贴（当前赛事、往期赛事、训练赛）、NLP会议时间、常用自媒体、GPU推荐等，持续更新中

NLP, before and after spaCy

Basic Utilities for PyTorch Natural Language Processing (NLP)

Python implementation of TextRank algorithms ("textgraphs") for phrase extraction

Unsupervised Data Augmentation (UDA)

Assist in organizing your piles of documents, resulting from scanners, e-mails and other sources with miminal effort.

EasyNLP: A Comprehensive and Easy-to-use NLP Toolkit

[Paper List] Papers integrating knowledge graphs (KGs) and large language models (LLMs)

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Official repository of the xLSTM.

Libraries for applying sparsification recipes to neural networks with a few lines of code, enabling faster and smaller models

Master Federated Learning in 2 Hours—Run It on Your PC!

Training RNNs as Fast as CNNs (https://arxiv.org/abs/1709.02755)

Aspect Based Sentiment Analysis, PyTorch Implementations. 基于方面的情感分析，使用PyTorch实现。

Explain, analyze, and visualize NLP language models. Ecco creates interactive visualizations directly in Jupyter notebooks explaining the behavior of...

Deep Learning Chinese Word Segment

Code and data accompanying Natural Language Processing with PyTorch published by O'Reilly Media https://amzn.to/3JUgR2L

ALIbaba's Collection of Encoder-decoders from MinD (Machine IntelligeNce of Damo) Lab

A comprehensive reference for all topics related to Natural Language Processing

Fast State-of-the-Art Static Embeddings

🤖 A powerful, open source client-side JavaScript library for ChatGPT

中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

An on-premises, OCR-free unstructured data extraction, markdown conversion and benchmarking toolkit. (https://idp-leaderboard.org/)

An IPython Notebook tutorial on deep learning for natural language processing, including structure prediction.

A full spaCy pipeline and models for scientific/biomedical documents.

A reading list for large models safety, security, and privacy (including Awesome LLM Security, Safety, etc.).

SLING - A natural language frame semantics parser

🌸 Learn Japanese grammar with TypeScript

一键中文数据增强包 ； NLP数据增强、bert数据增强、EDA：pip install nlpcda

Transformers 库快速入门教程

💫 Models for the spaCy Natural Language Processing (NLP) library

Self-contained Machine Learning and Natural Language Processing library in Go

bert nlp papers, applications and github resources, including the newst xlnet ， BERT、XLNet 相关论文和 github 项目

[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling