chinese-tokenizer

yishn

Tokenizes Chinese texts into words.

language

View on GitHub Website

100 Stars

25 Forks

100 Watchers

JavaScript Language

mit License

100 SrcLog Score

Cost to Build

$891.4K

Market Value

$1.52M

How is this calculated?

Growth over time

8 data points · 2021-08-01 → 2026-04-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about chinese-tokenizer

Question copied to clipboard

What is the yishn/chinese-tokenizer GitHub project? Description: "Tokenizes Chinese texts into words.". Written in JavaScript. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone chinese-tokenizer

Clone via HTTPS

git clone https://github.com/yishn/chinese-tokenizer.git

Clone via SSH

[email protected]:yishn/chinese-tokenizer.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the chinese-tokenizer issue tracker:

Open GitHub Issues

Similar to chinese-tokenizer

go TypeScript ruby crystal awesome-cheatsheets Eve ChatterBot awesome-nlp solidity proposals Nim red scala-js wren lang gravity proselint corpora franc haxe enso Carp sdk nlp_tasks mimesis moonscript dmd rant coconut slugify