chinese-tokenizer

yishn

Tokenizes Chinese texts into words.

language

View on GitHub Website

99 Stars

25 Forks

99 Watchers

JavaScript Language

mit License

Cost to Build

$888.4K

Market Value

$2.27M

How is this calculated?

Growth over time

7 data points · 2021-08-01 → 2025-08-01

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about chinese-tokenizer

Question copied to clipboard

What is the yishn/chinese-tokenizer GitHub project? Description: "Tokenizes Chinese texts into words.". Written in JavaScript. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone chinese-tokenizer

Clone via HTTPS

git clone https://github.com/yishn/chinese-tokenizer.git

Clone via SSH

[email protected]:yishn/chinese-tokenizer.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the chinese-tokenizer issue tracker:

Open GitHub Issues

Similar to chinese-tokenizer

TypeScript ruby pyret-lang go awesome-cheatsheets android-dev-sources mimesis CN-VScode-Docs oh Eve lang rust Nim red scala-js haxe enso crystal ChatterBot awesome-nlp solidity proposals wren gravity proselint corpora franc Carp sdk nlp_tasks