PyTokenCounter

A simple Python library for tokenizing text and counting tokens. While currently only supporting OpenAI LLMs, it helps with text processing and managing token limits in AI applications.

models

View on GitHub

2 Stars

0 Forks

2 Watchers

Python Language

gpl-3.0 License

Cost to Build

$12.9K

Market Value

$5.8K

How is this calculated?

Growth over time

1 data points · 2025-04-09 → 2025-04-09

Stars Forks Watchers

💬

How do you feel about this project?

Ask AI about PyTokenCounter

Question copied to clipboard

What is the kgruiz/PyTokenCounter GitHub project? Description: "A simple Python library for tokenizing text and counting tokens. While currently only supporting OpenAI LLMs, it helps with text processing and managing token limits in AI applications.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone PyTokenCounter

Clone via HTTPS

git clone https://github.com/kgruiz/PyTokenCounter.git

Clone via SSH

[email protected]:kgruiz/PyTokenCounter.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the PyTokenCounter issue tracker:

Open GitHub Issues

Similar to PyTokenCounter

django Awesome-CoreML-Models ardent laravel-model-caching Coolie acts_as_api plank vue-mc vectiler models spacy-models jsonmodels dynamic-training-bench laravel-model-cleanup sourced django-behaviors chainer-fast-neuralstyle-models NestedTypes gama.old hydro-serving felicity reobject tango vue-example Pytorch-Model-Zoo models osprey ImageRecognizer-Android COLLADAViewer2 Torch-Models