0 Forks
5 Stars
5 Watchers

PlaylandLLM

A python app with CLI interface to do local inference and testing of open source LLMs for text-generation. Test any transformer LLM community model such as GPT-J, Pythia, Bloom, LLaMA, Vicuna, Alpaca, or any other model supported by Huggingface's transformer and run model locally in your computer without the need of 3rd party paid APIs or keys.

How to download and setup PlaylandLLM

Open terminal and run command
git clone https://github.com/ecastera1/PlaylandLLM.git
git clone is used to create a copy or clone of PlaylandLLM repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with PlaylandLLM https://github.com/ecastera1/PlaylandLLM/archive/master.zip

Or simply clone PlaylandLLM with SSH
[email protected]:ecastera1/PlaylandLLM.git

If you have some problems with PlaylandLLM

You may open issue on PlaylandLLM support forum (system) here: https://github.com/ecastera1/PlaylandLLM/issues