5 Forks
20 Stars
20 Watchers

Local_LLM_Training_Apple_Silicon

Created and enhanced a local LLM training system on Apple Silicon with MLX and Metal API, overcoming the absence of CUDA support. Fine-tuned the Llama3 model on 16 GPUs for streamlined solution of verbose math word problems. Result: a powerful, privacy-preserving chatbot that runs smoothly on-device.

How to download and setup Local_LLM_Training_Apple_Silicon

Open terminal and run command
git clone https://github.com/GusLovesMath/Local_LLM_Training_Apple_Silicon.git
git clone is used to create a copy or clone of Local_LLM_Training_Apple_Silicon repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with Local_LLM_Training_Apple_Silicon https://github.com/GusLovesMath/Local_LLM_Training_Apple_Silicon/archive/master.zip

Or simply clone Local_LLM_Training_Apple_Silicon with SSH
[email protected]:GusLovesMath/Local_LLM_Training_Apple_Silicon.git

If you have some problems with Local_LLM_Training_Apple_Silicon

You may open issue on Local_LLM_Training_Apple_Silicon support forum (system) here: https://github.com/GusLovesMath/Local_LLM_Training_Apple_Silicon/issues