CICD_LLM_DATA_SCRAPER

CICD_LLM_DATA_SCRAPER

devo8604

Automated pipeline for generating high-quality Q&A training data from Git repositories. Processes source code with LLMs to create fine-tuning datasets. Features smart caching, resume support, MLX (Apple Silicon) & llama.cpp backends, multiple export formats (Alpaca, ChatML, etc).

3 Stars
0 Forks
3 Watchers
Python Language
mit License
60.1 SrcLog Score
Cost to Build
$10.1K
Market Value
$7.4K

Growth over time

2 data points  ·  2026-04-13 → 2026-04-20
Stars Forks Watchers
💬

How do you feel about this project?

Ask AI about CICD_LLM_DATA_SCRAPER

Question copied to clipboard

What is the devo8604/CICD_LLM_DATA_SCRAPER GitHub project? Description: "Automated pipeline for generating high-quality Q&A training data from Git repositories. Processes source code with LLMs to create fine-tuning datasets. Features smart caching, resume support, MLX (Apple Silicon) & llama.cpp backends, multiple export formats (Alpaca, ChatML, etc).". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.

Question is copied to clipboard — paste it after the AI opens.

How to clone CICD_LLM_DATA_SCRAPER

Clone via HTTPS

git clone https://github.com/devo8604/CICD_LLM_DATA_SCRAPER.git

Clone via SSH

[email protected]:devo8604/CICD_LLM_DATA_SCRAPER.git

Download ZIP

Download master.zip

Found an issue?

Report bugs or request features on the CICD_LLM_DATA_SCRAPER issue tracker:

Open GitHub Issues