llm-judge-independence
itsjustmarsel
A diverse 6-LLM judge committee (4 labs, 3 countries) has correlated errors: ~1.9 effective independent judges of 6 (mean pairwise error-correlation ρ≈0.42) on RAGTruth. Provider diversity does not buy error-independence. Verdicts + one-command recompute included.
Growth over time
2 data points · 2026-08-15 → 2026-09-11How do you feel about this project?
Ask AI about llm-judge-independence
Question copied to clipboardWhat is the itsjustmarsel/llm-judge-independence GitHub project? Description: "A diverse 6-LLM judge committee (4 labs, 3 countries) has correlated errors: ~1.9 effective independent judges of 6 (mean pairwise error-correlation ρ≈0.42) on RAGTruth. Provider diversity does not buy error-independence. Verdicts + one-command recompute included.". Written in Python. Explain what it does, its main use cases, key features, and who would benefit from using it.
Question is copied to clipboard — paste it after the AI opens.
How to clone llm-judge-independence
Clone via HTTPS
Clone via SSH
Download ZIP
Download main.zipFound an issue?
Report bugs or request features on the llm-judge-independence issue tracker:
Open GitHub Issues