Best Open Source fine tuning Libraries

A curated list of the most popular GitHub repositories tagged with fine tuning. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1hiyouga/LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

67,420Python

Analyze Code

#2unslothai/unsloth

Fine-tuning & Reinforcement Learning for LLMs. 🦥 Train OpenAI gpt-oss, DeepSeek, Qwen, Llama, Gemma, TTS 2x faster with 70% less VRAM.

52,562Python

Analyze Code

#3run-llama/llama_index

LlamaIndex is the leading document agent and OCR platform

47,100Python

Analyze Code

#4huggingface/peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

20,658Python

Analyze Code

#5FunAudioLLM/CosyVoice

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

19,659Python

Analyze Code

#6ConardLi/easy-dataset

A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval

13,392JavaScript

Analyze Code

#7oumi-ai/oumi

Easily fine-tune, evaluate and deploy gpt-oss, Qwen3, DeepSeek-R1, or any open source LLM / VLM!

8,860Python

Analyze Code

#8flyteorg/flyte

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

6,747Go

Analyze Code