back to home

Best Open Source ggml Libraries

A curated list of the most popular GitHub repositories tagged with ggml. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1ggml-org/llama.cpp

LLM inference in C/C++

95,543C++
Analyze Code

#2xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

9,058Python
Analyze Code