Best Open Source cuda Libraries
A curated list of the most popular GitHub repositories tagged with cuda. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.
#1vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
#2sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
#3hashcat/hashcat
World's fastest and most advanced password recovery utility
#4NVlabs/instant-ngp
Instant neural graphics primitives: lightning fast NeRF and more
#5kaldi-asr/kaldi
kaldi-asr/kaldi is the official location of the Kaldi project.
#6NVIDIA/TensorRT-LLM
TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.
#7LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
#8xlite-dev/LeetCUDA
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners🐑, 200+ CUDA Kernels, Tensor Cores, HGEMM, FA-2 MMA.🎉
#9rapidsai/cudf
cuDF - GPU DataFrame Library
#10NVIDIA/cutlass
CUDA Templates and Python DSLs for High-Performance Linear Algebra
#11Oneflow-Inc/oneflow
OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.
#12replicate/cog
Containers for machine learning
#13NVIDIA/cuda-samples
Samples for CUDA Developers which demonstrates features in CUDA Toolkit
#14catboost/catboost
A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.
#15gpustack/gpustack
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
#16arrayfire/arrayfire
ArrayFire: a general purpose GPU library.
#17NVIDIA/cccl
CUDA Core Compute Libraries
#18lupinemachines/lupine
LUPINE is a GPU over IP bridge allowing GPUs on remote machines to be attached to CPU-only machines.
#19tenstorrent/tt-metal
:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.
#20SemiAnalysisAI/InferenceX
Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3
#21hybridgroup/yzma
Go with your own intelligence - Go applications that directly integrate llama.cpp for local inference using hardware acceleration.
#22a2flo/floor
A C++ Compute/Graphics Library and Toolchain enabling same-source CUDA/Host/Metal/OpenCL/Vulkan C++ programming and execution.
#23avifenesh/memra
Rust + CUDA inference engine for NVIDIA RTX PRO 6000 Blackwell and RTX 5090. Serves safetensors and GGUF over an OpenAI-compatible API, with per-device tuned defaults and speculative decode gated byte-identical to plain decode. Hosted instance: inference.tiyuvta.ai