back to home
llm-d / llm-d-inference-sim
A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
View on GitHub109 stars
69 forks
35 issues
Go
AI Architecture Analysis
This repository is indexed by RepoMind. By analyzing llm-d/llm-d-inference-sim in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.
Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context on-demand, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.
Source files are only loaded when you start an analysis to optimize performance.