harbor-framework / harbor
Harbor is a framework for running agent evaluations and creating and using RL environments.
View on GitHubAI Architecture Analysis
This repository is indexed by RepoMind. By analyzing harbor-framework/harbor in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.
Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context on-demand, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.
Embed this Badge
Showcase RepoMind's analysis directly in your repository's README.
Repository Overview (README excerpt)
Crawler viewHarbor Harbor is a framework from the creators of Terminal-Bench for evaluating and optimizing agents and language models. You can use Harbor to: • Evaluate arbitrary agents like Claude Code, OpenHands, Codex CLI, and more. • Build and share your own benchmarks and environments. • Conduct experiments in thousands of environments in parallel through providers like Daytona and Modal. • Generate rollouts for RL optimization. Installation or Example: Running Terminal-Bench-2.0 Harbor is the official harness for Terminal-Bench-2.0: This will launch the benchmark locally using Docker. To run it on a cloud provider (like Daytona) pass the flag as below: To see all supported agents, and other options run: To explore all supported third party benchmarks (like SWE-Bench and Aider Polyglot) run: To evaluate an agent and model one of these datasets, you can use the following command: Citation If you use **Harbor** in academic work, please cite it using the “Cite this repository” button on GitHub or the following BibTeX entry: