coze-dev / coze-loop

Coze Loop • Feature list • Quick start • Developer guide English | 中文 What is Coze Loop Coze Loop is a developer-oriented, platform-level solution focused on the development and operation of AI agents. It addresses various challenges faced during the AI agent development process, providing full lifecycle management capabilities from development, debugging, evaluation, to monitoring. Based on the commercial version, Coze Loop introduces an open-source edition that offers developers free access to core foundational feature modules. By sharing its core technology framework in an open-source model, developers can customize and extend according to business needs, facilitating community co-construction, sharing, and exchange, helping developers participate in AI agent exploration and practice with zero barriers. What can Coze Loop do? Coze Loop helps developers develop and operate AI Agent more efficiently by providing full lifecycle management capabilities. Whether it is prompt engineering, AI Agent evaluation, or monitoring and optimization after deployment, Coze Loop provides powerful tools and intelligent support, greatly simplifying the development process of AI Agents and enhancing their operational performance and stability. • **Prompt development**: The Prompt development module of Coze Loop provides developers with end-to-end support for writing, debugging, optimizing, and version management. Through a visual Playground, it enables real-time interactive testing of prompts, allowing developers to intuitively compare the output of different LLMs. • **Evaluation**: The Coze Loop evaluation module provides developers with systematic evaluation capabilities, enabling automated multi-dimensional testing of prompts and Coze agents' output, such as accuracy, conciseness, compliance, and more. • **Observability**: Coze Loop provides developers with observability for the entire execution process, fully recording every stage from user input to AI output, including key stages such as prompt parsing, model invocation, and tool execution, and automatically capturing intermediate results and exceptions. Feature list | **Feature** | **Functional points** | | --- | --- | | Prompt debugging | *Playground debugging and comparison * Prompt version management | | Evaluation | *Manage evaluation sets Management evaluator * Manage experiments | | Observation | SDK trace reporting * Trace data observation | | Model | Support integration with OpenAI, Volcengine Ark, and other models | Quick Start > > Refer to Quick Start to learn in detail how to install and deploy the latest version of Coze Loop. Deployment method 1: Docker deployment (Docker Compose) > > Please install and start Docker Engine before you start. Procedure: • Clone the source code. Run the following command to obtain the latest version of the Coze Loop source code. • Configure a model. • Enter the directory. • Edit the file . • Modify the api_key and model fields. Take Volcengine Ark as an example: • api_key: Volcengine Ark API Key. Users in China can refer to the Volcengine Ark documentation, while users outside China can refer to the BytePlus ModelArk documentation. • model: The Endpoint ID of the Volcengine Ark model access point. Users within China can refer to the Volcengine Ark documentation; users outside China can refer to the BytePlus ModelArk documentation. • Start the service. Run the following commands to quickly deploy the open-source version of Coze Loop using Docker Compose. • Access the Coze Loop open-source version through your browser . Deployment method 2: Kubernetes deployment using Helm Chart > * The Kubernetes cluster has been prepared, the Nginx Ingress add-ons have been enabled, and the Kubectl and Helm tools have been installed. > * To quickly try it out locally, you can deploy a Kubernetes cluster using Minikube. For detailed steps, refer to Quick Start. Procedure: • Run the following command to obtain the Helm Chart package. • Configure a model. Go to the directory and edit the file. Configure the following fields, using Volcengine Ark as an example: • api_key: Volcengine Ark API Key. Users in mainland China can refer to the Volcengine Ark documentation, while users outside mainland China can refer to the BytePlus ModelArk documentation. • model: The Endpoint ID of the Volcengine Ark model access point. Users in China can refer to the Volcengine Ark documentation, while users outside China can refer to the BytePlus ModelArk documentation. • Configure Ingress rules. Ingress is used to expose services to external networks. You need to configure the file in the project directory according to the actual cluster situation, manually modify parameters such as ingressClassName, and configure elements such as class, instance, host, and IP allocation. • Deploy and start the service. Execute the following commands to quickly deploy the open-source version of Coze Loop using Helm. • Access the Coze Loop open source edition via a browser. The access domain name and URL depend on the domain name and URL assigned to your cluster. • Start customizing your Coze Loop project. Refer to the examples in the directory. Modify to override the default settings. After making changes, rerun for the changes to take effect. Use the Coze Loop open source version • Prompt development and debugging: Coze Loop provides a complete prompt development workflow. • Evaluation: The evaluation functionality of Coze Loop provides standard evaluation data management, an automated evaluation engine, and comprehensive statistics on experimental results. • Trace reporting and query: Coze Loop supports automatic reporting of traces from prompt debugging sessions created on the platform, enabling real-time tracking of each trace. • Open-source Edition usage of the Coze Loop SDK: The Coze Loop SDK in three languages is suitable for both commercial and open-source editions. For the Open-source Edition, developers only need to modify some p…