ParisNeo / lollms-webui

LoLLMs WEBUI (Local, single user, multi models/modal fully integrated webui) A new lollms project can be found at: https://github.com/ParisNeo/lollms This is a more advanced version with multi users and MCP compatibility. The lollms webui keeps a minimal support and will eventually be completely replaced by the new lollms project. Latest video Here is a tutorial on how to use function calls in lollms LoLLMs core library download statistics LoLLMs webui download statistics Welcome to LoLLMS WebUI (Lord of Large Language Multimodal Systems: One tool to rule them all), the hub for LLM (Large Language Models) and multimodal intelligence systems. This project aims to provide a user-friendly interface to access and utilize various LLM and other AI models for a wide range of tasks. Whether you need help with writing, coding, organizing data, analyzing images, generating images, generating music or seeking answers to your questions, LoLLMS WebUI has got you covered. As an all-encompassing tool with access to over 500 AI expert conditioning across diverse domains and more than 2500 fine tuned models over multiple domains, you now have an immediate resource for any problem. Whether your car needs repair or if you need coding assistance in Python, C++ or JavaScript; feeling down about life decisions that were made wrongly yet unable to see how? Ask Lollms. Need guidance on what lies ahead healthwise based on current symptoms presented, our medical assistance AI can help you get a potential diagnosis and guide you to seek the right medical care. If stuck with legal matters such contract interpretation feel free to reach out to Lawyer personality, to get some insight at hand -all without leaving comfort home. Not only does it aid students struggling through those lengthy lectors but provides them extra support during assessments too, so they are able grasp concepts properly rather then just reading along lines which could leave many confused afterward. Want some entertainment? Then engage Laughter Botand let yourself go enjoy hysterical laughs until tears roll from eyes while playing Dungeons&Dragonsor make up crazy stories together thanks to Creative Story Generator. Need illustration work done? No worries, Artbot got us covered there! And last but definitely not least LordOfMusic is here for music generation according to individual specifications. So essentially say goodbye boring nights alone because everything possible can be achieved within one single platform called Lollms... Features • Choose your preferred binding, model, and personality for your tasks • Enhance your emails, essays, code debugging, thought organization, and more • Explore a wide range of functionalities, such as searching, data organization, image generation, and music generation • Easy-to-use UI with light and dark mode options • Integration with GitHub repository for easy access • Support for different personalities with predefined welcome messages • Thumb up/down rating for generated answers • Copy, edit, and remove messages • Local database storage for your discussions • Search, export, and delete multiple discussions • Support for image generation based on stable diffusion/flux/comfyui/open ai dall-e/Midjourney/Novita ai services • Support for video generation based lumalabs/cogvideo_x/runwayml/stable_diffusion/Novita ai services • Support for music generation based on musicgen • Support for multi generation peer to peer network through Lollms Nodes and Petals. • Support for Docker, conda, and manual virtual environment setups • Support for LLMs using multiple bindings: • Hugging face local models • GGUF/GGML local models • EXLLama v2 local models (EXT/AWQ/GPTQ) • Ollama service • vllm service • Openai service • Anthropic service • Open-router service • Novita-ai service • Support for prompt Routing to various models depending on the complexity of the task Star History Thank you for all users who tested this tool and helped making it more user friendly. Installation Automatic installation (Console) Download the installation script from scripts folder and run it. The installation scripts are: • for Windows. • for Linux. • for Mac. Manual install: Since v 10.14, manual installation is back: • First ensure Python 3.11 is installed You can check your Python version with: If you need to install Python 3.11, download it from: https://www.python.org/downloads/release/python-3118/ • Clone the repository with submodules • Create and activate a virtual environment (recommended) On Windows: On Linux/Mac: • Install requirements • Create global_paths_cfg.yaml • Install desired bindings You can set environment variables to select which bindings to install For example, to install ollama binding: List of available bindings and their installation commands: elf: python zoos/bindings_zoo/elf/__init__.py openrouter: python zoos/bindings_zoo/openrouter/__init__.py openai: python zoos/bindings_zoo/openai/__init__.py groq: python zoos/bindings_zoo/groq/__init__.py mistralai: python zoos/bindings_zoo/mistralai/__init__.py ollama: python zoos/bindings_zoo/ollama_ai/__init__.py vllm: python zoos/bindings_zoo/vllm/__init__.py litellm: python zoos/bindings_zoo/litellm/__init__.py exllamav2: python zoos/bindings_zoo/exllamav2/__init__.py python_llama_cpp: python zoos/bindings_zoo/python_llama_cpp/__init__.py huggingface: python zoos/bindings_zoo/huggingface/__init__.py remote_lollms: python zoos/bindings_zoo/remote_lollms/__init__.py xAI: python zoos/bindings_zoo/xAI/__init__.py gemini: python zoos/bindings_zoo/gemini/__init__.py novita_ai: python zoos/bindings_zoo/novita_ai/__init__.py • Run the server now you are ready to run lolmms: Smart Routing: Optimizing for Money and Speed Lollms' Smart Routing feature goes beyond just selecting the right model for accuracy. It empowers you to optimize your text generation process for two key factors: **money** and **speed**. **Optimizing for Money:** Imagine you're using multiple text gen…