Best Open Source multi modality Libraries

A curated list of the most popular GitHub repositories tagged with multi modality. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1haotian-liu/LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

24,471Python

Analyze Code

#2jina-ai/clip-as-service

🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

12,817Python

Analyze Code