back to home

Best Open Source s3 Libraries

A curated list of the most popular GitHub repositories tagged with s3. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1minio/minio

MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.

60,345Go
Analyze Code

#2rclone/rclone

"rsync for cloud storage" - Google Drive, S3, Dropbox, Backblaze B2, One Drive, Swift, Hubic, Wasabi, Google Cloud Storage, Azure Blob, Azure Files, Yandex Files

55,664Go
Analyze Code

#3siyuan-note/siyuan

A privacy-first, self-hosted, fully open source personal knowledge management software, written in typescript and golang.

41,378TypeScript
Analyze Code

#4seaweedfs/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

30,449Go
Analyze Code

#5rustfs/rustfs

🚀2.3x faster than MinIO for 4KB object payloads. RustFS is an open-source, S3-compatible high-performance object storage system supporting migration and coexistence with other S3-compatible platforms such as MinIO and Ceph.

22,071Rust
Analyze Code

#6airbytehq/airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

20,743Python
Analyze Code

#7thanos-io/thanos

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

13,970Go
Analyze Code

#8donnemartin/awesome-aws

A curated list of awesome Amazon Web Services (AWS) libraries, open source repos, guides, blogs, and other resources. Featuring the Fiery Meter of AWSome.

13,923Python
Analyze Code

#9mickael-kerjean/filestash

:file_folder: File Management Platform / Universal Data Access Layer (without FUSE)

13,652JavaScript
Analyze Code

#10benbjohnson/litestream

Streaming replication for SQLite.

13,245Go
Analyze Code

#11juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

13,236Go
Analyze Code

#12s3fs-fuse/s3fs-fuse

FUSE-based file system backed by Amazon S3

9,700C++
Analyze Code