JuiceFS is a distributed POSIX file system built on top of Redis and S3.
-
Updated
Jun 3, 2024 - Go
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
A distributed storage benchmark for file systems, object stores & block devices with support for GPUs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, cross-DC active-active replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding.
The Universal Storage Engine
Ceph is a distributed object, block, and file storage platform
Kafka Connect HDFS connector
seaweedfs implemented in pure Rust
Exports Hadoop HDFS content statistics to Prometheus
Storage Benchmark Kit
Utils for streaming large files (S3, HDFS, gzip, bz2...)
Addax is a versatile open-source ETL tool that can seamlessly transfer data between various RDBMS and NoSQL databases, making it an ideal solution for data migration.
Apache Hadoop HDFS operator for the Kubernetes Data Stack
Must-read Papers for File System (FS)
Go Interface to the TileDB storage manager
Add a description, image, and links to the hdfs topic page so that developers can more easily learn about it.
To associate your repository with the hdfs topic, visit your repo's landing page and select "manage topics."