Loading...
File Systems & Storage
Cloud-Native File System
★ 4.3
Fault-Tolerant Distributed File System
★ 3.7
N/A — CLI binary, see juicefs.comN/A — system package, install via package managerN/A — CLI binary, see juicefs.comN/A — system package, install via package managerPython data engineers use JuiceFS to mount cloud object storage as a local POSIX file system — enabling Python pipeline code that reads and writes local files to work seamlessly with S3 or GCS as the backing store without using boto3 or cloud-specific SDKs. PySpark jobs on JuiceFS benefit from its Hadoop-compatible interface and local cache for repeated dataset reads.
Python data engineers in on-premise environments use LizardFS as a shared POSIX file system mounted across pipeline worker nodes. Python scripts write output files to the LizardFS mount and those files are immediately visible to all other nodes in the cluster — enabling simple shared-nothing pipeline patterns where workers write outputs that other workers consume without message queue coordination.
Individual Tool Pages