Skip to content
/ Fido Public

E2E Solution for Distributed Cold-Data Storage

Notifications You must be signed in to change notification settings

codenoid/Fido

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Fido [Active Development]

E2E Solution for your distributed file storage

Real-World use case

  1. you need to download a file, many files, a bunch of file from your scraper
  2. one disk is not enough, you always need more
  3. then you decide to use Fido with Systemd
  4. Fido will automatically distribute your files into selected external disk
  5. When your files getting bigger again, just add external disk again to your server

Prerequisite

  1. Make sure you have running mongodb server, if not, install mongodb
  2. Setup mongodb url in here

Installation

git clone 
cd Fido
cargo build --release

Usage

# generate symbolic link for any data that already in brick/slave/disk
# --path are not used in --cmd 0
./target/release/Fido --cmd 0 --path / --bricks /mnt/disks/disk-1

# move temporary file to brick/slave/disk, then create ln from disk to temporary location
./target/release/Fido --cmd 1 --path /path/to/scrapped-data --bricks /mnt/disks/

About

E2E Solution for Distributed Cold-Data Storage

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages