Given 2TB worth of 4MB files, how would I create a block device with those files as backing storage?
I want to trial use of Sia for storage, since:
Storing 1TB on Sia costs about $2 per month, compared with $23 on Amazon S3.
The cost is so low since people are sharing their otherwise unused disk space.
Files are uploaded at 3x redundancy to 30 hosts. What this means is that 30 hosts end up with fragments of your data, and out of those hosts any 10 are enough to recover the original data.
Sia only provides storage for files, but I would like to use it to create a block device for versatility.
Sia operates on 4MB "sectors", so creating a loopback device for each file would be silly.
I'd love to use Ceph, but given ext4 is not recommended as a filesystem, I doubt that Sia's FUSE filesystem will cut the mustard. Either way, given bluestore (block backed) eliminates double writes, using filestore would be super slow.