I'm working with a cluster of Linux servers sitting behind the Amazon cloud autoscaling feature (documentation). There are files that accumulate on each server, they are cache files for the application. I am searching for an automated way to have the servers sync that folder amongst themselves.
Rsyncwould work if someone had a clever way to do peer detection.
- Same goes for
- We have also considered using a SaaS such as Dropbox.
- Gluster seems like overkill, and I'm not sure how easy it is to have a new computer auto-join the cluster.
Ideally what would happen is when a new server is launched, it discovers it's peers and begins syncing the folder. From that point on it's a latest filestamp wins P2P synchronization.
Anything out there that does this?