3
votes
2answers
50 views

Can I safely read a file that is appended to by another process?

If process A copies files to some location loc and process B regularly copies the files from loc to some other location, can B read a file that is currently in the process of being copied to loc by A? ...
3
votes
2answers
141 views

Wait for move directory to be completed before attempting to delete it

I have a process running on one computer that spawns simulations by writing the simulation data to directory pre/id. Worker processes then copy a simulation from pre to a local disk, which can be on a ...
0
votes
1answer
82 views

Get a clean list of files transferred from rsync

I'm trying to get an itemized list of files transferred by rsync. Using the -i and --out-format options, I'm instead ending up with output that looks like this: 3HMP1MO_001.tif 974.68K 100% ...
2
votes
2answers
80 views

How to automatically apply changes in a folder to another?

Running Ubuntu 12.04, I work software "production" on certain folders and then I usually copy files I make up to another paths where I do the "deployment". For example, sometimes I produce some files ...
3
votes
1answer
3k views

Move files and delete directories with rsync?

Recently I needed to delete a large number of files (over 1 million) and I read that doing: rsync -av --delete `mktemp -d`/ ~/source && rmdir ~/source Was one of the most optimized ways to ...
3
votes
4answers
393 views

Most Efficient way to back up/sync large directories over SSH

I'm looking to back up some large directories on a Dedicated Server to another Server on a daily basis using minimal bandwidth RSync looks like its up to the task but I'm unsure of the best command ...
9
votes
3answers
348 views

Stacked filesystems with write-back

I need to setup a system where a laptop and a desktop computers coexist. The idea is, I bring the laptop into the network and the laptop syncs the /home directory( with some exceptions) with the ...
3
votes
2answers
622 views

How to add/replace only modified/updated files recursively for some 2 folders?

So I currently do stuff like: rm -rf ../../../$CLOUD_INSTALL_SUBDIR/lib_boost mkdir ../../../$CLOUD_INSTALL_SUBDIR/lib_boost cp -r ../../../$BOOST_ROOT_DIR/$BOOST_INSTALL_SUBDIR/lib/* ...
13
votes
4answers
5k views

How can I do a “copy if changed” operation?

I would like to copy a set of files from directory A to directory B, with the caveat that if a file in directory A is identical to a file in directory B, that file should not be copied (and thus its ...
2
votes
1answer
103 views

Finding out *what* is synchronizing two Linux servers

The last person to maintain these Red Hat servers somehow set it up so they stay in sync -- if I delete files on one it automatically deletes them on the other. I need to set up a new configuration on ...