2 added 534 characters in body
source | link

The nature / contents of those files can make some difference. I understood that you need to copy 200 files, ~20 GB each, from one computer to another, is that it ?

If those files are compressible or with similar / identical pieces , you have two approaches:

  • zip them before copying, or create a tunnel between the computers with zip enable on it. So, if the network is the bottleneck, it will be a bit faster

  • if the files are very similar, or share some pieces of common content among them, try using rsync. It'll spend some time finding what is common among the files, and won't need to copy it literally, because it'll reconstruct it based on what is common.

edit

Will you need to copy those files many times ?? (like a copy -> use those files -> change something in the files in the computer A -> copy files again to computer B)

If so, rsync will be helpfull, because it'll try to detect what is equal among the versions and don't copy what is unchanged.

And a third method: if the above is correct (changes in file, then copy all files again to the second computer) you could try some binary diff to just change in the second computer what was changed in the first computer.

The nature / contents of those files can make some difference. I understood that you need to copy 200 files, ~20 GB each, from one computer to another, is that it ?

If those files are compressible or with similar / identical pieces , you have two approaches:

  • zip them before copying, or create a tunnel between the computers with zip enable on it. So, if the network is the bottleneck, it will be a bit faster

  • if the files are very similar, or share some pieces of common content among them, try using rsync. It'll spend some time finding what is common among the files, and won't need to copy it literally, because it'll reconstruct it based on what is common.

The nature / contents of those files can make some difference. I understood that you need to copy 200 files, ~20 GB each, from one computer to another, is that it ?

If those files are compressible or with similar / identical pieces , you have two approaches:

  • zip them before copying, or create a tunnel between the computers with zip enable on it. So, if the network is the bottleneck, it will be a bit faster

  • if the files are very similar, or share some pieces of common content among them, try using rsync. It'll spend some time finding what is common among the files, and won't need to copy it literally, because it'll reconstruct it based on what is common.

edit

Will you need to copy those files many times ?? (like a copy -> use those files -> change something in the files in the computer A -> copy files again to computer B)

If so, rsync will be helpfull, because it'll try to detect what is equal among the versions and don't copy what is unchanged.

And a third method: if the above is correct (changes in file, then copy all files again to the second computer) you could try some binary diff to just change in the second computer what was changed in the first computer.

1
source | link

The nature / contents of those files can make some difference. I understood that you need to copy 200 files, ~20 GB each, from one computer to another, is that it ?

If those files are compressible or with similar / identical pieces , you have two approaches:

  • zip them before copying, or create a tunnel between the computers with zip enable on it. So, if the network is the bottleneck, it will be a bit faster

  • if the files are very similar, or share some pieces of common content among them, try using rsync. It'll spend some time finding what is common among the files, and won't need to copy it literally, because it'll reconstruct it based on what is common.