1

First I will elaborate what is the scenario here.

We have 2 servers both are ubuntu 14.04 LTS and we have a drive called /storage/ of 70TB It includes many files of 30GB size each and other ones as well. So as both are the remote servers and I want to move all this data to my other remote server's same drive as /storage/.

Is there any way to do it fastly and stably so that there will be no data loss in that?

once i have tried to move only one file from one to other which worked fine with this link. Any help will be thankful.

  • 1
    then try that again, it will work fine. – Ipor Sircer Nov 30 '16 at 12:12
  • Thanks for -1 but am talking about 1: moving NOT copying. 2: It was smal file of few kps now am talking about 70TB – Junaid Farooq Nov 30 '16 at 12:13
  • 1
    1. what's the difference? 2. what's the difference? – Ipor Sircer Nov 30 '16 at 12:15
  • @ijunaidfarooq Moving in this respect is a two step procedure of 1) copying 2) removing the original data. Use scp or rsync - double checking the m5d checksum is not a necessity (see here). Just make sure scp finished correctly and then you can go on deleting the original files. – Fiximan Nov 30 '16 at 12:19
  • Don't you what is the difference between copying and moving? Dont you know is meant by 34 byte and 70TB? – Junaid Farooq Nov 30 '16 at 12:20
4

Is there any way to do it fastly

It depends of the network connection speed between source and destination server.

70 TB is a lot of data. It might be worthy physically disconnecting the drive from the server and remounting it on the destination server.

and stably so that there will be no data loss in that?

If you copy the files via scp their integrity is ensured by the crypto protocols used by the program itself. So as long scp finishes with a zero status, you know that everything went well.

0

I'm not sure which of solutions have you used from mentioned question but I would strongly suggest using rsync and screen as this operation will take a lot of time.

With this amount of data something might go wrong (for example, connection might be lost) and you will take hard time finding out the point where you should restart your procedure. Rsync does it for you.

Talking about speed - well that depends on network connection and, yes, moving physical drive might be also a solution. Take a look at compression switch in rsync it might help if your files can be compressed easly. If not, then going without compression also might be a good idea (no unnecessary CPU usage).

  • rsync seems the more sensible idea. – Rui F Ribeiro Nov 30 '16 at 15:57
0

Simply

  1. Make a backup
  2. Configure the new server, ssh access as root (temporary and with public key only) and install rsync, create dir /storage
  3. transfer using rsync (on slackware ssh is enabled default, if not enable use rsync -e)
  4. After transfer check with df, du if is all ok and disable ssh access as root (mantein only ssh as user)
  • rsync is fine for smalier amounts of data but will take forever on 70 Tb of data. – fpmurphy Nov 30 '16 at 17:02
  • @fpmurphy1 it depends on so many factors that the question asker hasn't provided. I moved several TB of data from New Zealand to France earlier this year. It took a month (so would have been faster with a disk posted through the mail) but time wasn't important. – roaima Nov 30 '16 at 17:11

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.