I am copying files from remote server to my local server using below scp command. I just type below command on the terminal and it starts copying.
scp -r user@machineA:/data/process/* /data/process/
Now since on remote servers we have around 100 files and each file size is around 11 GB so above command will copy one file at a time. Is there any way by which I can copy 5 files at a time in parallel with some command that I can run directly on the terminal?
I also have GNU parallel installed but not sure how can I use it here which can help me copy files in parallel by running directly on terminal? Or if there is any other way then I am open for that as well.