I need to transfer multiple files to a HPC cluster. Currently, I've been using the scp command but it takes about 10 minutes or more to transfer one file (about 1.4GB each). I've seen that using tar would speed up the transfer, however I noticed that compressing the files takes much longer than just transferring the files using scp. The tar command I use is:
tar -cvfz files.tar.gz files
I've also tried using rsync, however I keep getting an error saying rsync is not recognized by bash despite it being installed on the remote server. I'm not too knowledgeable about this stuff so any help or advice would be greatly appreciated!