Questions regarding copying files from one place to another

learn more… | top users | synonyms

12
votes
4answers
17k views

How to copy-merge two directories? [duplicate]

I have two directories images and images2 with this structure in Linux: /images/ad /images/fe /images/foo ... and other 4000 folders and the other is like: /images2/ad /images2/fe ...
2
votes
1answer
1k views

rsync specific directories

Below are the directories of my directory structure. I only want to run rsync on the content under the archive directory of any subdirectory and exclude everything else: ./ ap/ ap/aploader/ ...
0
votes
0answers
18 views

rsync : fixing Permission denied error with no rwx permission

We can see that one of our rsync jobs is failing with the following error rsync: opendir "/share/resources/0731402367/docs/quick-check/answers" failed: Permission denied (13) rsync: opendir ...
0
votes
1answer
34 views

rsync failing to exclude directory [duplicate]

We are using rsync to copy files from one location to another location on a different host. We want to exclude a directory from the source location so that files from this directory are not copied . ...
-5
votes
2answers
41 views

Copying file from one directory to another directory [closed]

So I have this directory called CS under my home directory. Under CS, I have 3 directories called "Q", "W", "E". I want to copy a file in "Q" into "W", but I'm having trouble. I tried numerous cp ...
3
votes
4answers
470 views

Copy All Files With Certain Length File Name

In directory /source I'd like to copy all files with a file name more than 15 characters to directory /dest. Is there a UNIX command to do this? EDIT: Although this question explains how to search ...
2
votes
2answers
60 views

How to duplicate a file a number of times while embedding an index in each file

I have a file named, for example, ascdrgi.txt, with the following contents: tiger lion cat I want to duplicate this file a (variable) number of times by changing the last character of the filename ...
1
vote
0answers
19 views

Search drive and copy source to flat target

I have backups and backups of backups (there are copies of copies) of images spread out over various drives. I want to scan the drives and copy all images from a source to one flat target directory. I ...
2
votes
0answers
144 views

Copy file if no error was encountered, else delete copied portion

I am copying a folder in Linux with plenty of files. Some of the files give me errors like this: Error splicing file: Input/output error The problem is that it keeps the file in the new location ...
9
votes
1answer
85 views

How to duplicate a file without copying its data with btrfs?

I have no experience with btrfs, but it's advertised to be able to de-duplicate files. In my application, I'd need to duplicate whole directory trees. From what I learned, btrfs only de-duplicates ...
31
votes
7answers
3k views

Is it a UUOC (useless use of cat) to redirect one file to another?

If I want to make the contents of file2 match the contents of file1, I could obviously just run cp file1 file2. However, if I want to preserve everything about file2 except the contents—owner, ...
15
votes
8answers
8k views

How do I copy all files and directories except certain ones over ssh?

Using the Linux command line, I use the scp command to copy up all the files and folders from a certain directory. However, I don't like to consume wasted bandwidth for copying up things I rarely ...
1
vote
1answer
22 views

ZeroCopy using commandline

Does any of the standard copy mechanisms take advantage of zero copy? Ex. cp, rsync
30
votes
11answers
34k views

Is there a faster alternative to cp for copying large files (~20 GB)?

I am a graduate student, and the group in which I work maintains a Linux cluster. Each node of the cluster has its own local disk, but these local disks are relatively small and are not equipped with ...
1
vote
1answer
38 views

copying and working on OSX .app files (folders) in linux

tldr; I want to run a script over an external hard drive and tar.gz every folder that ends with .app into their own archive. That is, I don't want them all in one tar.gz file, I want to create one ...
1
vote
2answers
117 views

See progress in Files (Nautilus)

I am trying to copy a directory containing multiple subdirectories and files to an external drive. It is taking a long time (24+ hours). I copied in Files on Fedora 23 instead of cp -v on the ...
1
vote
3answers
148 views

How to copy symlinks as symlinks from one machine to another?

Let's assume I have two identical systems. On the first system I've created a symbolic link. On the second one I want to copy that symlink via sftp and the symlink shall work the same (i.e if the ...
2
votes
2answers
50 views

Find and replace all same files between 2 directories

I want to find all files in dir1 having corresponding same file names in dir2, and replace them with the files from dir2. For example: dir1: first.txt second.txt dir2: third.txt first.txt So I ...
2
votes
3answers
979 views

How to copy and add prefix to file names in one step?

I want to copy and rename multiple c source files in a directory. I can copy like this: $ cp *.c $OTHERDIR But I want to give a prefix to all the file names: file.c --> old#file.c How can I ...
13
votes
3answers
602 views

How is install different from cp?

How is install different from a simple copy, cp or dd? I just compiled a little utility and want to add it to /usr/sbin so it becomes available via my PATH variable. Why use one vs the other?
0
votes
1answer
27 views

Migrate to a new vdisk

I have to migrate some data to a new vdisk. But i have no idea how i can do this. The old Vdisk is under /dev/mapper/12345 which is a link to /dev/dm-1 The new Vdisk is under /dev/mapper/67890 which ...
3
votes
1answer
34 views

cp command which partially resolves symlinks

Is there an easy way to copy a directory recursively where symlinks to external files/directories are resolved (target file is copied), but internal symlinks (pointing to files inside the copied tree) ...
1
vote
3answers
4k views

download file from Internet to server using SSH

Recently because of some problem, I lost all my server files and requested the hosting team to provide me my files from a backup. They will provide me a link from which I have to download a compressed ...
3
votes
4answers
316 views

Comparing each file in two directories and copying it to another if it differs from its counterpart

How can I compare all files in two directories and copy the ones that are different to another directory? For example, say we have dir1 and dir2: dir1: build.gradle gradle.properties ...
2
votes
2answers
162 views

rsync option to exclude partial files

We are using rsync to sync two folders on same machine. Files will be written to a source folder from another application. We have the problem that, even if a file is not completely written/copied to ...
173
votes
4answers
604k views

How to copy files from one machine to another using ssh [duplicate]

I'm using Linux (centos) machine, I already connected to the other system using ssh. Now my question is how can I copy files from one system to another system? Suppose, in my environment, I have two ...
-2
votes
2answers
57 views

Comparing files with different extensions but possibly similar contents

I'm stuck on a task and need some help. So the problem is that i need to compare and copy files with 2 different extensions say .txt and .doc . These files may have the same name but different ...
1
vote
0answers
120 views

rsync + renaming the copied files

Is it possible to change the name of the destination file (add some timestamp as a prefix) when copy is done by rsync ? For example, I can use the following command to change the name of the ...
0
votes
3answers
88 views

Script for copying files from a folder and appending md5sum into new filename

I would like to know if this is possible: I have a large number of .mov files in a folder. I would like to know if I can copy the files to a separate folder but include the md5sum in the new ...
0
votes
2answers
64 views

checking rsync run status

We have a cron job running to rsync files from one server to a different host. The cron runs daily at midnight. The file copy is critical for us so we want to monitor the backup runs. We want to ...
3
votes
7answers
896 views

How to copy a folder structure and make symbolic links to files?

I have a folder SOURCE that contains several sub-level folders, each with its own files.. I want to copy this folder in a new folder COPY where I need to copy the directory structure but keep the ...
14
votes
5answers
9k views

How can I copy a file and create the target directories at the same time?

I want to cp aaa/deep/sea/blob.psd to bbb/deep/sea/blob.psd How do I do the copy if the deep and sea directories don't exist under bbb so that the copy both creates the directories that are needed ...
2
votes
3answers
6k views

Copy files from a list to a folder

I have a text file abc.txt and its contents are: /lag/cnn/org/one.txt /lag/cnn/org/two.txt /lag/cnn/org/three.txt If I use: $ tar -cvf allfiles.tar -T abc.txt I'm getting the tar of ...
1
vote
2answers
218 views

How to copy directory structure from one server to another without root user?

I would like to know best way to copy directory structure from one server(Unix) to another (Linux): without root user servers are not connected (e.g. can't use SSH directly between them) I need to ...
5
votes
4answers
4k views

How can I copy a file in a bash script and rename it while copying and place it in the same directory

How would I copy a file "file.doc" and rename it while copying to "file_copy.doc" and place it in the same directory ? And this only by calling the script and adding the file name in the argument: ...
5
votes
2answers
16k views

faster alternative to cp -a

For a simple transfer of /home to another disk i use cp -a that seems to me an extremely slow way. Should like know a more efficient way to complete the task. I have /home mounted as logical volume, ...
12
votes
4answers
57k views

Can I transfer files using SSH?

I am using PuTTY on Windows 7 to SSH to my school computer lab. Can I transfer files from my Windows machine to my user on the school machines using SSH?
43
votes
5answers
24k views

Is there a way to determine the optimal value for the bs parameter to dd?

On occasion I've seen comments online along the lines of "make sure you set 'bs=' because the default value will take too long," and my own extremely-unscientific experiences of, "well that seemed to ...
0
votes
2answers
131 views

How do I archive a folder keeping owners and permissions intact?

Is there any way to archive a folder and keep the owners and permissions intact? I'm doing a backup of some files, which I want to move using a usb-stick, which has a FAT filesystem. So the idea was ...
-1
votes
2answers
41 views

Is there a variant of the “cp -a” command that avoids copying from other filesystems?

Let's say I have a directory /data/something with the following subdirs: /data/something/iowa /data/something/wyoming /data/something/burkinafaso /data/something/slovenia All four subdirs have ...
1
vote
1answer
48 views

Syncing folders where multiple files are partially changed

I have following directory structure on remote machine ALLLibs/LibA/LibA.1 ALLLibs/LibA/LibA.2 ALLLibs/LibB/LibB.1 ALLLibs/LibB/LibB.4 for info LibA.1 and LibA.2 are version of a directory, ...
0
votes
1answer
73 views

How to backup all the files that I'm copying before being overwritten?

I have a folder like this: ./folder-a/index.html ./folder-b/index.html ./folder-c/subdir/index.html ./new-content/folder-a/index.html ./new-content/folder-b/index.html ...
3
votes
1answer
83 views

How to limit speed of file copy?

I am copying huge file from NFS mount using dd: dd if=/mnt/nfs/image.img of=/dev/sda I need to limit the speed of reading from NFS. How can I achieve it? The only precondition is to use some easy ...
1
vote
3answers
144 views

Copy filenames, and add path prefix, in a directory, recursively

I have a working directory: /home/myusername/projectdir The working directory contains files and sub-directories. The depth of sub-directories is not known. I want to put all the *.log files into the ...
1
vote
2answers
107 views

Copy files between two hosts

How can I copy files between two hosts the first primary host is running Linux and the secondary host is running Windows. I am looking for a correct command line to use it in terminal/Linux? I tried ...
20
votes
2answers
2k views

Why is this binary file transfered over “ssh -t” being changed?

I am trying to copy files over SSH, but cannot use scp due to not knowing the exact filename that I need. Although small binary files and text files transfer fine, large binary files get altered. Here ...
11
votes
1answer
4k views

Best way to continue stopped move (mv) by merging directories?

I have moved (mv) a pretty large directory on my NAS (Linux based), but had to interrupt the procedure. Not being a regular Linux user, I though I could just continue and merge the rest later in. mv ...
3
votes
2answers
149 views

Recursive copy files with rename

If I have input folder files_input that has subfilders like 01-2015, 02-2015, 03-2015 etc and all these subfolders have other subfolders. Each subfolder has only one file called index.html. How can ...
2
votes
3answers
2k views

How to I copy the directory and subfolders but ignore certain files in the subfolder?

I believe the question is best asked with an example. /home test1.txt test2.txt /home/my-folder test3.txt test4.txt test1.txt, test2.txt and my-folder folder are inside /home. ...
5
votes
4answers
3k views

Copying specific subfolders with directory structure to a new folder

I am having a the following directory structure: Main_Dir | ----------------------------------- Subdir1 Subdir2 Subdir3 | | ...