Questions tagged [duplicate-files]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
26 views

How to use rmlint to merge two large folders?

In exploring options to merge two folders, I've come across a very powerful tool known as rmlint. It has some useful documentation (and Gentle Guide). I have a scenario that I previously mentioned and ...
2
votes
2answers
40 views

Delete duplicates from another directory recursively

(N.B. There are many similar questions (e.g. here, here, here, and here) but they either assume that the directory structure is one-deep, or the answers are more complex multi-line scripts.) This is ...
0
votes
0answers
27 views

Why so many duplicated files of files in lowerdir occured in upperdir when using overlayfs without manual modification to them?

I installed new Fedora OS on SSD last year, my old HOME directory on HDD were leaved there until now. Recently, I want to combine the new HOME directory and old HOME directory into a merged HOME ...
1
vote
0answers
119 views

Copy unique files to new directory?

I have a number of folders with my various media (e.g. photos, music) from different points in time. The different folders have some of the same content (e.g. a photo might be in 2 folders), but ...
0
votes
1answer
17 views

move files from directory A to directory B, without duplicating any files

I am looking to take files from directory B and copy them into directory A. However, I know that are some same named files in each. I would only like to have only the "non-matching" file names copied ...
1
vote
3answers
136 views

What is the most efficient way to find duplicate files?

I have a number of folders with a few million files (amounting to a few TB) in total. I wish to find duplicates across all files. The output ideally is a simple list of dupes - I will process them ...
0
votes
2answers
267 views

Compare large directories recursively - but ignoring sub-directories - compare two backups - with gui

I've got 2 very old Backups of a friends computer. They were simply copied into a folder each on an external Harddrive. Both are about 300GB in Size and the contents are very much alike but not ...
0
votes
0answers
29 views

Create duplicate files on 2 different locations?

tough to find information to my idea as people normally look forward to find and remove duplicates not vice versa. I have an application running to control a heating system. It uses a file based ...
1
vote
2answers
518 views

Using FSlint to find duplicates by file size only?

I'm trying to use fslint to find duplicates, but it takes forever hashing entire multi-gigabyte files. According to this website, I can compare by the following features: feature summary compare by ...
1
vote
0answers
648 views

Evaluate the similarity between two video files

I'm looking for a method that reliably gives me a "mathematical distance" of two videos from one another. Similar to how the Levenshtein distance can be used to get the distance from a ...
0
votes
1answer
73 views

Unzipped/zipped file search

How am I able to search for duplicate files that are zipped and unzipped, with the same name? I understand I can do the initial search with the below however, not sure how to pipe in some duplicate ...
0
votes
1answer
506 views

Duplicate Files in a directory

I Have duplicate file i need count of that files. Example: example.html example(1).html Output: i want the number of counts for example(1).htnl
-4
votes
1answer
175 views

A lot of duplicates…no fdupes,i want to make a script

No fdup please..I want to make a script. I have a lot of file duplicates,there are more than 200 I made ( is under construction ) a bash script which make md5sum on every file,then with uniq i put ...
19
votes
5answers
8k views

Finding duplicate files and replace them with symlinks

I'm trying to find a way to check inside a given directory for duplicate files (even with different names) and replace them with symlinks pointing to the first occurrence. I've tried with fdupes but ...
100
votes
9answers
70k views

Find duplicate files

Is it possible to find duplicate files on my disk which are bit to bit identical but have different file-names?
19
votes
7answers
13k views

case-insensitive search of duplicate file-names

I there a way to find all files in a directory with duplicate filenames, regardless of the casing (upper-case and/or lower-case)?
165
votes
19answers
56k views

Is there an easy way to replace duplicate files with hardlinks?

I'm looking for an easy way (a command or series of commands, probably involving find) to find duplicate files in two directories, and replace the files in one directory with hardlinks of the files in ...