Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [merge]

Merging is the operation of taking two or more source contents to produce a single one. Things that are commonly merged are files (source code, configuration, etc.), branches in a version control system, redundant entries in databases, etc.

1
vote
1answer
18 views

How can I merge two sorted named pipes with uneven sizes?

My question is similar to "Merge two sorted files based on sorting values in the same field" but extending it to named pipes. Say I have two text files with sorted integers and I want to merge them. ...
0
votes
0answers
17 views

Centralized application logging that combines matching log lines to a single output [migrated]

We have a solution where we have multiple data centers and per data center we have multiple servers with the same application. The application is handling stateless traffic and produces a lot of ...
1
vote
0answers
56 views

How do I merge identically named files?

My question is similar to this one but the answers don't address how I would like to solve it in my case: Background: I have two computers generating experimental results that are filed in ...
1
vote
2answers
34 views

Merging csv files with Key columns

I need to write a shell script to merge csv files. Both the files have same columns with fixed number of columns designated as "Keys". If the Keys are same, then I want to merge them by adding the non ...
1
vote
2answers
42 views

Merging two files using matching characters

File1: X X P X N X Q File2: P 1 N 5 Q 0 Desired output: X 0 X 0 P 1 X 0 N 5 X 0 Q 0 I have tried a lot of ways using merge command on bash. I couldn't make it work.
1
vote
0answers
29 views

merge commands for line-by-line interactive merging with sdiff, in MacOS unix. Is there a working version?

On MacOS, the sdiff command is described as able to do line-by-line interactive merging, and lists several merge commands for the latest chunk. e.g. sdiff -o mergefile fileleft fileright The single ...
0
votes
0answers
13 views

Merge multiple files with different extensions using a loop in bash script [duplicate]

I have 100's of files of the form filename.0 filename.1 filename.2 filename.3 And they all have identical layouts which I want to merge together into one file using a loop in my bash script, I have ...
5
votes
1answer
181 views

Command-line diff tool

So we all have the diff command installed by default. I certainly don't know how to use it well. But I would expect some reasonable default usage. But when I type diff file1 file2 I get ... a text ... ...
0
votes
1answer
127 views

Merging PDF files with similar names

I have a folder populated with PDF files in this format: SI-T-xxxxxx.pdf SI-T-xxxxxx-sol.pdf SI-T-yyyyyy.pdf SI-T-yyyyyy-sol.pdf and so forth, with the middle part being digits. I want a way for ...
4
votes
3answers
220 views

How to merge pre-sorted files into a single BIG file, without excessive memory or temporary disk use

I'm trying to sort (and ideally remove duplicate lines) from a 1.4TB file. Splitting and sorting the individual chunks is not an issue, but reassembling them is turning out to be a challenge. I ...
2
votes
1answer
52 views

Does sort --unique -k drop duplicates in original order?

I'm doing a unique sort on a concatenated set of index files where the first column will sometimes change between each index and the second column will be a key value (actually hex addresses). Each ...
1
vote
2answers
636 views

Joining two csv files on common column and removing the second last column

I have two csv files: file1: C1, 1, 0, 1, 0, 1 C2, 1, 0, 1, 1, 0 C3, 0, 0, 1, 1, 0 file2: C3, 1.2 C1, 2.3 C2, 1.8 I want to merge these two files based on C column (which produces): C1, 1, 0, 1, ...
0
votes
2answers
57 views

Joining two space-separated files based on matching values in two different columns

I have tried various solutions given in this site for this kind of problem and none of these are helping me out. I have two files (space-separated, contains columns). Both the files contain the same ...
1
vote
3answers
93 views

Merging in Unix

I have a CSV file with vertical bars (|) as the delimiter, like below, for which I need to apply merging technique in Unix. The file contains hundreds of thousands of records (four fields), but I gave ...
1
vote
2answers
43 views

How to merge different columns in the same file?

I have three files, as shown below: FILE 1: DATE PGTO_CRED 20180801 50.00 20180802 150.00 20180803 130.00 20180804 110.00 20180805 200.00 FILE 2: DATE PGTO_TOTAL 20180801 ...
1
vote
1answer
221 views

Awk for merging multiple files with common column

I have a question concerning awk command in unix to merge multiple tables with a common value Tab1 Geneid Chr Start End Strand Length Sample_1 ENSG00000278267 1 17369 17436 - 68 0 ...
2
votes
2answers
60 views

Fetching, merging and exporting data from CURL

Before anything else, english isn't my laguage. I'll try to be understandable :-) Second, I am not a regular Linux user, I'm just starting out. I'm using curl and the API of a web chat platform to ...
0
votes
0answers
81 views

Merge fdf file into pdf (output of skim pdf for OS X)

The skim PDF viewer for OS X saves its annotations as .fdf files. Is there any way to merge these into a common pdf document? The closest that might have worked is pdftk: pdftk doc.pdf fill_form ...
0
votes
1answer
40 views

merging files with the same 1 column

I have multiple files named p1.bbmap.mapping.csv, p2.bbmap.mapping.csv, p3.bbmap.mapping.csv ... p3.bbmap.mapping.csv Each file has two columns. p1_60_length_504_cov_1.580902 12 ...
0
votes
3answers
2k views

How to concatenate files from different sub-directories?

I have a large folder containing many sub-directories each holding many .txt files. I want to concatenate all of these files into one .txt file. I am able to do it for each of the sub-directories with ...
1
vote
1answer
116 views

Git not creating merge commit when merging signed/annotated tag

I'm expecting Git to create a merge commit when I merge a signed or annotated tag but instead it fast-forwards the branch pointer. I'm using Git version 2.17.0 on openSUSE Tumbleweed that comes with ...
0
votes
1answer
273 views

Mount and merge folder contents

Is there any way to mount a folder content inside to another one? Let's say I have 2 folders with following content; Folder1 Folder2 file1 file2 I basically want to make visible all ...
0
votes
1answer
676 views

How to merge two gz files into new outputfile with specific name

I have 96 *fastqc.gz raw read files from 24 samples. Each sample was sequenced on two lanees for each pair. I would like to merge reads for each pair from both lanes into one output file with same ...
1
vote
0answers
207 views

socat to merge TCP streams

I'm trying to merge 2 TCP streams into one and then send the result outside through a TCP port server. The first part is Ok, I'm able to capture incoming streams as below: STREAM1: socat TCP:127.0.0....
0
votes
1answer
40 views

simple merge of CSV file

I want to merge two CSV without any condition and no primary.It should be first row file1 and file2. file1 id,name,city file2 mobileno,address,email output id,name,city,mobileno,address,,...
0
votes
3answers
852 views

Combine multiple .csv files with different lengths in a single one

I have a similar problem as Merging contents of multiple .csv files into single .csv file but for different length of csv files. What should I add to the perl script in this answer, in order to ...
0
votes
1answer
61 views

Merging columns from 200+ big files into one table

I have 200+ large files that all have exactly 1 column and 76M rows. I want to start a newfile.txt and slap the columns next to each other (match Line 1 of File 1 with Line 1 of File 2... and continue ...
1
vote
2answers
318 views

How to merge two /etc/group files

I have two files in style of /etc/group : root:x:0: daemon:x:1: bin:x:2: sys:x:3: adm:x:4:username tty:x:5: disk:x:6: lp:x:7: mail:x:8: news:x:9: ubuntu:x:999: And I want to merge them into a third ...
2
votes
3answers
84 views

Merge columns and add

I have a file with the following content (there are additional spaces to pad the first column) 1 account1 192.168.0.1 1 account1 192.168.0.2 19 account2 192.168.0.1 100 account3 192.168....
0
votes
2answers
89 views

Interleave seven fastQ files

I have 7 FastQ files and I want to merge them into one in the following way: File1 line1 File1 line2 File1 line3 File1 line4 File2 line1 File2 line2 File2 line3 File2 line4 File3 line1 File3 line2 ...
2
votes
3answers
4k views

scp remote file and append to local file

I have multiple files to be pulled from remote server. For further processing of the files in the local server, I need to merge (concatenate) them into single file, which can't be done in the remote ...
0
votes
0answers
619 views

Merge/combine two monitors into one desktop

I'm running Arch Linux on a PC with a ATI HD 5870, using the open source driver. I have two HD-monitors and I want to "merge" these screens into one large desktop (3840x1080), so I can run a ...
1
vote
2answers
364 views

How to merge two files with different lengths and columns linux

I have 2 files with different columns and length and I want to merge them as desired output file given below, Please Help!!! File 1 aa bb cc dd File 2 ff , 2 , tg12 dd , 3 , tg13 gg , 4 , tg14 hh ,...
3
votes
1answer
118 views

merging files in a one dataframe

I have almost 160 txt files, each file has 7 columns and now i want to put that in one file. Each files 1st and 6th column data (Geneid, Length) is same so i just want that to be the 1st and 2nd ...
4
votes
1answer
2k views

Join two files based on a column

file1: a, 1 b, 5 c, 2 f, 7 file2: a, 2 f, 9 g, 3 I want to join file 1 and file 2 based on column 1 and get file 3 as below. file3: a, 1, 2 b, 5, - c, 2, - f, 7, ...
2
votes
1answer
2k views

concatenating multiple fastq files

I have a folder with almost 100 files, organized in groups of 16 files each. I need to concatenate each of the 16 files of each group into a single file. For example, one group of file names is: ...
0
votes
1answer
33 views

Merging Directories Based on their Suffix

I have a directory structure produced during archiving. The archiving system can't be changed. Whenever a duplicate directory occurs the archiver appends an integer suffix to the directory name. My ...
3
votes
1answer
128 views

Merge 2 huge files matching multiple columns and preserving the order (print matching and non-matching values) - scale up from awk

I'm having trouble with merging data from 2 files. It is genetic data with chromosome, position, reference and alternate alleles and I need to merge the files by matching all 4 of those columns - with ...
1
vote
0answers
446 views

Merge two videos using FFMPEG side by side without black portion on top and bottom

I have two video files of size 360X406 each, I want to merge them side by side to size 720X406. However the below command generating the video output of size 720X406 but its resolution look different ...
1
vote
1answer
125 views

Join two tables based on non-sharing values in chosen column

I have been using "Perl for biologists with little computer coding knowledge" from site called Scriptome (Harvard). It gives great Perl one-liners to achieve desired functions which runs on Unix ...
0
votes
2answers
543 views

Multiple files with no header to merge with one header

I have 58 files named as xaa.csv to xcf.csv, none of them have headers. I have a separate file with the header. How can I merge the files with the header and have 59 outputs merged? For example: ...
8
votes
0answers
1k views

Merge pdf files and automatically create a table of contents with each file as an entry

I have several pdf files (chapter1.pdf, chapter2.pdf, etc.), each one being a chapter of a book. I now how to merge them into a single pdf (I use the command pdfunite from poppler), but since the ...
1
vote
2answers
553 views

How to merge duplicate lines into one line separate by comma

I have the following data: St1 apt1 St1 apt2 St2 apt5 St3 apt6 St3 apt7 St3 apt8 I would like to merge the duplicate lines and separate the fields by comma and have 2 columns, for example: St1 apt1,...
-2
votes
1answer
97 views

Merging 2 file vertically sorted

I want to merge two files of desired output. File 1 example as below: LOCATION 0 X 0 VALUE 1 2 3 VALUE 1 2 3 VALUE 1 2 3 LOCATION 1 X 0 VALUE 1 2 3 VALUE 1 2 3 VALUE 1 2 3 LOCATION 2 X 0 VALUE 1 2 3 ...
0
votes
3answers
854 views

How to merge two csv files with common but differently ordered headers?

I have multiple files (>150) with multiple columns (>150). Most of the headers are common but occur in different order (as eg below): File 1: Col1 Col2 Col3 Col4 Col5 A B C D E File 2: ...
1
vote
2answers
3k views

Merge three .gif animations

I have 3 .gifs animations and I just want to merge them temporally. Say g1.gif contains images 1,2,3 sequenced as so g2.gif contains images 4,5,6 sequenced as so g3.gif contains images 7,8,9 ...
0
votes
1answer
138 views

rsync and cp producing different results

I was upgrading ModX today and tried to merge the new installation with the existing copy on my server. On their site ModX says to "merge directories", which I assume means to recursively copy every ...
1
vote
0answers
46 views

Restoring Maildir emails from backup on different machine (so filename conventions differ)

I have GMail synced via IMAP using offlineimap on Machine A and Machine B. I accidentally deleted 5000 messages when trying to sync Machine B. Machine A was off at the time, and so I still have ...
0
votes
1answer
178 views

What is the name of the default git mergetool?

I'm wondering what the name of the default git mergetool on my linux server is?
1
vote
2answers
417 views

how to concatenate next line when condition is true awk

I'm using awk to edit a text file that looks like this : Device_ID Local Intrfce CS_Quimicas_Alim Gig 3/13 computacion_seg_23 Gig 3/14 158 T S MAUSALUD_B Gig 1/40 MULTIAULAS_PRINCIPAL Gig 3/22 173 S ...