Questions tagged [merge]

Merging is the operation of taking two or more source contents to produce a single one. Things that are commonly merged are files (source code, configuration, etc.), branches in a version control system, redundant entries in databases, etc.

Filter by
Sorted by
Tagged with
0
votes
1answer
54 views

Merging two files based on a common column; add 0 for variants not present in file 2, and keep the original value in those which are present

I would like to merge two files, which share some common data. File 1 includes more than file 2. I want to merge the files based on their shared column (3) following the order of file 1 and I want to ...
1
vote
1answer
43 views

merging two files according to a common column and add 0 to those which are not present in file 2

I would like to merge two files, which share some common data. File 1 includes more than file 2. I want to merge the files based on their shared column following the order of file 1 and I want to add ...
1
vote
1answer
19 views

Merge sort and extract new uniques?

I found a post that answers how to merge sort and remove duplicates. I'm interested in expanding on this and extracting new unique entries from the post-merged file. What would be the command to do so?...
2
votes
2answers
49 views

Is there any git option to automatically merge commits from master branch into a feature branch?

I have a feature branch in git that needs to be up to date with the master branch at all times. Is there any way to automatize this in git? I basically want on every commit in master branch a merge ...
0
votes
0answers
10 views

Emulate diff3 (git-style file merges) with busybox

GNU diff3 allows git-style potentially conflicting file merges Busybox does not support diff3, but instead supports diff and patch Is it possible to emulate diff3 result somehow? Context: I am looking ...
0
votes
1answer
43 views

How to merge multiple files which are not in order and assign the name of file to a specific column in linux?

I have around 250 .gtf files. Here I'm showing 3 .gtf files. All the .gtf files have three columns that look like below: TUSCC120A.gtf TUSCC36.gtf TUSCC89B.gtf TUSCC120A.gtf looks like below: ...
3
votes
2answers
78 views

merging 5 million files efficiently

Due to some poor planning i have a directory containing > 5 million files totalling roughly 20GB. Each file contains 32 lines of garbage at the top followed by an unknown number of lines of ...
1
vote
1answer
58 views

merging data of two data sets

I am attempting to merge two datasets..... File 1 is a single column JDay list 1 to 366 File 2 has 3 columns 2002 1 9.5938 2002 2 9.5938 2002 3 -28672.0000 2002 5 -28672.0000 At times there is ...
1
vote
1answer
485 views

sort multiple files and merge

I want to sort several text files in reverse order and then merge/cat to one single text file. a.txt 0 33.1 2 33.0 10 21.1 20 21.8 b.txt 0 30.1 2 33.0 10 28.1 20 27.8 and so on *.txt ...
0
votes
1answer
57 views

Merge two txt files into one using AWK and add missing items

my goal is merge this two files into one, read first if first item is present in second file update it, if not just copy first file a.txt AAA;2020-09-01;Y BBB;2020-09-01;Y CCC;2020-09-01;Y second ...
-1
votes
1answer
43 views

Concatenate each two files with awk

I have several files like this BR1.txt NH1.csv BR2.txt NH2.csv BR3.txt NH3.csv and I want to concatenate each BR with NH in one file.
2
votes
5answers
218 views

Using awk or sed to concatenate lines having a pattern

I essentially want to put the name of the query in front of each line containing the SourceField. I have tried this concatenation scheme awk '/<\^Query/ && p{print p;p=""}{p=p $0}...
1
vote
1answer
651 views

Merge two CSV files into one using AWK

I am trying to merge two csv files using AWK. If the 1st column in file 1 matches the 1st column in file 2 I want to change file1's 3rd column to the value of file2's 2nd column. If there is no match, ...
1
vote
0answers
54 views

Merge two directories with files in common

I have two directories that I need to merge: B (base), which is very large U (update), which is moderately sized and contains some modifications and additions to files in B Both B and U are updated ...
0
votes
2answers
93 views

Merge two columns of a gzipped file and replace the merged column with another column

I have a gzipped file which looks like this : 1 rs571093408 rs571093408 13380 C G I want to merge the first and fourth column with : inbetween and replace the second column with the new content, so ...
1
vote
1answer
971 views

ffmpeg merge multiple sets of 2 videos in for loop

I am still pretty new to linux and have been trying very hard at getting this right. Please help me to get this right. I am trying to merge 2 videos (1 from each folder) multiple times in like a ...
1
vote
2answers
79 views

Merge rows using common values in any column

I have a tab-delimited file like shown below, and would like to merge the rows based on matches in any of the columns. The number of columns are usually 2, but could vary in some cases and be 3. ...
0
votes
4answers
143 views

merge multiple txt files

I have multiple txt files, 3 of them are like: file1: sample input filtered 5809378 1 2 5811151 3 4 5811237 5 6 file2: sample chi tri 5809378 7 8 5811151 5811237 9 ...
0
votes
2answers
41 views

Merging files in a specific order of two different name lists

In one folder I have two sets of 6 files: first set: 1st-letter-00 - 1st-letter-05 second set: verse-00 - verse-05 How can I concatenate these two sets such that the result is one file that has all ...
1
vote
0answers
39 views

using rsync to move merge files into new directory fails to show progress or create backups

I have a bunch of old backups, each of which is a directory containing incremental changes from the previous backup. There are arbitrarily nested directories and files in each directory. I need to ...
1
vote
1answer
2k views

how to combine 2 arrays into one associative array

i need to combine ARRAY1 and ARRAY2 into an associative array like ARRAY. i'm using this code: mapfile -t ARRAY1 < <(/bin/awk '{ print $ 1 }' /output/gen_branch) mapfile -t ARRAY2 < <(...
0
votes
1answer
52 views

Combine the value of the variables into one with a new line after first variable

I have below two variables: $var1 which has value like ABC XYZ SDF and $var 2 which has value like SDF SGDGH hfg I want the output like ABC XYZ SDF SDF SGDGH hfg I have the below script and i ...
1
vote
2answers
1k views

How to JOIN two JSONs in environment variables?

I have environment variable, which contains JSON text. I want to add some data to it with jq tool. I want to keep all old fields but add and/or overwrite new ones. The idea is the same as with adding ...
0
votes
2answers
191 views

Merging strings as columns to create a table in bash

Consider the following strings: $ columnA="A1\nA2\nA3" $ columnB="B1\nB2\nB3" $ columnC="C1\nC2\nC3" Using Bash, how can I merge these so that I get another string with the following content: $ ...
0
votes
1answer
519 views

updating one file based on values in another with AWK

I have two files file1.csv (20 columns 410k rows) and data.csv (4 columns 1800 rows). What I am trying to do is if data.csv 1st column matches file1.csv 2nd column overwrite 1st column in file1.csv ...
0
votes
1answer
162 views

How to merge/join two file based on common field with repeated rows [duplicate]

I have 2 file: file1 SC 65.696 618 SC 61.92 625 KN 82.546 1037 KN 82.946 1032 KN 82.849 1032 CN 70.55 618 and file2 SC SC7 SCARE 588 2 75702 KN KN4 Kines ...
0
votes
1answer
48 views

copy-merge several folders contents, prioritizing newer files

I have few folders like this with their contents data/ -2011/ ---images/ ------logo.jpg ------banner.jpg ---reports/ ------monthly.pdf -2012/ ---images/ ------logo.jpg ---reports/ ------monthly.pdf -...
1
vote
1answer
131 views

How can I merge two sorted named pipes with uneven sizes?

My question is similar to "Merge two sorted files based on sorting values in the same field" but extending it to named pipes. Say I have two text files with sorted integers and I want to merge them. ...
1
vote
0answers
94 views

How do I merge identically named files?

My question is similar to this one but the answers don't address how I would like to solve it in my case: Background: I have two computers generating experimental results that are filed in ...
1
vote
2answers
450 views

Merging csv files with Key columns

I need to write a shell script to merge csv files. Both the files have same columns with fixed number of columns designated as "Keys". If the Keys are same, then I want to merge them by adding the non ...
1
vote
2answers
135 views

Merging two files using matching characters

File1: X X P X N X Q File2: P 1 N 5 Q 0 Desired output: X 0 X 0 P 1 X 0 N 5 X 0 Q 0 I have tried a lot of ways using merge command on bash. I couldn't make it work.
1
vote
0answers
190 views

merge commands for line-by-line interactive merging with sdiff, in MacOS unix. Is there a working version?

On MacOS, the sdiff command is described as able to do line-by-line interactive merging, and lists several merge commands for the latest chunk. e.g. sdiff -o mergefile fileleft fileright The single ...
0
votes
0answers
61 views

Merge multiple PDF files with different widths into one page

I have three PDF files containing the front page (firstpage.pdf), the last page (lastpage.pdf) and the spin (tranche.pdf) like this: (source: framapic.org) So, the goal is to concatenate the three ...
6
votes
1answer
2k views

Command-line diff tool

So we all have the diff command installed by default. I certainly don't know how to use it well. But I would expect some reasonable default usage. But when I type diff file1 file2 I get ... a text ... ...
0
votes
1answer
504 views

Merging PDF files with similar names

I have a folder populated with PDF files in this format: SI-T-xxxxxx.pdf SI-T-xxxxxx-sol.pdf SI-T-yyyyyy.pdf SI-T-yyyyyy-sol.pdf and so forth, with the middle part being digits. I want a way for ...
4
votes
4answers
907 views

How to merge pre-sorted files into a single BIG file, without excessive memory or temporary disk use

I'm trying to sort (and ideally remove duplicate lines) from a 1.4TB file. Splitting and sorting the individual chunks is not an issue, but reassembling them is turning out to be a challenge. I ...
2
votes
1answer
217 views

Does sort --unique -k drop duplicates in original order?

I'm doing a unique sort on a concatenated set of index files where the first column will sometimes change between each index and the second column will be a key value (actually hex addresses). Each ...
1
vote
2answers
2k views

Joining two csv files on common column and removing the second last column

I have two csv files: file1: C1, 1, 0, 1, 0, 1 C2, 1, 0, 1, 1, 0 C3, 0, 0, 1, 1, 0 file2: C3, 1.2 C1, 2.3 C2, 1.8 I want to merge these two files based on C column (which produces): C1, 1, 0, 1, ...
0
votes
2answers
68 views

Joining two space-separated files based on matching values in two different columns

I have tried various solutions given in this site for this kind of problem and none of these are helping me out. I have two files (space-separated, contains columns). Both the files contain the same ...
1
vote
3answers
100 views

Merging in Unix

I have a CSV file with vertical bars (|) as the delimiter, like below, for which I need to apply merging technique in Unix. The file contains hundreds of thousands of records (four fields), but I gave ...
1
vote
2answers
53 views

How to merge different columns in the same file?

I have three files, as shown below: FILE 1: DATE PGTO_CRED 20180801 50.00 20180802 150.00 20180803 130.00 20180804 110.00 20180805 200.00 FILE 2: DATE PGTO_TOTAL 20180801 ...
1
vote
1answer
1k views

Awk for merging multiple files with common column

I have a question concerning awk command in unix to merge multiple tables with a common value Tab1 Geneid Chr Start End Strand Length Sample_1 ENSG00000278267 1 17369 17436 - 68 0 ...
2
votes
2answers
190 views

Fetching, merging and exporting data from CURL

Before anything else, english isn't my laguage. I'll try to be understandable :-) Second, I am not a regular Linux user, I'm just starting out. I'm using curl and the API of a web chat platform to ...
0
votes
1answer
43 views

merging files with the same 1 column

I have multiple files named p1.bbmap.mapping.csv, p2.bbmap.mapping.csv, p3.bbmap.mapping.csv ... p3.bbmap.mapping.csv Each file has two columns. p1_60_length_504_cov_1.580902 12 ...
3
votes
3answers
9k views

How to concatenate files from different sub-directories?

I have a large folder containing many sub-directories each holding many .txt files. I want to concatenate all of these files into one .txt file. I am able to do it for each of the sub-directories with ...
2
votes
1answer
344 views

Git not creating merge commit when merging signed/annotated tag

I'm expecting Git to create a merge commit when I merge a signed or annotated tag but instead it fast-forwards the branch pointer. I'm using Git version 2.17.0 on openSUSE Tumbleweed that comes with ...
0
votes
1answer
558 views

Mount and merge folder contents

Is there any way to mount a folder content inside to another one? Let's say I have 2 folders with following content; Folder1 Folder2 file1 file2 I basically want to make visible all ...
0
votes
1answer
1k views

How to merge two gz files into new outputfile with specific name

I have 96 *fastqc.gz raw read files from 24 samples. Each sample was sequenced on two lanees for each pair. I would like to merge reads for each pair from both lanes into one output file with same ...
1
vote
0answers
488 views

socat to merge TCP streams

I'm trying to merge 2 TCP streams into one and then send the result outside through a TCP port server. The first part is Ok, I'm able to capture incoming streams as below: STREAM1: socat TCP:127.0.0....
0
votes
1answer
44 views

simple merge of CSV file

I want to merge two CSV without any condition and no primary.It should be first row file1 and file2. file1 id,name,city file2 mobileno,address,email output id,name,city,mobileno,address,,...