The tag has no wiki summary.

learn more… | top users | synonyms

7
votes
7answers
288 views

How to efficiently split up a large text file wihout splitting multiline records?

I have a big text file (~50Gb when gz'ed). The file contains 4*N lines or N records; that is every record consists of 4 lines. I would like to split this file into 4 smaller files each sized roughly ...
1
vote
2answers
25 views

Why doesn't GNU Screen split show up for remote user?

I have a screen session running on my local machine: ~/test@example.com$screen -S pair Then, turn on multiuser: ctrl-a:multiuser on Finally, allow the user pair to connect to the session: ...
2
votes
4answers
191 views

Need to print the matching lines in different file

Eg: I have data like this 1111111 test1 test2 test3 1111111 block 1 block 2 block 3 1111111 page1 page2 page3 I would like to print the content as different files as bellow. Test1 - File 1111111 ...
3
votes
1answer
124 views

What does `{\} {}` mean in `find` command?

Please explain this command in detail. I am using this command to find large files above 6 MB and split them into 5 MB chunks in the same folder. Then it removes the original files (larger than 6MB) ...
0
votes
1answer
49 views

Splitting a file using perl

I have a csv file and like to split the file into smaller files based on column matching in the file using perl. I am new to perl. I am working on Linux Rhel6. example: fruit1, ...
2
votes
3answers
118 views

Split binary data of fixed byte offset by byte position?

I have binary data which I review by xxd -ps in hex format. I notice that the byte distance is 48300 (=805*60) bytes between two headers where the separator is fafafafa. There is the beginning of ...
0
votes
0answers
47 views

Which version of split support flag -p?

Code which does not work in GNU Coreutils Split, Split of Cern Linux 5 (Redhat) and BSD (Apple Yosemite 10.10.3): split -p'\0' input.txt where input.txt is masi\0hello\0world. Some versions I do ...
0
votes
2answers
32 views

CentOS 6 Partitioning Root Drive

I have recently installed CentOS (into a machine with only one hard drive) and I would like to know how to Partition the main hard drive into two. As it is a fresh install there is no data to lose ...
5
votes
6answers
538 views

split file into two parts, at a pattern

How to split a large file into two parts, at a pattern? Given an example file.txt: ABC EFG XYZ HIJ KNL I want to split this file at XYZ such that file1 contains lines up-to XYZ and rest of the ...
1
vote
4answers
391 views

Split a file into two

I have a big file and need to split into two files. Suppose in the first file the 1000 lines should be selected and put into another file and delete those lines in the first file. I tried using split ...
2
votes
2answers
105 views

What are the differences between split and rar?

I am used to raring files -- but I am looking for something faster. I see that there is a "split" command. How does this command compare to rar? What is are the differences between split and rar?
6
votes
1answer
378 views

Zip Archive With Limited Number of Files

What command can I use to create zips with a file number limit? I have a folder (no subfolders) of, say, 5000 files, so I would want a command that could divide that number and create 10 individual ...
1
vote
1answer
65 views

splitting an image into multiple pieces

I have an image as below. It is 2579*2388 pixels. Lets assume that it's bottom left corner is at 0,0. From that image I want to create multiple images as follows and save them in the working folder. ...
4
votes
4answers
1k views

Using GNU Parallel With Split

I'm loading a pretty gigantic file to a postgresql database. To do this I first use split in the file to get smaller files (30Gb each) and then I load each smaller file to the database using GNU ...
4
votes
4answers
825 views

Split single string into character array using ONLY bash

I want to split 'hello' into h e l l o in an array using only bash, I could do it in sed with sed 's/./& /g' but I want to know how to split a string into an array in Bash when I do not know what ...
2
votes
1answer
77 views

How to split file and save parts to multiple locations?

How do I split a large file into multiple smaller chunks and write each part of it into separate locations? split command seems to only output all the files into one location. The context I need to ...
0
votes
1answer
42 views

VIM switching between split buffers

i tried to split a vim in 2 buffers with 2 different files vim file1.txt :sp file2.txt but ctrl + w is not working to switch between them. giving below error E486: Pattern not found: ...
0
votes
1answer
53 views

How should I split a string with no spaces in vim script?

How should I split a string with no spaces in vim script? All the options which I see are to split a string with spaces. I even tried split(string_name) without a delimiter , but it doesn't work.
0
votes
2answers
56 views

Cut a string up to a certain character [closed]

I've searched the site and I've seen similar questions but I couldn't get them to work. I tried to follow: Splitting a string up to a specific location but it didn't work. I working with Korn. I ...
1
vote
1answer
32 views

file (vdi) increase (at double) size after split and then cat operation

I'd splitted a vdi file with 7 gigabytes and then joined with cat command. The file works normally on VBox, but get 14 gigabytes after be re-joined. The exact operation was: $ split -- bytes=2000M ...
3
votes
0answers
92 views

Splitting ddrescue output image into 2 files

My ext4 disk crashed and I'm using ddrescue to try to rescue it. However the crashed disk is 3tb, and I only have another 3tb drive for the image file. I assumed that this image file will be too big ...
7
votes
4answers
14k views

Split a file by line and have control over resulting files extension

There is a standard command for file splitting - split. For example, if I want to split a words file in several chunks of 10000 lines, I can use: split -dl 10000 words wrd and it would generate ...
1
vote
1answer
86 views

split line based on space and delete the second part

I have a big file >fid|29290408|locus|VBIEntCas2262_0001| Phosphoglycolate phosphatase (EC 3.1.3.18) [Enterococcus casseliflavus EC20] ...
0
votes
1answer
71 views

Tar Create and Split files into subdir

I have this command: tar -cf - input/* | split --bytes=1m Which splits my huge gz files into small ones. This works fine. However I want the output (the small files) to be created in the input/ ...
29
votes
4answers
31k views

What's the best way to join files again after splitting them?

If I have a large file and need to split it into 100 megabyte chunks I will do split -b 100m myImage.iso That usually give me something like xaa xab xac xad And to get them back together I have ...
8
votes
3answers
2k views

Split: how to split into different percentages?

How can I split a text file into 70% and 30% using the split command ?
3
votes
0answers
78 views

screen & xterm: how to select text with the mouse in one only pane when window is divided vertically

Interestingly enough, this has also been a tmux issue for some: http://daemonforums.org/showthread.php?t=7311 But currently I am sticking to screen, and I'd like to know how I can make screen ...
6
votes
4answers
508 views

How to split text between separator into multiple files?

I have a text file contaning the following: "random textA" "random random textB" The separator is " How can I split the containt into multiple file as follow using a bash command? File 1 : ...
2
votes
1answer
849 views

Can I split a avi file into 2 valid (watchable) files with only standard unix commands?

The question is self explanatory. I have a very big movie file, I want to split it in 2. How can I do this?
3
votes
2answers
771 views

How to split an image vertically using the comand line?

So, say I have a large 800x5000 image, how would I split that into 5 separate images with dimensions 800x1000 using the command line?
3
votes
1answer
219 views

Split input file into X parts of size total lines / X

Currently, my bash script splits by number of lines. However, I'd like to split a file into X pieces, each of those having total lines equal to the file length divided by X. The script is run as ...
1
vote
1answer
699 views

Split very big xml file into little pieces with specific line number count

This is how I did to extract the first 100000 lines from my big xml file (2gb): head source.xml -n 100000 > part.xml How can I keep splitting them to 100000 line (or specific file size chunks) ...
21
votes
2answers
11k views

Break a large file into smaller pieces

How do I break a large, +4GB file into smaller files of about 500MB each. And how do I re-assemble them again to get the original file?
3
votes
3answers
2k views

Split the lines of a text file into separate files

I have a text file that looks something like this: foo bar zip rar tar I need to use a bash script on OSX to make a new text file after every new line like this: cat text1.txt foo cat text2.txt ...
5
votes
2answers
91 views

How to wait for execution of parallelized processes and stitch together the outputs?

Quite new to doing things on Unix, looking to make a script that does the following things in order: Take main .tsv file, split into X number of files with Y lines each Run each split file through a ...
1
vote
4answers
378 views

How to split a line by multiple characters?

Output of w | head -1 can give 2 different results for my machine: 16:34:42 up 32 days, 3:02, 1 user, load average: 0.14, 0.11, 0.07 14:10:55 up 32 days, 39 min, 1 user, load average: 0.07, 0.13, ...
1
vote
4answers
226 views

How to split text file into records by first non-blank charecter using awk and print only records containing string

I have a text file with information separated in blocks. I would like to separate these blocks into records so that I can handle them separately. This is my text file (file.txt): Alarm Stats: ...
17
votes
4answers
55k views

Splitting string by the first occurrence of a delimiter

I have a string in the next format id;some text here with possible ; inside and want to split it to 2 strings by first occurrence of the ;. So, it should be: id and some text here with possible ; ...
-1
votes
3answers
101 views

Split a file into multiple based on selected lines [duplicate]

I have a file in which more than 50,000 lines are there. How can I split the file into two or more based on the selected lines? Suppose I want to split a file from line 10,000 to line 40,000.
1
vote
2answers
99 views

Specifying height for vertical splits in vim

Usually I am editing two files, A and B, split horizontally. I set it up, so that one buffer would only occupy the first 2 lines at the top of the screen, and the rest is for the other buffer. ...
1
vote
1answer
5k views

FFmpeg - Split video multiple parts

I read the following thread, and the solution works if I want to split a video into pieces every two minutes: Split video file into pieces with ffmpeg The problem is that I want to split a video into ...
3
votes
2answers
332 views

Script using “split” in a loop over large files

I'm attempting to get a bash script working, and running into terrible errors along the way. The aim of the script is to break several large text files, into multiple files with a line count read from ...
0
votes
2answers
763 views

Split large txt file into certain small file

I have a txt file which is formatted as 250,000 * 3600 (3600 rows and 250,000 column) I am going to split it into 3600 small txt which each file is 250,000 * 1. I understand the split can basically ...
3
votes
2answers
510 views

split a file, pass each piece as a param to a script, run each script in parallel

I have a words.txt with 10000 words (one to a line). I have 5,000 documents. I want to see which documents contain which of those words (with a regex pattern around the word). I have a script.sh that ...
4
votes
6answers
2k views

How can I split a large text file into chunks of 500 words or so?

I know there's the command split which can split a file into several chunks based on file size, and then there's the command wc which can count words. I just don't know how to use the two together.
1
vote
0answers
117 views

How do I convert a TTA file and its CUE sheet into several FLAC files?

I have a sound file encoded in TTA format and a CUE sheet with its metadata. Which tools and commands do I need to convert it and split it into several FLAC files? I tried using ffmpeg to convert the ...
6
votes
4answers
3k views

Split PDF into documents with several pages each

There are several resources on the web explaining how one can split a PDF into many files with on page per file. But how can you split them into chunks of, say, five pages each? I have looked into ...
4
votes
3answers
2k views

Splitting a large binary file into sections determined by context patterns

I have a large (2GB) file that looks like this: ^%%-=-=-=-=-=-=-=-=-=-=-=-=-=-%%^ <binary data> ^%%-=-=-=-=-=-=-=-=-=-=-=-=-=-%%^ <binary data> ^%%-=-=-=-=-=-=-=-=-=-=-=-=-=-%%^ ...
6
votes
6answers
1k views

Split large file into chunks without splitting entry

I have a rather large .msg file formatted in the UIEE format. $ wc -l big_db.msg 8726593 big_db.msg Essentially, the file is made up of entries of various length that look something like this: ...
1
vote
2answers
494 views

printing special characters in awk output

I have a large file that contains lot MQ messages with RFH2 header. Each message in the file is separated by a blank line. Now I need to split this large file into small files each containing single ...