How do I break a large, +4GB file into smaller files of about 500MB each.
And how do I re-assemble them again to get the original file?
You can use split and cat.
For example something like
$ split --bytes 500M --numeric-suffixes --suffix-length=3 foo foo.
(where the input filename is
foo and the last argument is the output prefix)
The same command with short options:
$ split -b 100k -d -a 3 foo foo.
The split commands generate pieces named:
For re-assembling the generated pieces again you can use e.g.:
$ cat foo.* > foo_2
(assuming that the shell sorts the results of shell globbing - and the number of parts does not exceed the system dependent limit of arguments)
You can compare the result via:
$ cmp foo foo_2 $ echo $?
(which should output 0)
Alternatively, you can use a combination of find/sort/xargs to re-assemble the pieces:
$ find -maxdepth 1 -type f -name 'foo.*' | sort | xargs cat > foo_3