Questions tagged [numeric-data]
The numeric-data tag has no usage guidance.
218
questions
0
votes
1answer
17 views
Rounding numbers of a CSV file, skipping the header
This question is a derivative of the https://askubuntu.com/questions/601149/is-there-a-command-to-round-decimal-numbers-in-txt-files, which was successfully solved by using:
perl -i -pe 's/(\d*\.\d*)/...
1
vote
4answers
146 views
Extracting numbers between two string patterns
I have a file with following type of expression in every line "Age=22 years and Height=6 feet", I want to extract Age and height numbers only.
I have tried
grep -oP '(?<=Age=)[^years]+' $...
3
votes
3answers
142 views
Calculating rates / 'derivative' with awk
awk newbie here.
Suppose I have two columns of data, and I want to calculate the rate of increase, given by delta(y)/delta(x). How would I do this in an awk script? What I've learnt so far only deals ...
2
votes
1answer
76 views
Testing if a string is a number
That should be easy, just use [[ "$var" =~ '^[1-9][0-9]*$' ]]. But I don't get the behavior I expect excepted with zsh. I don't control the machine where the script will be run, so portability along ...
4
votes
2answers
105 views
Numerical sorting of every column in a file individually using awk
I'm trying to numerically sort every column individually in a very large file. I need the command to be fast, so I'm trying to do it in an awk command.
Example Input:
1,4,2,7,4
9,2,1,1,1
3,9,9,2,2
5,...
4
votes
3answers
241 views
Number formatting and rounding issue with awk
I want to get the exact number when I try to find the average of a column of values.
For example, this is the column of input values:
1426044
1425486
1439480
1423677
1383676
1360088
1390745
1435123
...
1
vote
2answers
123 views
Sum of large numbers and print the result with all decimal points for the stated question when using awk arrays
I have a below input file which I need to split into multiple files based on the date in 3rd column. Basically all the same dated transactions should be splitted into particular dated file. Post ...
0
votes
4answers
53 views
Filling empty cells and making data type the same in a tab separated file
I am dealing with a tab separated file with nearly 200MM rows on Linux. In one the columns which contains binary values, I noticed the data type is not consistent and there is a large number of ...
2
votes
2answers
58 views
Delete duplicate lines in file without creating new file in ubuntu
I can't seem to find a command that lets me delete duplicates in my file without creating a new file and also preserving the order of the contents in my file.
Would there be another command besides ...
0
votes
2answers
37 views
Find max values within Column 1 range and print column2
I have a representative dataset
35.5259 327
35.526 326
35.526 325
35.5261 324
35.5262 323
35.5263 322
35.5264 321
35.5265 320
35.5266 319
35.5268 318
# ...
0
votes
2answers
53 views
How to replace a fix location in each line in a file
I have a file as below, how do I replace the $number (location 19-30) and (location 59-70) with its number in cents.
update: All fields are required to stay at the same fixed location.
input:
...
3
votes
3answers
177 views
How can I convert a float to ratio?
I would like to convert a float to a ratio or fraction.
Do we have the option to convert a float 1.778 to ratio as 16:9 or 16/9 in bash, in a fashion similar to Python's fractions module (Fraction(1....
-1
votes
1answer
107 views
Hexadecimal color codes grep regex in makefile
So I have a text file containing valid and invalid hexadecimal color codes. I want to be able to filter out the invalid codes and print just the valid ones. For a code to be valid it must have a hash ...
2
votes
2answers
37 views
Comparing two columns(numeric) in two different text files
I have two text files with space-delimited fields (03 fields) in Linux environment:
File1 : ram-service1.txt
RAM used Program
23500 kb firewalld
14780 kb tuned
10140 kb polkitd
5370 ...
1
vote
5answers
182 views
how to extract maximum and minimum value from column 1 and column 2
Dear all I have a big data file lets say file.dat, it contains two columns
e.g file.dat (showing few rows)
0.0000 -23.4334
0.0289 -23.4760
0.0578 -23.5187
0.0867 -23.5616
0....
1
vote
3answers
45 views
Converting base-6 number to base-2 (binary) using commands or a program
I have a base-6 number generated by rolling a physical six-sided dice and want to convert it into base-2 / binary.
Are there built-in commands or programs that can do that for me?
If not, what is ...
0
votes
1answer
40 views
regex (or other way) to find numbers followed by a space
I'm running the following
awk '$2 ~ /^[0-9]\s+/ {print($2)}' file >> file1
Not sure how to correct this to only select lines where digits are followed by a space?
-1
votes
2answers
53 views
How I can change 01 and 25 in 001 and 025 without change 125 in 0125?
I have a file like this
Thomas_4567_01
Luc_2344_125
Ann_5780_25
I would like an outpu like this
Thomas_4567_001
Luc_2344_125
Ann_5780_025
How I can change 01 and 25 in 001 and 025 without change ...
1
vote
5answers
117 views
sed/awk: replace numbers in a line after last occurance of '.'
I have the following tcpdump stream:
Current:
07:36:03.848461 IP 172.17.3.41.33101 > 172.17.3.43.17408: UDP, length 44
07:36:03.848463 IP 172.17.3.42.33101 > 172.17.3.43.17409: UDP, length 44
...
4
votes
2answers
71 views
Why does gawk (sometimes?) think 2.0e-318 > 2.0?
I am trying to find the maximum value of a column of data using gawk:
gawk 'BEGIN{max=0} {if($1>0+max) max=$1} END {print max}' dataset.dat
where dataset.dat looks like this:
2.0
2.0e-318
...
3
votes
2answers
107 views
Sort numerical column
I'm trying to sort a file based on a particular position but that does not work, here is the data and output.
~/scratch$ cat id_researchers_2018_sample
id - 884209 , researchers - 1
id - 896781 , ...
0
votes
5answers
103 views
Max, Mean, Min for range within column of data
I have data structured like this :-
X 43808873 A 14
X 43808874 G 7
X 43808875 T 15
X 43808876 A 13
X 43808877 T 4
X 43808878 C 13
X 43808879 T 11
X ...
-1
votes
1answer
33 views
sum the values of all occurrences parameters
we have the following file ,
in file we can see the same parameters names with their values
more file.txt
gg_ff_rr =56
gg_ff_rr =56
gg_ff_rr =52
jk_ll_tt=24
jk_ll_tt=24
jk_ll_tt=24
pl_pl_uu=10
...
1
vote
1answer
105 views
how to change color of text based on value?
I want to use cat to display a file content and changes the text color to red if the number is larger than 50.
Example:
cat file1
would give
1 33 56
the number 56 will be displayed in red ...
2
votes
2answers
163 views
How to get max, min, and mean from values in column 4
I have data structured like this
X 43808504 G 1 ^]. <
X 43808505 C 3 . 4
X 43808506 T 8 . ?
X 43808507 G 5 . C
I want to get the max (8), min (1), and ...
0
votes
1answer
121 views
Calculating average in awk based on several column conditions in csv
I currently have the following csv format, it's much larger but I've taken a chunk of it for now.
EV,"Houston","-7.0"
AB,"Boston","19.0"
OO,"Mystic","13.0"
AB,"Boston","-12.0"
EN,"New York City","9....
1
vote
3answers
57 views
Find the maximum value of Column3 and print the values of Column1 and 2 only
In Unix, I am trying to find a command that would find the maximum value in Column3 and print the corresponding values from Column2 and Column1 (but not from Column3) in a new file.
Column1 ...
1
vote
0answers
81 views
Read Data from raw devices [closed]
I have inserted a record on the table and I am trying to read the data using "STRINGS" command
SQL> insert into DATA values (7299974551,'HARIHARAN',4544676688992251);
1 row created.
I am able ...
0
votes
1answer
19 views
re-write column's values to obtain previous line's value if exceed number 1
I have a file containing the following list of numbers:
0.1131492
0.1231466
0.1327564
0.1017683
5.4356130
0.1360532
5.4258129
0.1433982
0.1124752
.
.
.
I would like to re-write this list of numbers ...
0
votes
1answer
104 views
Sort file by row and with scientific numbers
I have a file F.tsv with 13 columns, the last column (the 13th columns) looks like this:
2.1e-06
0.58
10
8.7e-22
0.0014
0.034
9.5
0.67
0.67
0.68
9.2
8.4e-22
9.7
I've tried sort -k 13 F.tsv but it ...
1
vote
5answers
2k views
Sum of even and odd numbers of odd and even lines
I would like to write a shell script program that gives the sum of even and odd numbers in a given file's odd and even lines.
I would like to use:
sed -n 2~2p
and
sed -n 1~2p
but I am not even ...
0
votes
1answer
61 views
Compare two lines using second columns
http://0-0.latam.corp.yahoo.com/ 6656
http://0-0.latam.corp.yahoo.com/nonEtAk 6670
http://1.avatar.yahoo.com/ ...
0
votes
3answers
59 views
how to read file line by line and delete the line have number less than 20% shell scripting
i need help.
i have this file
i want read it line by line with for loops and delete the line less than 20% the number will with list %CPU .
%CPU PID USER UID COMMAND %MEM
71 9136 ...
2
votes
3answers
110 views
Generates random numbers with 11 digits
I need a command that generates random numbers with 11 digits. How can this be done?
4
votes
4answers
343 views
How can I adjust nth number in a line?
File contents:
RANDOM TEXT num1=400 num2=15 RANDOM TEXT
RANDOM TEXT num1=300 num2=10 RANDOM TEXT
RANDOM TEXT num1=200 num2=5 RANDOM TEXT
I would like to subtract 5 for ...
0
votes
1answer
35 views
How to add an average at then end of a table of values
I've been teaching myself Linux for 3 months now and I'm using the grep command but I also want an average of all of my extracted values.
Command:
grep -o "201[1-4].[0-9][ -9]" file1.txt file2.txt ...
6
votes
2answers
216 views
AWK if number less than previous number, how to add previous number to current number, and from then on
Have a field with distance data from GoPro. Need to concat the files together but the distance starts at 0 on each new csv file as video files are of only a set duration.
So how would it be possible ...
0
votes
2answers
335 views
How to calculate max and min for each unique entry
I need to find the max and min of each entry in my file:
#subset of my file
NEUTRON 20.900103
PION- 0.215176
PION- 22.716532
NEUTRON 8.043279
PION+ 1.374297
PION- 0.313350
...
0
votes
1answer
50 views
awk rounding error using int() in connection with log()
For later formatting I need to calculate the logarithm, base 10. Fine so far:
$ awk 'BEGIN { print log(1000) / log(10) }'
3
$ awk 'BEGIN { print log(1001) / log(10) }'
3.00043
I need to kick the ...
13
votes
4answers
2k views
How to increment the value of a (decimal) variable (with leading zero) by +1?
I have a file in the name of Build.number with the content value 012 which I need to increment by +1.
So, I tried this
BN=$($cat Build.number)
BN=$(($BN+1))
echo $BN >Build.number
but here I am ...
1
vote
2answers
45 views
Replace single field numbers with double field numbers (1->01)
beginning with
male 9
male 11
male 9
male 1
female 4
female 13
male 14
sort -u -k1,1 -k2,2n
returns
female 13
female 4
male 1
male 11
male 14
male 9
male 9
how can I make these numbers show as ...
0
votes
2answers
39 views
Highest Columns Number Records Issue
Highest Columns Number Records Issue
I have a test.txt file with contents as follows:
1:2:3
123:5
34589:5:0
34567:8:7
781:9:09
Could you please help me getting the following output from that test....
0
votes
1answer
38 views
add multiple rows for a range of variable and condtional column to a file
I have a file with 4 columns. First two columns are for x and y position (in integers) and third, fourth column for an arbitrary field value.
1 1 0.5 1.2
1 2 1.7 2.3
1 3 2.0 2.2
2 1 1.4 2.5
2 2 1.6 ...
1
vote
2answers
102 views
get count with grep
im working on sun10 Solaris os,i have a process that returns table as by using this command dmh -q 12 the below:
*PROFILE PRIORITY COMM_TYPE QID # OF MSGS ATTRIBUTES/VALUES*
13 ...
-3
votes
1answer
36 views
Adding a sequence of one hundred numbers to a starting number
If I have file like this:
1
19
24
119
201
230
... then I want output like this:
1 2 3 4 .........100
19 20 21 22 .......119
24 25 26 ...........124
119 120 121 .......219
201 ...
0
votes
3answers
168 views
multiply specific column in a file which consists of thousands columns
The in file looks like this
-17.3644 0.00000000 0.00000000 ....
-17.2703 0.00000000 0.00000000 ....
-17.1761 0.00000000 0.00000000 ....
-16.5173 0.00000000 0....
4
votes
3answers
713 views
Print all lines that don't have numbers, using sed
I need to print all the lines containing non numeric characters using regex in sed.
The input is a csv, and some of it's lines has text and numbers. I'm interested in printing only those without ...
-6
votes
2answers
105 views
How to check if integer value is less or more then 3
We have two values
$a
$b
we need to compare the $a value with $b value
in case $b value is less than ($a - 3) or more than ($a + 3), then it will print fail.
example:
a=10
b=14
then it should ...
0
votes
3answers
373 views
Replace and increment a line in bash
How can I read, increment and replace a value in a file?
foo="val"
ver="1.2.0001"
...
Now I would like to increment the "0001" to 0002".
0
votes
2answers
70 views
How to always print an output with certain number of digits using AWK
I have the following command:
find . -mtime -5 -type f -exec ls -ltr {} \; | awk '{print "cp -p "$9" "$7}'
the output is like:
cp -p ./18587_96xxdata.txt 10
cp -p ./16947_96xxdata.txt 8
cp -p ./...
