I have 200 text files. Each text file contains one column of mathematical numbers (100k rows).
I want to do some statistical processing on these data (finding the probit or quantile). I know the mean and sigma value associated for each file. Is there any direct way to calculate probit or quantile of a dataset?
If not, then I know the formula for quantile which is =(sorted data-mean)/sigma. e.g.
input_file.txt
12.2
10.11
15.55
5.01
...
...
12.9
temp.txt
5.01
10.11
12.2
12.9
15.55
...
...
Final output file should contain two columns. First column is same as temp_output.txt
and second column is the following mathematical function on each element:
= (row(i)-mean)/sigma
Where mean and sigma are two mathematical number say 10.1 and 2.02 respectively. Final output file should look like this for above values
output.txt
5.01 -2.51980198
10.11 0.004950495
12.2 1.03960396
12.9 1.386138614
15.55 2.698019802
...
...