I have 200 text files. Each text file contains one column of mathematical numbers (100k rows).
I want to do some statistical processing on these data (finding the probit or quantile). I know the mean and sigma value associated for each file. Is there any direct way to calculate probit or quantile of a dataset?
If not, then I know the formula for quantile which is =(sorted data-mean)/sigma. e.g.
12.2 10.11 15.55 5.01 ... ... 12.9
5.01 10.11 12.2 12.9 15.55 ... ...
Final output file should contain two columns. First column is same as
temp_output.txt and second column is the following mathematical function on each element:
Where mean and sigma are two mathematical number say 10.1 and 2.02 respectively. Final output file should look like this for above values
5.01 -2.51980198 10.11 0.004950495 12.2 1.03960396 12.9 1.386138614 15.55 2.698019802 ... ...