Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange
The results are in! See what nearly 90,000 developers picked as their most loved, dreaded, and desired coding languages and more in the 2019 Developer Survey.

Questions tagged [statistics]

The tag has no usage guidance.

-1
votes
1answer
19 views

How do I check how much RAM a process consumes like the way `time` is used to measure the elapsed time?

How do I check the maximum amount a RAM a process uses similar to how time works? $ time mvn package real 0m35.796s user 0m32.925s sys 0m1.559s $ maxmem mvn package 688 MB
0
votes
2answers
84 views

Summary statistics in shell script

I have multiple files (records) across multiple directories. Each record lies in its own path based on the date it was created. Eg a record on 12 Nov 2016 is ~/records/2016/11/12/record. In each ...
0
votes
0answers
33 views

measuring ppp traffic with ifstat

I've established a ppp link with 2 Linux machines. The speed is set to 9600. Traffic is going one way, i.e. from Machine 1 to Machine 2. However when I run ifstat -btwTWS -i ppp0 on Machine 2, I'm ...
0
votes
1answer
94 views

How to log quantities of IP traffic by src/dst (and port for UDP & TCP)?

How can I log quantities of IP traffic by src/dst (and port for UDP & TCP)? For each interval (probably each hour) I would like to see something like: proto, src, dst, packets, octets ICMP, 192....
0
votes
1answer
212 views

Calculating the IOPS using Bandwidth

I have the write Bandwidth value received from the system and I need to calculate the write IOPS using the BW, Bandwidth = amount of data / second http://rickardnobel.se/storage-performance-iops-...
2
votes
2answers
374 views

Is there a way to find out the estimate of Linux kernel version usage in the world?

Currently I am writing my bachelor thesis and as a part of it I need some statistics about the Linux kernel. Is there any website or publication that would provide some estimates on which kernel ...
1
vote
1answer
68 views

Network I/O and Disk I/O without installing anything or using third parties libraries

I can't find anything on how can I get the network I/O and disk I/O without installing any libraries on my server. I tried with this for the disk I/O: cut -d" " -f 1,2,42 /proc/*/stat | sort -n -k +...
1
vote
2answers
3k views

What does /proc/loadavg ' s “CPU and IO utilization” mean?

In this page, it says that the first three columns of the output of /proc/loadavg measure CPU and IO utilization of the last one, five, and 10 minute periods. Does a single value reveal both CPU and ...
0
votes
1answer
59 views

How to see the current routed connections?

I'm running a router that is using linux; I want to see connection statistics from internal network to external network(s) (NAT router); how do I do this? I've tried using netstat but of course its ...
1
vote
1answer
230 views

Open ZFS : Recently Used/Frequently Used statistics persistence

ZFS cache data into ARC using two information : Recently Used Cache Frequently Used Cache Does ZFS keep this file/metadata statistic somewhere, or does it just do with what has been used since power ...
1
vote
1answer
433 views

Network statistics: reading ifconfig rx drop count

Need to get the RX drop counter incremented in Linux ethernet interface (ifconfig RX dropped: should increment), for some statistics testing. I am using 2 virtual PCs, with Ubuntu. I tried the ...
2
votes
1answer
339 views

How to output process stats after completion?

I would like to run a process from bash in Cygwin so that I have some short summary after execution like peak memory usage or average CPU usage, like time but with more information. Are there any ...
6
votes
2answers
19k views

How can I see memory usage history?

I am familiar with several commands like top, htop, free, etc. However, is there a command to see the peak/burst memory usage of the entire server (not individual processes) over, say, the last 30 ...
1
vote
2answers
636 views

Reset vmstat statistics without rebooting

Running vmstat will give you the average virtual memory usage since last reboot. The si and so values give the average virtual memory I/O. For example: root@mymachine# vmstat procs -----------...
4
votes
1answer
506 views

How to gather full network usage statistics on a freebsd router?

I have a freebsd box, which serves as a router from LAN to the outside world. It has several Internet providers, OpenVPN servers and clients, NAT and so on. I would like to have complete statistics ...
1
vote
1answer
1k views

Difference between `strace -r` and `strace -T` options?

What's the difference between the two? In the man pages it says: -r Print a relative timestamp upon entry to each system call. This records the time difference between the beginning ...
1
vote
1answer
804 views

How to install R Vennerable in Debian?

There are many threads about the topic 2014 but their proposal does not work in R 3.3.1, apparently because the dependencies are not met but I could not install them neither install.packages("...
1
vote
1answer
610 views

How to install rgl and netmata in R 3.3.1?

I am reading the R Springer book of the authors. Their 00-installation script yields the following warings # List of R packages pkgs <- c("mada", "meta", "metafor", "metasens", "mvmeta", "netmeta",...
0
votes
1answer
732 views

Compute percentile and max value per variable

Bash Gurus, I need to compute the max and percentile numbers for each item in the list, using awk aa 1 ab 3 aa 4 ac 5 aa 3 ad 2 ab 4 ac 2 ae 2 ac 5 Expected output Item 90th percentile ...
3
votes
1answer
7k views

How to plot a CDF from array using matplotlib python

I wrote a python program that basically takes a text file with 86400 lines containing web server ping responses. I extract the round trip from each line and add it to an array called roundtriptimes. I ...
1
vote
1answer
5k views

Using AWK to calculate mean and variance of columns

I have a large data file dataset.csv with 7 numeric columns. I have read that AWK would be the fastest/efficient way to calculate the mean and variance for each column. I need an AWK command that goes ...
0
votes
1answer
206 views

Calculate average values for each day over multiple years

I have some "CSV" data (actually using ; as a delimiter) having a row for every day from 1971-01-01 through 2099-12-31 (a span of 2099−1971=128 years). The data are organized as follows: YEAR;MONTH;...
1
vote
3answers
1k views

ksar (a sar grapher) development stopped 2013 - no RHEL 7x compatibility - any alternative? [closed]

Ksar is a BSD licensed Java based application to create graph of all parameters from the data collected by Unix sar utilities. Usually Unix sar is part of Unix' sysstat package and run sa1, sa2, ...
0
votes
1answer
81 views

Why do I have more packets than bytes? [closed]

I don't know how to explain this. mind blown. ip -s link 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP mode DEFAULT group default qlen 1000 link/ether RE:DA:...
1
vote
0answers
56 views

ImageMagick + ruTorrent-stats (Github repo)

I am trying to combine information I found here on the Unix & Linux Stack with I Wim Leers' rutorrent-stats I have some experience with coding simple websites and while I am by no means a ...
0
votes
1answer
20 views

Since when Disks statistics in `top` command are counted?

I've got these disk statistics shown in top command: $ top | head | tail -n1 Disks: 1095425909/52T read, 1016012571/52T written. It's quiet high number for only 37 day uptime. Are these numbers are ...
3
votes
1answer
452 views

Which process sent data out of my computer?

Using vnstat, I observed a lot of uploaded data from my computer and I don't know which process sent data out of my computer. Is there a tool to get stats on how much data a process consumed during a ...
-1
votes
1answer
49 views

Statistics of System usage time (time of day, day of week)

I once found a tool that printed a huge amount of statistics about the time of day and day of week of computer usage when invoked. Unfortunately I don't remember the name neither did Google reveal it ...
1
vote
0answers
42 views

Is there a tool for generating historical process oriented resource usage statistics like top output?

I've seen many tools like collectd, systats etc for recording general usage statistics, but I would like to find a tool for generating a historical graph of system resource consumption of the top 10 ...
2
votes
1answer
3k views

ping statistics

When ping displays statistics the field mdev is the std deviation of all the ping times. It is the average time (in ms) to the average avg. But because ping times are stricktly positive, I don't ...
1
vote
3answers
146 views

Random sampling and outputting the largest value

I have a fairly large data set ~500 million rows. The data set looks like below. Col 1 is float number, col 2 is mac id(device id) 1616.93,ac:22:0b:a6:22:c3 2872.32,c0:bd:d1:36:bb:49 3314.55,d4:0b:1a:...
1
vote
0answers
709 views

How can I get read/write instant speed of a Hard Drive using /proc/diskstats data?

I know that the proc/diskstats file presents these data columns: 1 - major number 2 - minor mumber 3 - device name 4 - reads completed successfully 5 - reads merged 6 - sectors read 7 - time spent ...
6
votes
1answer
8k views

NIC statistics explanation (ethtool -S eth1)

What is the meaning of each of the results from ethtool -S eth1 command? For example, when I used ethtool -S eth1, I got something like this: >root@localhost ~]# ethtool –S eth1 >NIC ...
2
votes
1answer
1k views

lsof: measure I/O rate of a socket fd

I'm writing a script that parses the output of lsof to show a list of what processes have sockets open (similar to what netstat shows). lsof also gives me a file descriptor. What I want to do now is ...
5
votes
1answer
62 views

How to find the number of bytes rewritten to a folder hierarchy? [duplicate]

I want metrics for how much writing and reading have been done to a folder. vmstat -d gives metrics at the whole disk level. iotop will give per process rw stats. But how can I find out how much ...
1
vote
1answer
55 views

Get summary count of all patches applied to a server?

Is there an easy way to get a count of the total number of patches applied to a server over a time frame, or even in summary?
11
votes
5answers
4k views

How to gather byte occurrence statistics in binary file?

I'd like to know the equivalent of cat inputfile | sed 's/\(.\)/\1\n/g' | sort | uniq -c presented in https://stackoverflow.com/questions/4174113/how-to-gather-characters-usage-statistics-in-text-...
2
votes
1answer
143 views

Mathematical processing on text file

I have 200 text files. Each text file contains one column of mathematical numbers (100k rows). I want to do some statistical processing on these data (finding the probit or quantile). I know the ...
0
votes
2answers
84 views

How to list similar lines?

The delimiters could be: " "; "_" INPUT: foo#foo_ehh113#The password of user 111 will expire within the next seven d foo#foo_ehh204#The password of user 111 will expire within the next seven d sadf#...
5
votes
2answers
1k views

How can I see i/o stats for a briefly running process?

For long running processes like init, I can do things like $ cat /proc/[pid]/io What can I do if I want to see stats for a briefly running process such as a command line utility like ls? I don't ...
2
votes
1answer
54 views

How do you implement totals from usage output generated by a program in a script so that they carry on sanely through repeated execution?

I have a script with a pipeline where the data is throttled by a program. Every 20 minutes, a throughput status is sent on stderr, and I simply redirect this to a file: command | cstream -t -512k -T ...
3
votes
3answers
2k views

Is there an equivalent to systat in Linux?

Is there an equivalent to the amazing systat command in Linux-based operating systems? For those who don't know about it, the BSD's systat command is just amazing. It displays live graphs of network ...
5
votes
2answers
9k views

How do I install plugins for collectd

I have installed collectd and got it running but also wanted to use the Ping plugin ( https://collectd.org/wiki/index.php/Plugin:Ping ) but it's not actually installed by default (i.e. not in the list ...
17
votes
2answers
2k views

Is there something like `time` that also records I/O and CPU?

I can pretty quickly monitor the running time of a process with time: x@y ~ $ time foo real 0m14.299s user 0m4.770s sys 0m0.440s Is there a way I can get the same data for I/O ...
-1
votes
1answer
486 views

Which is the most precise command to get processes and system information? [closed]

I'm trying to evaluate performances of some active processes of mine on linux. Searching the internet I found that ps and top are the only command available for that. More precisely here, it says ...
1
vote
0answers
88 views

Should rpc.statd write anything into wtmp?

On several linux machines (some old custom variant of gentoo) I have huge wtmp files, up to gigabyte in size. After some experiments I know that there is rpc.statd daemon running on all servers and ...
2
votes
1answer
5k views

Load average per process or user

is it possible to obtain load average values (as displayed by uptime) individually per process or user. I would like to be able to see what user is causing what load. top is not really suitable ...
4
votes
1answer
618 views

Are there awk versions that provide syntax for computing aggregations?

From time to time I find myself writing awk scripts that compute some simple statistics. For example computing a histogram, the average of a value, the standard deviation or even the variance ... ...
4
votes
2answers
1k views

Is collectd able to send data tagged as a host other than itself?

I log various stats both generic and custom from a lot of different servers using collectd to a single host running a network listener. The setup is pretty simple. All the systems run an instance of ...
13
votes
5answers
16k views

Traffic stats per network port

I have two machines with two applications that talk to each other on few network ports (TCP and UDP). I want to count traffic that they send and receive. I need not only overall count but stats per ...