Questions tagged [statistics]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
26 views

Monitor how long per day or hour I'm close to my maximuim internet bandwith? So if it makes sense to buy an upgrade

for quite some time I'm working at home now. Recently I questioned if my current internet connection is good enough for my activity on my laptop. For some activities I notice a high internet usage, ...
user avatar
  • 265
1 vote
0 answers
46 views

Count number of bytes read() from files on a file system

I have multiple XFS filesystems mounted on my Linux 5 machine. I'd like to know for one of them how many bytes were read() in a time period. Is there an easy way of doing that? I've been looking ...
user avatar
0 votes
1 answer
88 views

How can you check how much of a bcache cache is currently in use?

I've got a setup that includes a bcache cache device serving multiple backing devices. I would like to know how much of it is currently in use because bcache only caches certain kinds of data.
user avatar
  • 333
0 votes
3 answers
73 views

Extract maximum values for each objects from a file [duplicate]

I need to extract some values from a file in bash, on my CentOS system. In myfile.txt I have a list of objects called Info_region in which each object is identified with a code (eg. BARD1_region_005 ...
user avatar
1 vote
1 answer
30 views

Linux collect CPU time per shared library file

Is there a way to -in the background- collect cumulative cpu time stats per shared library? Without modifying applications or libraries? Ideally a solution that'll (also) work on arm (Jetson / Pi). ...
user avatar
  • 111
1 vote
0 answers
139 views

Best way to group & count lines on stdin?

Since time immemorial I have used ... | sort | uniq -c | sort -nr to group & count input lines, to count how many of each line there is in the input. Is there any better way? Have I just picked up ...
user avatar
  • 1,049
0 votes
3 answers
363 views

live count of uniq lines

I've got a command that outputs a few different lines constantly (a stream), I'd like a live summary of the number of times each line has occurred (with a few seconds latency being acceptable). for ...
user avatar
-1 votes
1 answer
60 views

Debian version usage statistics

I'm developing a Linux application. I would like to figure out the minimum Debian release I should target depending on the version usage statistics. There is a lot of such information for Windows and ...
user avatar
  • 101
0 votes
1 answer
66 views

Bash command to count lines with matching substrings in two different positions

I'm trying to get some trivial statistics on some debug output. Each debug line is of the form(class name)(delimiter 1)(object ID)(delimiter 2)(method name)(delimiter 3)(log message) I want to get a ...
user avatar
1 vote
0 answers
115 views

How to Mirror (Sync) Specific Log Entries to a data file?

Running CentOS 7.7 in VPS Question: Is there native functionality to copy|duplicate|sync lines from a specific log file matching specific search criterion to a separate data file for archival ...
user avatar
  • 11
2 votes
0 answers
118 views

Read per thread network statistics from C/C++

I have a Linux process with let's say 10 threads. Some of them make network traffic. From another thread or it can be even within another process I need to find out which threads have network activity....
user avatar
  • 41
1 vote
0 answers
38 views

How to gather stats of accessed file, true http

I have a simple file/web server. On that server I have files which are accessed by myself and others, using a URL. It is on Ubuntu 14.4 server with nginx. I want to know how many times a file was ...
user avatar
  • 11
6 votes
1 answer
2k views

Where does ethtool get information from?

When I run the command ethtool -S wlp2s0, I get the following information: NIC statistics: rx_packets: 63 rx_bytes: 14163 rx_duplicates: 2 rx_fragments: 58 rx_dropped: 30 ...
user avatar
  • 199
1 vote
3 answers
1k views

How to retrieve specific cpu, memory and interface statistics only

There is requirement to collect only specific stats like %idle, memfree, available, pmemused etc. I further have to convert the output to a json string and consume it. Is there any UNIX tool which ...
user avatar
  • 123
2 votes
1 answer
2k views

How to sum each column and print column name and column sum using awk?

I have a file with a table of numbers; the first line is a header line. I want to sum each column and print out sum and column name for each column using awk. How can I do it?
user avatar
  • 141
-1 votes
1 answer
44 views

How do I check how much RAM a process consumes like the way `time` is used to measure the elapsed time?

How do I check the maximum amount a RAM a process uses similar to how time works? $ time mvn package real 0m35.796s user 0m32.925s sys 0m1.559s $ maxmem mvn package 688 MB
user avatar
  • 478
0 votes
1 answer
957 views

Summary statistics in shell script

I have multiple files (records) across multiple directories. Each record lies in its own path based on the date it was created. Eg a record on 12 Nov 2016 is ~/records/2016/11/12/record. In each ...
user avatar
  • 33
0 votes
0 answers
85 views

measuring ppp traffic with ifstat

I've established a ppp link with 2 Linux machines. The speed is set to 9600. Traffic is going one way, i.e. from Machine 1 to Machine 2. However when I run ifstat -btwTWS -i ppp0 on Machine 2, I'm ...
user avatar
  • 521
1 vote
1 answer
1k views

How to log quantities of IP traffic by src/dst (and port for UDP & TCP)?

How can I log quantities of IP traffic by src/dst (and port for UDP & TCP)? For each interval (probably each hour) I would like to see something like: proto, src, dst, packets, octets ICMP, 192....
user avatar
  • 579
0 votes
1 answer
1k views

Calculating the IOPS using Bandwidth

I have the write Bandwidth value received from the system and I need to calculate the write IOPS using the BW, Bandwidth = amount of data / second http://rickardnobel.se/storage-performance-iops-...
user avatar
  • 191
4 votes
2 answers
801 views

Is there a way to find out the estimate of Linux kernel version usage in the world?

Currently I am writing my bachelor thesis and as a part of it I need some statistics about the Linux kernel. Is there any website or publication that would provide some estimates on which kernel ...
user avatar
1 vote
1 answer
216 views

Network I/O and Disk I/O without installing anything or using third parties libraries

I can't find anything on how can I get the network I/O and disk I/O without installing any libraries on my server. I tried with this for the disk I/O: cut -d" " -f 1,2,42 /proc/*/stat | sort -n -k +...
user avatar
4 votes
3 answers
8k views

What does /proc/loadavg ' s "CPU and IO utilization" mean?

In this page, it says that the first three columns of the output of /proc/loadavg measure CPU and IO utilization of the last one, five, and 10 minute periods. Does a single value reveal both CPU and ...
user avatar
0 votes
1 answer
688 views

How to see the current routed connections?

I'm running a router that is using linux; I want to see connection statistics from internal network to external network(s) (NAT router); how do I do this? I've tried using netstat but of course its ...
user avatar
1 vote
1 answer
286 views

Open ZFS : Recently Used/Frequently Used statistics persistence

ZFS cache data into ARC using two information : Recently Used Cache Frequently Used Cache Does ZFS keep this file/metadata statistic somewhere, or does it just do with what has been used since power ...
user avatar
  • 1,073
1 vote
1 answer
968 views

Network statistics: reading ifconfig rx drop count

Need to get the RX drop counter incremented in Linux ethernet interface (ifconfig RX dropped: should increment), for some statistics testing. I am using 2 virtual PCs, with Ubuntu. I tried the ...
user avatar
3 votes
1 answer
756 views

How to output process stats after completion?

I would like to run a process from bash in Cygwin so that I have some short summary after execution like peak memory usage or average CPU usage, like time but with more information. Are there any ...
user avatar
24 votes
2 answers
65k views

How can I see memory usage history?

I am familiar with several commands like top, htop, free, etc. However, is there a command to see the peak/burst memory usage of the entire server (not individual processes) over, say, the last 30 ...
user avatar
1 vote
2 answers
1k views

Reset vmstat statistics without rebooting

Running vmstat will give you the average virtual memory usage since last reboot. The si and so values give the average virtual memory I/O. For example: root@mymachine# vmstat procs -----------...
user avatar
  • 3,465
3 votes
1 answer
963 views

How to gather full network usage statistics on a freebsd router?

I have a freebsd box, which serves as a router from LAN to the outside world. It has several Internet providers, OpenVPN servers and clients, NAT and so on. I would like to have complete statistics ...
user avatar
  • 2,517
2 votes
2 answers
4k views

Difference between `strace -r` and `strace -T` options?

What's the difference between the two? In the man pages it says: -r Print a relative timestamp upon entry to each system call. This records the time difference between the beginning ...
user avatar
1 vote
1 answer
1k views

How to install R Vennerable in Debian?

There are many threads about the topic 2014 but their proposal does not work in R 3.3.1, apparently because the dependencies are not met but I could not install them neither install.packages("...
user avatar
1 vote
1 answer
990 views

How to install rgl and netmata in R 3.3.1?

I am reading the R Springer book of the authors. Their 00-installation script yields the following warings # List of R packages pkgs <- c("mada", "meta", "metafor", "metasens", "mvmeta", "netmeta",...
user avatar
0 votes
1 answer
2k views

Compute percentile and max value per variable

Bash Gurus, I need to compute the max and percentile numbers for each item in the list, using awk aa 1 ab 3 aa 4 ac 5 aa 3 ad 2 ab 4 ac 2 ae 2 ac 5 Expected output Item 90th percentile ...
user avatar
2 votes
1 answer
12k views

How to plot a CDF from array using matplotlib python

I wrote a python program that basically takes a text file with 86400 lines containing web server ping responses. I extract the round trip from each line and add it to an array called roundtriptimes. I ...
user avatar
2 votes
3 answers
10k views

Using AWK to calculate mean and variance of columns

I have a large data file dataset.csv with 7 numeric columns. I have read that AWK would be the fastest/efficient way to calculate the mean and variance for each column. I need an AWK command that goes ...
user avatar
0 votes
1 answer
353 views

Calculate average values for each day over multiple years

I have some "CSV" data (actually using ; as a delimiter) having a row for every day from 1971-01-01 through 2099-12-31 (a span of 2099−1971=128 years). The data are organized as follows: YEAR;MONTH;...
user avatar
  • 548
1 vote
3 answers
2k views

ksar (a sar grapher) development stopped 2013 - no RHEL 7x compatibility - any alternative? [closed]

Ksar is a BSD licensed Java based application to create graph of all parameters from the data collected by Unix sar utilities. Usually Unix sar is part of Unix' sysstat package and run sa1, sa2, ...
user avatar
  • 1,457
0 votes
1 answer
116 views

Why do I have more packets than bytes? [closed]

I don't know how to explain this. mind blown. ip -s link 2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP mode DEFAULT group default qlen 1000 link/ether RE:DA:...
user avatar
  • 1,898
1 vote
0 answers
72 views

ImageMagick + ruTorrent-stats (Github repo)

I am trying to combine information I found here on the Unix & Linux Stack with I Wim Leers' rutorrent-stats I have some experience with coding simple websites and while I am by no means a ...
user avatar
0 votes
1 answer
23 views

Since when Disks statistics in `top` command are counted?

I've got these disk statistics shown in top command: $ top | head | tail -n1 Disks: 1095425909/52T read, 1016012571/52T written. It's quiet high number for only 37 day uptime. Are these numbers are ...
user avatar
  • 18.2k
2 votes
1 answer
961 views

Which process sent data out of my computer?

Using vnstat, I observed a lot of uploaded data from my computer and I don't know which process sent data out of my computer. Is there a tool to get stats on how much data a process consumed during a ...
user avatar
  • 123
-1 votes
1 answer
60 views

Statistics of System usage time (time of day, day of week)

I once found a tool that printed a huge amount of statistics about the time of day and day of week of computer usage when invoked. Unfortunately I don't remember the name neither did Google reveal it ...
user avatar
  • 1
1 vote
0 answers
46 views

Is there a tool for generating historical process oriented resource usage statistics like top output?

I've seen many tools like collectd, systats etc for recording general usage statistics, but I would like to find a tool for generating a historical graph of system resource consumption of the top 10 ...
user avatar
  • 1,085
3 votes
1 answer
8k views

ping statistics

When ping displays statistics the field mdev is the std deviation of all the ping times. It is the average time (in ms) to the average avg. But because ping times are stricktly positive, I don't ...
user avatar
  • 365
1 vote
3 answers
162 views

Random sampling and outputting the largest value

I have a fairly large data set ~500 million rows. The data set looks like below. Col 1 is float number, col 2 is mac id(device id) 1616.93,ac:22:0b:a6:22:c3 2872.32,c0:bd:d1:36:bb:49 3314.55,d4:0b:1a:...
user avatar
1 vote
0 answers
982 views

How can I get read/write instant speed of a Hard Drive using /proc/diskstats data?

I know that the proc/diskstats file presents these data columns: 1 - major number 2 - minor mumber 3 - device name 4 - reads completed successfully 5 - reads merged 6 - sectors read 7 - time spent ...
user avatar
6 votes
1 answer
15k views

NIC statistics explanation (ethtool -S eth1)

What is the meaning of each of the results from ethtool -S eth1 command? For example, when I used ethtool -S eth1, I got something like this: >root@localhost ~]# ethtool –S eth1 >NIC ...
user avatar
  • 61
3 votes
1 answer
2k views

lsof: measure I/O rate of a socket fd

I'm writing a script that parses the output of lsof to show a list of what processes have sockets open (similar to what netstat shows). lsof also gives me a file descriptor. What I want to do now is ...
user avatar
  • 375
5 votes
1 answer
113 views

How to find the number of bytes rewritten to a folder hierarchy? [duplicate]

I want metrics for how much writing and reading have been done to a folder. vmstat -d gives metrics at the whole disk level. iotop will give per process rw stats. But how can I find out how much ...
user avatar
  • 365