I/O is an acronym for Input/Output, which refers to the mechanism or process for the transfer of information between one system or component and another.

learn more… | top users | synonyms

2
votes
0answers
10 views

What could cause dropping cache to be extremely slow on a large cluster?

I'm attempting to time file I/O on my disks. In order to make sure all the I/O is happening off the hard drives and not from ram, before I time any read, I run a drop cache command. Specifically, I ...
2
votes
2answers
117 views

How can I print current reads and writes to the filesystem on demand?

I am interested in getting statistics about filesystem reads and writes, specifically to an NFS mount. I know there are many tools such as iostat, nfsstat and inotifywait but there are issues I have ...
1
vote
1answer
24 views

NTFS partitions with high IO load causes consuming all processor time

My system (linux 3.16, ntfs-3g 2013.1.13AR.1) has 2 NTFS partitions and 2 ext4. I have 2 hard drives, each of them has 1 ntfs and 1 ext4. I've noticed that high inpit-ouput on NTFS partitions causes ...
1
vote
1answer
25 views

Performance of `tar -xf` (block size related)

I'm recently working on optimizing the performance of tar -xf, i.e. untar a file. I notice that under default settings, tar -xf calls writes to write 10 KiB output at a time in chunks. However, this ...
1
vote
1answer
26 views

Linux buffer(1) program — replacement? useful?

I used to heavily use the buffer(1) program especially in talking to tape drives. Its a program made in the 1990's to essentially use a circular shared memory buffer to speed up I/O between two piped ...
2
votes
2answers
78 views

High IO wait - How to determine the root cause?

I have a MySQL instance on two dedicated servers. One for the production, the other for the test platform. The 2 servers are pretty the same, the only difference is the RAID controller and the ...
1
vote
0answers
23 views

Find amount of IO occurring over various NFS mounts

When I run netstat | grep nfs, I get the currently mounted nfs connections for a given host in a cluster. If there is massive io happening over 1 (or 2) of the connections, how can I monitor this? Is ...
0
votes
0answers
55 views

Why cancelled_write_bytes is different size than created/removed file?

I was wondering how field cancelled_write_bytes from /proc/[pid]/io works, so I've created a file (dd) and then deleted it (rm). I was expecting to see cancelled_write_bytes ~equal to file size while ...
0
votes
1answer
44 views

High on %wa from top command, is there any way to constrain it?

Here's my last top info before it stucks: top - 18:26:10 up 238 days, 5:43, 3 users, load average: 1782.01, 1824.47, 1680.36 Tasks: 1938 total, 1 running, 1937 sleeping, 0 stopped, 0 zombie ...
3
votes
2answers
36 views

How can I tell which process is IO bound?

Suppose I have a large number of processes and one (or more) is IO bound, obvious by a high wa value in top. How can I pinpoint which process it is? Each process shows how much cpu is being used, but ...
9
votes
1answer
349 views

Know which process does I/O without iotop

On Linux, I want to know which process uses my disk I/O bandwith. I know I can use iotop but I have a machine where, for various reasons, iotop cannot be installed. How can I manually get that ...
2
votes
2answers
71 views

How do I check which files are written by an application?

On my system, sar reports an average write to disk about 5MB/s. Using dstat I found that it's not so permanently, but there are peaks to 30-50MB/s, and then are sleeps. Using iotop i found that most ...
1
vote
0answers
35 views

Inherit IO redirections from a script to another

When I redirect the output of a script within a script, I expect the redirection to be applied to the called script as well as the program called within it. A: ./B 2>> error.log B: ...
1
vote
0answers
24 views

Linux Mint keyboard and mouse take a long time to work after boot

I turn my computer on, select my linux harddrive, and then I end up at the Linux mint encryption password area. I have to wait about 1 minute just for my keyboard and mouse to actually light up and ...
2
votes
1answer
96 views

Relationship between IO scheduler and cpu/process scheduler?

The concepts of IO scheduler and CPU scheduler confuse me. Below are my understanding: Linux uses CFS scheduler + nice values by default to schedule processes. Each process has an IO queue. There ...
2
votes
1answer
67 views

How to track down the source of I/O spikes?

I am using Linux as a desktop, and keep getting seemingly random I/O Spikes. The machine becomes unusably slow. At first I thought it was just that I don't have enough memory. But looking at the ...
1
vote
1answer
56 views

Set ionice for a multi-threaded application

I have a program that spawns multiple threads, all of which do fairly intensive IO, running on the background. I want to set the scheduling class to idle so that it doesn't clog up the system; ...
0
votes
0answers
31 views

stdin read notification

I want to detect when/if an application issues read(stdin, ...). Is it possible to use unbuffered I/O so that I could wait on write in external process? The problem: Some commands require user input ...
3
votes
2answers
72 views

How does one determine when a process or machine is IO bound?

I have a node.js process which writes to many different sqlite databases. Sqlite can handle only one concurrent write per database, which is fine since there will be only one write per database at a ...
3
votes
2answers
62 views

How to determine whether the data is written to disk or cached?

I'm learning file operation calls under Linux. The read() and write() and many other functions use cache to increase performance, and I know fsync() can transfer data from cache to disk device. ...
0
votes
1answer
60 views

NAS: 100% system (kernel) cpu usage

I have a single core NAS My Live Duo. It runs Debian lenny release. I found via htop utility that it constantly use 100% of red cpu without any noticeable process to eat it. Than I checked via iostat ...
1
vote
1answer
76 views

Very slow file operation

I recently rebuild a machine with Centos 5.8 with a brand new disk. This machine is old and has been running 5.8 for a long period with no issues so the only thing which changed recently is the new ...
2
votes
1answer
59 views

Selecting IO scheduler on external drives

I'm running linux on the beaglebone black. My system is running directly from the sdcard. To change the IO scheduler I need to configure /sys/block/xxx/queue/scheduler where xxx is the mounted ...
2
votes
1answer
148 views

Set bash script output to the line that called bash script

I've looked for the greater part of two hours trying to see if I could find a way to redirect the output of a bash script to the line that called the bash script. The best example I can use to ...
2
votes
1answer
50 views

pipe speed benchmark with machine readable output

I'm looking for a tool similar to pv which is producing machine readable output. And i cant believe that nobody did it bevore... I looked at the manpages of pv, pipemeter, dd and cpipe but all these ...
8
votes
2answers
660 views

tar to pipe but keep -v verbose output separate from STDERR

A normal tar command tar cvf foo.tar ./foo >foo.out 2>foo.err has three output IO streams archive data to foo.tar list of filenames to STDOUT (redirected into foo.out) error messages to ...
0
votes
1answer
290 views

Does dm-multipath schedule I/O?

I have a multipath device I'm interested in: [root@xxx dm-7]# multipath -ll mpathf mpathf (3600601609f013300227e5b5b3790e411) dm-7 DGC,VRAID size=3.0T features='1 queue_if_no_path' hwhandler='1 alua' ...
2
votes
1answer
59 views

Running command on server, but have the server read/write local files [duplicate]

Is it possible to have a remote machine run a command, but redirect all reads and writes to a local machine. Example: I have a bunch of scripts in folder 'project'. When 'make simulate' is run in ...
2
votes
0answers
71 views

View syscalls/kernel activity for I/O from a running process

I'd like to be able to view syscalls or kernel activity for a process...I'm not actually sure of the terminology I need here! Specifically I'm looking for the difference between I/O going to local ...
2
votes
0answers
24 views

Linux sound lags while copying from USB key

Why did I experienced sound skipping while copying a big file from my USB key onto my computer's drive? I monitored the system during this I/O operation: music was playing from Internet on the ...
2
votes
2answers
1k views

Optimizing logical sector size for physical sector size 4096 HDD

With many new hard drive disks the physical sector size is 4096. Would it be possible to make the system use a logical sector size of the same size, rather than the default logical sector size of 512? ...
2
votes
2answers
41 views

Current disk load

I'm using iostat to get the current disk load each second with iostat -dx 1 (specially, %util column). However, I'd like to put this in a bash script and control the interval with the watch command ...
2
votes
1answer
289 views

how to read any process' /proc/pid/io

I'm trying to monitor disk activity of each process. One way that I found how to do this is to read /proc/pid/io file and compare fields with previous read. That works fine except my monitoring ...
1
vote
1answer
57 views

How to collect disk read/write activity over a given period of time?

Sometimes, especially upon login, I have a lot of disk activity. I can use iotop to see what's doing that at a given moment, but I would like to have an integral table over a given time, say the first ...
4
votes
2answers
473 views

Disk busy is close to 100% and iowait is 0,0% on SunOS, how can it be possible?

During monitoring of SunOS5.10 machine I noticed strange behavior: Disk busy is close to 100% Disk waiting time is 0,0% Primary purpose of this machine is running application server on jvm. This ...
4
votes
1answer
781 views

Alternative to iotop for non-root user without sudo privileges

I'm looking for an alternative to iotop. Here's my situation: I want to find out if a program is accessing the hard drive a lot while running. iotop requires root/sudo privileges. My account is on ...
6
votes
1answer
161 views

Can you throttle the bandwidth to a tmpfs based ramdisk?

I created a ramdisk using tmpfs as follows: sudo mount -t tmpfs -o size=1024m tmpfs /myramdisk I was looking into cgroup blkio subsystem bandwidth limits "read_bps_device" and "write_bps_device" ...
2
votes
0answers
42 views

IO throughput lower when only a single process using the disk?

I am running a busy cacti server on centos and sometimes the rrdtool process is painfully slow when writing to disk, in HTOP the IO Column would display something between 100-300. I a polling cycle ...
4
votes
1answer
431 views

How can I prevent disk I/O from taking over my CPU?

I run Debian Jessie on a quad-core i7 processor, which results in 8 cores being shown thanks to hyperthreading. On disk-heavy loads, all eight cores are maxed out with io-wait, as shown by htop. This ...
2
votes
0answers
94 views

How to calculate blkio shares in cgroups?

Currently I'm trying to setup a test scenario with the use of Debian Wheezy with its default kernel 3.2.60-1+deb7u3 and the cgroups blkio controller. The calculation of blkio.weight is not working for ...
1
vote
1answer
603 views

External Hard disk Input/Output error

One of WD external harddrives is not working when I try to access some folder. I am able to access the rest of the folders on the disk. I am getting Input/Output error as show in the attached Image. ...
0
votes
1answer
3k views

ERROR: init: ttyS0 (/dev/ttyS0) main process (1612) terminated with status 1

I'm getting the following errors every 10-30 seconds on a virtual Red Hat Enterprise Linux 6.5 2 Server on Amazons EC2. Sep 23 09:57:05 ServerName init: ttyS0 (/dev/ttyS0) main process (1612) ...
2
votes
1answer
328 views

Dirty in /proc/meminfo for dd

I read from here that the below command gives me the amount of data that needs to be written to the disk. grep ^Dirty /proc/meminfo It particularly says Ever ask yourself "How much data would be ...
1
vote
2answers
239 views

mkfifo - Does disk I/O actually occur?

I have 2 applications: Producer (N instances) Consumer (1 instance) I currently write out intermediate results from the producers, and then the consumer reads these files from disk and produces a ...
0
votes
0answers
158 views

Journal commit I/O error for Seagate Expansion external USB hard drive

I am using Debian 7.6 (amd64) and for some reason when I am trying to read or write to my Seagate Expansion 1TB external USB drive, I am getting input/output errors ... Here is what the output of ...
1
vote
1answer
336 views

blktrace - differentiating between sequential to random io

I'm looking for a way to determine whether an app is doing sequential or random I/O. Is it possible to look at a blktrace capture and say if I/O is sequential or random? If yes, any examples of what ...
2
votes
1answer
298 views

How to test Disk IO on VMs with iozone?

I want to test the disk IO performance like read, write, random read, random write and so on both in physical machine and VMs (with aufs file system). Also I want to test the throughput performance in ...
1
vote
1answer
211 views

why doesn't iozone generate output file?

I'm using iozone3 for tesing, on Xamin (an Debian-based OS). When I enter iozone command, for example iozone -Rab output.xls, the test runs successfully. But after running the test (after displaying ...
1
vote
1answer
279 views

wget internal buffer size

I'm constantly using wget to download many files over 1GB each. I'm getting concerned about how this may be straining my HDD. Can wget's internal buffer size be modified so that it writes to my HDD ...
2
votes
0answers
240 views

/dev/sda not appearing after secure erase

I decided to wipe my SSD with a secure erase before installing Arch Linux, since the Arch wiki said that it would improve performance. I followed the instructions listed on the wiki, but now when I ...