3
votes
1answer
55 views

Artificially prime buffer cache?

Is it beneficial to artificially prime the buffer cache when dealing with larger files? Here's a scenario: A large file needs to be processed, line by line. Conceptually, it is easy to parallelize ...
0
votes
0answers
32 views

Calculate Total disk i/o by a single process [duplicate]

I am looking for some tool that will dump total disk I/O by a single process after it ends. So far my finding is :- iotop= It shows i/o per process in real time but does not give total after process ...
4
votes
1answer
45 views

Are writes to eventfd counted as io?

I am trying to reduce hard-disk activity on my system. Running iotop shows that Eclipse (the IDE, latest version (Luna)) is writing kilobytes of data every few seconds. So I ran strace on the eclipse ...
0
votes
0answers
18 views

I2c with 16 bit addresses

So, i'm trying to interface with a device that has 16-bit addresses, and the master I'm using also supports this mode. However since this isn't standard I2C (should be 8-bit addresses) I haven't been ...
4
votes
3answers
201 views

Poor IO due to LUKS/Software RAID/LVM ordering?

I'm trying to determine if I should re-setup my RAID array due to poor IO performance. First off, the system: i7 920 4 4TB WD 5400 Green drives CentOS 6.3 host Secondly, the disk setup: ...
3
votes
3answers
439 views

Can I just disable updatedb?

Is updatedb necessary at all? I never use locate and my servers tend to have dozens of millions of files which usually makes updatedb to run for a long time and consume I/O needed by MySQL and/or ...
4
votes
2answers
163 views

why does blktrace only write blocks of 8?

I want to understand the I/O pattern a database is writing to disk to decide how many disks to use for best performance. To analyse the I/O pattern I want to use blktrace and I have to grok it first. ...
1
vote
1answer
3k views

iostat: await vs. svctm

In the iostat manpage I have found these two similar columns: await The average time (in milliseconds) for I/O requests issued to the device to be served. This includes the time spent by ...
3
votes
3answers
75 views

Disallow File IO for a process except for FIFOs

How do you start a process that cannot do any file IO (opening / closing files, creating / deleting files, reading / writing files, etc.), except to read and write to pre-created FIFOs? (chroot will ...
1
vote
2answers
315 views

How I/O channels are implemented in Linux kernel?

stdin, stdout, stderr are some integers that index into a data structure which 'knows' which I/O channels are to be used for the process. I understand this data structure is unique to every process. ...
3
votes
2answers
431 views

Massive, unpredictable I/O performance drop in Linux

I'm using Debian testing without any problems for ~6 years (I'm just regularly updating it), but recently it started to show a random behaviour that can be summarized as "Low I/O performance which ...
2
votes
1answer
60 views

Getting IO privileges in Linux

I have installed flashrom software. When i try to run sudo flashrom command it gives me "Could not get I/O privileges (Operation not permitted). You need to be root" error. Also I tried su command to ...
1
vote
0answers
140 views

How different is I/O handling of hard disk in AIX and Redhat Linux?

I am running a hadoop I/O workload in redhat linux and have ran that in IBM AIX as well with same underlying hardware, disk and disk configuration. With the default settings on the os redhat linux is ...
1
vote
1answer
432 views

How to measure total disk I/O per hour

I have a cloud server were we get billed also for disk IO usage. Here is an example from the stats: 04/Sep/2013 07:24:19 04/Sep/2013 08:24:19 0,5 GB / 1 vCPU (0,08 Kr. per hour): Charge for ...
2
votes
1answer
69 views

Why don't I see a file being copied right away with ls?

Is it due to the buffering in memory? I did cp /network/large_file . & and I kept doing ls -lh to monitor progress, but the file didn't appear until it was about 400MB. Linux 2.6 kernel, Bash 4, ...
14
votes
3answers
2k views

Determining Specific File Responsible for High I/O

This is a simple problem but the first time I've ever had to actually fix it: finding which specific files/inodes are the targets of the most I/O. I'd like to be able to get a general system overview, ...
3
votes
2answers
122 views

How to make directory modication date change when files from that dir change?

For example, if a file has been changed in that directory, then directory modification date should be updated. Basically any changes that happen in that directory should trigger a "touch" on the ...
2
votes
0answers
568 views

find ount what [flush-8:0] is writing

Using iotop, I found out that [flush-8:0] is doing a lot of hard disk activity, which explains the annoying slowdowns. However, I can't figure out what's the actual cause behind this flushing. No ...
4
votes
4answers
796 views

Special File that causes I/O error

I want to automatically test if a piece of software reacts as expected if an essential SQLite DB file fails to be read (causing an I/O error). Exactly that happened some days ago at a client. We ...
1
vote
1answer
116 views

Determine how much a process is using each disk?

How do I tell how much load a particular process is contributing to each of several available volumes/mounts? It seems that dstat only shows aggregate stats across all processes per disk, and iotop ...
4
votes
2answers
475 views

iotop but for particular disk?

Is there a tool like iotop but for monitoring IO on specific volumes? (Or perhaps I missed a way to filter iotop?) If not is there any way to get at this information via (say)/proc? (dstat etc. ...
1
vote
1answer
3k views

I/O errors on hard disk on Linux boot

Here is a screenshot of booting Arch. I guess the reason is that I force poweroff my Arch linux many times. (I already force poweroff my Arch because my firefox flash plugin use too much memory to ...
5
votes
2answers
319 views

How to improve IO when there is a lot of random read and write?

My scripts uses tons of read and writes. Most of them are small and random. I want Linux to wait 10 seconds before writing any data to the disk. How would this be achieved? I think Linux can already ...
0
votes
1answer
334 views

Does linux have something like supercache?

I installed http://www.superspeed.com/desktop/supercache.php for windows and the result is awesome. Every program I run is faster. Basically it uses the memory to cache data. Simple idea. I also use ...
1
vote
2answers
745 views

How to know recently updated files

If I run iostat -x 1 I saw ocassionally large 5MB to 10MB writes. What files are being written? I want to check the recently created files with size over 5MB for example. How would I do so?
1
vote
1answer
1k views

Which drive had a “journal commit I/O error”?

I received a message: kernel:[123456.789012] journal commit I/O error Which disk drive had the journal error?
2
votes
1answer
1k views

I/O error but no bad block is reported in syslog

I got errors like this in my syslog, but there's no bad block or sector defined in kernel report, I can't just replace the HDD right now and I prefer to reallocate the bad blocks for now, so I need ...
12
votes
2answers
3k views

Can I watch the progress of a `sync` operation?

I've copied a large file to a USB disk mounted on a Linux system with async. This returns to a command prompt relatively quickly, but when I type sync, of course, it all has to go to disk, and that ...
2
votes
1answer
256 views

How do I record disk performance on slow hardware and then replay it to faster hardware and benchmark it?

I am currently performing various development tasks that are slow on my current system because of IO performance. Is there a way to record disk operations while performing IO consuming tasks, ...
4
votes
2answers
3k views

Write inside a socket open by another process in Linux

Is it possible on Linux for a process to write inside a socket open by another one? Let's say I open a connection to google.com using netcat: myuser@linux:~$ nc google.com 80 Now I can lookup for ...
2
votes
2answers
1k views

vmstat IO stats: why the high bo during a download?

On my RHEL 4 machine, I was downloading a huge file (2.5GB)..I was checking the output of vmstat and was especially curious about seeing the disk IO using bi and bo. I know iostat is a better tool ...
5
votes
1answer
822 views

SysBench highlighting abysmal disk write performance on white box vs Tier1 server

Have been testing white box system with SuperMicro X8DTL motherboard with various SATA hard disks such as 7,200RPM Seagate Constellation ES and 10,000 RPM Western Digital VelociRaptor. Have tested ...
2
votes
0answers
447 views

GNU/Linux, IO performance problems

I have some problems with my system performance. As I was adviced here, I used sar: $sar -u 5 and found out that the problems are caused by a low HDD performance, as I supposed (high %iowait). ...
1
vote
1answer
333 views

BluRay Burner High I/O Wait State with UDF; Optimization Possible?

I've recently scaled back my home network, with one of the bigger changes being a switch-over to using a BD-RE drive for backup. With years of pictures and home video consuming about 25GB, and ...
11
votes
2answers
1k views

Weight-based block IO control for VMs

I use KVM to manage my virtual machines. I am trying to limit the resources provided for VMs. I am able to limit the CPU and memory allocated for VMs using libvirt/cgroups. Now I want to control the ...
7
votes
3answers
10k views

Find out what processes are writing to hard drive

On my Lenovo T400 and Ubuntu, the light for hard drive writing keeps flashing. I was wondering if in Linux it is possible to find out what processes are doing I/O to the hard drive? Just like by top, ...
1
vote
1answer
262 views

performance on Linux system when daisy-chaining multiple USB hard-drives on USB hubs?

What would the I/O access be like as I plug many USB drives into a Linux system with only 2 USB 2.0 ports and 1 USB 3.0 port? I expect I will have to have multiple levels of fan-out by plugging hubs ...
0
votes
1answer
139 views

What Linux tool will tell me if all the mounted disks share roughly the same bandwidth?

What Linux tool will tell me if all the mounted disks share roughly the same bandwidth? Can I do something like iostat for each of my /dev/sd* devices?
2
votes
1answer
308 views

Pluggin a bunch of USB hard drives into a Linux system?

I've got a Linux system with two USB 2.0 ports and one USB 3.0 port, and I would like to know how many USB hard drives I could plug into it. On the performance side, what would the I/O access be like ...
0
votes
1answer
270 views

How to test the difference between using disk encryption or not?

If I have a laptop, and I want to install an Ubuntu 11.04 on it, but disk performance would be an important thing, then how could I test the real differences between: - not using encryption - ...
4
votes
3answers
1k views

Intercept input and output from specific executable

I have a certain Linux executable that is called from a bigger application to perform some calculations. I want to modify the way the calculations are performed, for that I first need to understand ...
3
votes
3answers
236 views

Changing the disk scheduler on the fly

Can the Linux disk scheduler be changed on the fly by writing to /sys/block/sda/queue/scheduler? Should applications (e.g. Mysql) be stopped / started when changing?
4
votes
1answer
535 views

Does IO prioritise by the very nature of renicing a task?

The CFQ IO scheduler supports priorities though I am not sure that Deadline does (I believe not). The premise is that when I renice a task it gets a larger share of CPU under the Completely Fair ...
7
votes
3answers
3k views

How can I monitor disk I/O in a particular directory?

I've got a few processes with a known name that all write to files in a single directory. I'd like to log the number of disk block reads and writes over a period (not just file access) to test whether ...
8
votes
2answers
7k views

Run process with higher priority

I want to run mplayer with higher priority than any other processes, including the IO-processes. How can I do that?
13
votes
2answers
5k views

Why does high disk I/O reduce system responsiveness/performance?

I never quite understood why high disk I/O slowed the system so much. It's strange to me because I would expect the slow-down to affect only those processes dependent on the hard/optical drive data, ...
9
votes
1answer
1k views

What's the progress regarding improving system performance/responsiveness during high disk I/O?

Whenever there is high disk I/O, the system tends to be much slower and less responsive than usual. What's the progress on Linux kernel regarding this? Is this problem actively being worked on?
4
votes
3answers
821 views

How to get output from a remote shell

I have an application running on a server, started from the command line. From time to time, I need to connect to the server via SSH and get the output messages written to stdout from the application. ...
6
votes
1answer
1k views

How do I view the IO priority of a process?

How can I view the IO priority of a process? like to see for example if something has been ionice-ed.
25
votes
12answers
3k views

How can I tweak my Linux desktop to be more responsive?

I have the experience that Linux works fine until the physical memory is exhausted. As soon as swap space is used the performance is severely degraded and the GUI becomes unresponsive. This problem ...