I/O is an acronym for Input/Output, which refers to the mechanism or process for the transfer of information between one system or component and another.

learn more… | top users | synonyms

2
votes
2answers
35 views

Is it possible to generate a separate file list when creating a tarball?

When using tar for backups I'd like to create a separate list of the files that is included in the archive for storing alongside the backup tarball. Solutions that's not so good: tar --verbose ... ...
0
votes
0answers
12 views

I2c with 16 bit addresses

So, i'm trying to interface with a device that has 16-bit addresses, and the master I'm using also supports this mode. However since this isn't standard I2C (should be 8-bit addresses) I haven't been ...
3
votes
2answers
30 views

Monitor when read/write on metadata or mmaped files hit the disk

On a server hosting a wide range of websites, I often see IO becoming a bottleneck without being able to identify the processes responsible of IO operations with tools such as iotop, iostat or sar. I ...
22
votes
5answers
2k views

Why is iterating over a file twice faster than reading it into memory and computing twice?

I'm comparing the following tail -n 1000000 stdout.log | grep '"success": true' | wc -l tail -n 1000000 stdout.log | grep '"success": false' | wc -l with the following log=$(tail -n 1000000 ...
0
votes
2answers
14 views

How to know if io stream should stay open or close each time

I have a program that need to write in a file every second. I thought there is a too much overhead if I open and close the file each time. So I decided to keep open the file io stream. But I don't ...
0
votes
0answers
87 views

jdb2 keeps Hard Disk busy all the time

My system became too slow last few days. The hard disk indicator is on all the time. To discover which process is keeping the disk busy i run this command: # while true; do date; ps auxf | awk ...
2
votes
2answers
84 views

Tool to show PID and file I/O in realtime

I need to watch a program which modifies some files. I don't know which files the process is modifying_. So I'm looking for a tool that basically outputs a PID, and lista the files being ...
1
vote
2answers
47 views

dd command: Finding read/write throughput of a flash/SD?

I am running petalinux from sd card. And trying to find data copying rate from Sd card and from QSPI flash that is there on the Xilinx Zynq board. As suggested here , I am doing like this: ...
2
votes
1answer
73 views

What is the recommended way of setting a default IO scheduler on Linux?

I would like deadline to be the default IO scheduler for my system, and I don't want to lose that config when I reboot. What is the proper way of doing that? (I'm using Debian) Some hints: have a ...
7
votes
3answers
163 views

Harddrive I/O per Pid

is there any way to see the disk I/O per pid/process ? Monitorix shows me the following and correct me if I´m wrong, but it looks like that the harddrive is slowing down the whole system: UPDATE #1 ...
3
votes
0answers
31 views

Unable to close a Luks partition

For backup purposes, I have "snapshotted" a LVM partition. This partition was crypted so I have opened this Luks partition (snapshot) in order to do my backup. The problem is that I have forgotten to ...
2
votes
1answer
34 views

How to customize or reprogram function of specific keys on my keyboard and the LED on my laptop

When I disable bluetooth on my laptop, the light does not go off and the blinking of the Wi-Fi LED is starting to bother me. Since I sometimes use my laptop in a poor lighting condition an illuminated ...
0
votes
1answer
40 views

Copy a file that is in the middle of being written

I have a program that writes to the standard output. It does not write all info at once, it does computation and then writes new bits. The output of the program is being stored in a file. $ ...
4
votes
3answers
76 views

Poor IO due to LUKS/Software RAID/LVM ordering?

I'm trying to determine if I should re-setup my RAID array due to poor IO performance. First off, the system: i7 920 4 4TB WD 5400 Green drives CentOS 6.3 host Secondly, the disk setup: ...
3
votes
3answers
168 views

Can I just disable updatedb?

Is updatedb necessary at all? I never use locate and my servers tend to have dozens of millions of files which usually makes updatedb to run for a long time and consume I/O needed by MySQL and/or ...
2
votes
0answers
69 views

jbd2 journal constant i/o

iotop reports a constant i/o about 3% of [jbd2/vda1-8], I think this is the journal manager for ext4. my fstab is: UUID=X / ext4 defaults,noatime,nodiratime 1 1 tmpfs /dev/shm ...
4
votes
1answer
254 views

how can I retrieve disk IO utilization in percents on HP-UX

I need to collect data about disk utilization for selected disks. I can use glance-plus monitoring tool to display the current data in percents (it looks similar to top), but I need to collect these ...
3
votes
3answers
189 views

Is setting a higher nice level for a process an effective way to reduce its impact on system load/CPU time?

I have an rsync cron job which is pushing the server load and triggering monitor alerts. If I set the job to be run with a high nice level, would that effectively reduce the impact it has on system ...
4
votes
2answers
97 views

why does blktrace only write blocks of 8?

I want to understand the I/O pattern a database is writing to disk to decide how many disks to use for best performance. To analyse the I/O pattern I want to use blktrace and I have to grok it first. ...
1
vote
0answers
118 views

IOMMU causing freezes, disabling causes USB to not work

I'm somewhat new to linux, but I'm running a Xubuntu machine that I recently built. Since I started it up, I had noticed frequent freezes, where both the screen (if plugged in) and any SSH session ...
0
votes
0answers
61 views

Is swapping the cause of high IO on my box?

I'm running a LAMP stack on an Amazon EC2 micro instance with 616 MB of memory. This seems sufficient to be able to run a few small websites with Apache, MySQL and PHP. I have one Wordpress site ...
1
vote
3answers
153 views

Amazon EC2 micro instance large number of IO requests

I'm trying to understand why I have a huge number of EBS IO request on my Amazon EC2 micro instance. I launched the instance roughly 6 days ago and has racked up over 4 million IO requests so far. ...
1
vote
1answer
1k views

iostat: await vs. svctm

In the iostat manpage I have found these two similar columns: await The average time (in milliseconds) for I/O requests issued to the device to be served. This includes the time spent by ...
10
votes
1answer
152 views

Moving a file to a file that is being read

When a file is moved and the destination file already exists and is currently being read, will the operation succeed? Will it depend on how long the reading operation on the destination file lasts?
1
vote
1answer
57 views

I/O brings a machine to its knees [closed]

Why, on every Linux I've used, when a program is really I/O bound, it bogs the machine down? It just happened when I (accidentally) tried to make gcc compile a (valid!) 50Mb C file. GCC was so I/O ...
3
votes
3answers
70 views

Disallow File IO for a process except for FIFOs

How do you start a process that cannot do any file IO (opening / closing files, creating / deleting files, reading / writing files, etc.), except to read and write to pre-created FIFOs? (chroot will ...
0
votes
1answer
78 views

best programming language for I/O intensive tasks [closed]

I need to process "big data" (nearly 1TB which can be partitioned into smaller chunks). Consider several programming languages (Java, Python, C++, Perl) and other scripting options (Perl, awk, sed, ...
5
votes
1answer
188 views

`unbuffer` or `stdbuf` for removing stdout buffering?

Is there a difference between unbuffer(1) and stdbuf(1)? From what I gather, unbuffer makes more than the "best effort" of calling the libc function set(X)buf at the beginning, and then letting things ...
1
vote
2answers
176 views

How I/O channels are implemented in Linux kernel?

stdin, stdout, stderr are some integers that index into a data structure which 'knows' which I/O channels are to be used for the process. I understand this data structure is unique to every process. ...
4
votes
1answer
125 views

Execution time and resources after processes that has been running for so long

This might be a basic question, but I am getting hard time finding an answer to it. I am using RHEL6. After running any process that takes significant cpu time, I get a line that tells (I guess) the ...
2
votes
2answers
257 views

Massive, unpredictable I/O performance drop in Linux

I'm using Debian testing without any problems for ~6 years (I'm just regularly updating it), but recently it started to show a random behaviour that can be summarized as "Low I/O performance which ...
2
votes
1answer
53 views

Getting IO privileges in Linux

I have installed flashrom software. When i try to run sudo flashrom command it gives me "Could not get I/O privileges (Operation not permitted). You need to be root" error. Also I tried su command to ...
1
vote
0answers
114 views

How different is I/O handling of hard disk in AIX and Redhat Linux?

I am running a hadoop I/O workload in redhat linux and have ran that in IBM AIX as well with same underlying hardware, disk and disk configuration. With the default settings on the os redhat linux is ...
0
votes
2answers
90 views

IO utilization for /dev/null redirection?

I always use nohup to start my system. However, the output to nohup is so big that I'm thinking to redirect it to /dev/null. My concern is, will redirecting to /dev/null also incur some I/O operations ...
1
vote
1answer
236 views

How to measure total disk I/O per hour

I have a cloud server were we get billed also for disk IO usage. Here is an example from the stats: 04/Sep/2013 07:24:19 04/Sep/2013 08:24:19 0,5 GB / 1 vCPU (0,08 Kr. per hour): Charge for ...
2
votes
1answer
66 views

Why don't I see a file being copied right away with ls?

Is it due to the buffering in memory? I did cp /network/large_file . & and I kept doing ls -lh to monitor progress, but the file didn't appear until it was about 400MB. Linux 2.6 kernel, Bash 4, ...
4
votes
1answer
180 views

fstrim and iostat

I have a new samsung ssd in my new notebook. I tuned up everything to avoid writings in the disk (firefox profiles and /var/log in memory), I'm using a ext4 fs with relatime and I use fstrim once a ...
1
vote
1answer
75 views

Strange problem with IO or file system or what?

On a SLES 11 SP2 32-bit system I'm seeing a strange problem. It's as if the OS can not open a file from the beginning of the file. Say I have a file that is 200 lines. If I cat or more or vi the ...
13
votes
3answers
953 views

Determining Specific File Responsible for High I/O

This is a simple problem but the first time I've ever had to actually fix it: finding which specific files/inodes are the targets of the most I/O. I'd like to be able to get a general system overview, ...
1
vote
1answer
359 views

-bash: /usr/sbin/useradd: Input/output error — What does this mean?

Today, on my Centos server I tried to add a user but got the following error: -bash: /usr/sbin/useradd: Input/output error How do I fix it?
3
votes
2answers
102 views

How to make directory modication date change when files from that dir change?

For example, if a file has been changed in that directory, then directory modification date should be updated. Basically any changes that happen in that directory should trigger a "touch" on the ...
2
votes
0answers
404 views

find ount what [flush-8:0] is writing

Using iotop, I found out that [flush-8:0] is doing a lot of hard disk activity, which explains the annoying slowdowns. However, I can't figure out what's the actual cause behind this flushing. No ...
4
votes
2answers
169 views

Why do systems become slow when doing massive writes to disk?

I want to know why systems become slow when writing mass data to disk. I think that for system to become slow, there should be some issue with CPU. But write is only I/O bound. Do hardware ...
2
votes
0answers
84 views

Shorter timeout on I/O errors MacOS X

How do you set a shorter timeout value for read/write I/O errors on MacOSX? We tend to get a few semicrashed disks and want to rsync the contents to a secure location, but when the file subsystem ...
2
votes
1answer
108 views

CONFIG_GPIO_SYSFS makes /sys/class/leds disappear

I have an embedded Linux board I'm working on, with a button and a couple LEDs. By default, I can control the LEDs via /sys/class/leds/redled/brightness However, I have no way to monitor the ...
3
votes
3answers
547 views

Special File that causes I/O error

I want to automatically test if a piece of software reacts as expected if an essential SQLite DB file fails to be read (causing an I/O error). Exactly that happened some days ago at a client. We ...
20
votes
3answers
1k views

Can the “du” program be made less aggressive?

We have a regular job that does du summaries of a number of subdirectories, picking out worst offenders, and use the output to find if there are things that are rapidly rising to spot potential ...
1
vote
1answer
109 views

Determine how much a process is using each disk?

How do I tell how much load a particular process is contributing to each of several available volumes/mounts? It seems that dstat only shows aggregate stats across all processes per disk, and iotop ...
2
votes
2answers
292 views

iotop but for particular disk?

Is there a tool like iotop but for monitoring IO on specific volumes? (Or perhaps I missed a way to filter iotop?) If not is there any way to get at this information via (say)/proc? (dstat etc. ...
1
vote
1answer
2k views

I/O errors on hard disk on Linux boot

Here is a screenshot of booting Arch. I guess the reason is that I force poweroff my Arch linux many times. (I already force poweroff my Arch because my firefox flash plugin use too much memory to ...