The speed at which a program runs

learn more… | top users | synonyms (1)

8
votes
1answer
208 views

Do processes in cgroups have to be set every boot? If so, how to persist them?

I was reading this answer to a question on setting limits for processes by using cgroups. The sample given sets limits for a process (in the example, sshd). In the answer, the PID of the process is ...
13
votes
7answers
5k views

Make disk/disk copy slower

Is there a method of slowing down the copy process on Linux? I have a big file, say 10GB, and I'd like to copy it to another directory, but I don't want to copy it with full speed. Let's say I'd like ...
7
votes
2answers
3k views

Why load is high despite the fact that neither CPU or disk is overused

I'm getting the following output from top: Cpu(s): 43.8%us, 32.5%sy, 4.8%ni, 2.0%id, 15.6%wa, 0.2%hi, 1.2%si, 0.0%st Mem: 16331504k total, 15759412k used, 572092k free, 4575980k buffers ...
2
votes
3answers
126 views

How to optimize this oneliner? (if second column empty, put the line in another file)

I have a little "oneliner": while read ONELINE; do if [[ -n "`echo $ONELINE | awk '{print $2}'`" ]]; then echo "$ONELINE" >> LIST-ok.txt else echo "$ONELINE" >> ...
2
votes
1answer
726 views

Analyse the performance of an rsync command from FreeNAS to a USB drive

I infrequently run a task where I rsync my photos (~30 directories with 10-100 files in each) from my FreeNAS machine to an external USB hard drive (500GB WD) as a redundant backup. I execute the ...
28
votes
4answers
2k views

python vs bc in evaluating 6^6^6

I am evaluating the expression 6^6^6 using python and bc separately. The content of the python file is print 6**6**6. When I execute time python test.py, I get the output as real 0m0.067s ...
11
votes
4answers
8k views

Can I just disable updatedb?

Is updatedb necessary at all? I never use locate and my servers tend to have dozens of millions of files which usually makes updatedb to run for a long time and consume I/O needed by MySQL and/or ...
0
votes
1answer
6k views

What is the effect of rsync --block-size on large files?

I want to backup a few terabytes of large files (500mb to 1500mb each) to a backup server (BULK storage) via rsync. For this I use the following command (updated with suggestions from @Gilles): ...
1
vote
0answers
32 views

Amount of memory transfer on a running Linux

Can I determinate the amount of RAM exchange (between the CPU and the RAM) on a running Linux system? I'm not looking for the max RAM speed (then memtest would be valid answer). I'm looking for the ...
1
vote
1answer
160 views

How to measure the time a packet spends on the system(router)?

I have a streaming system and one if its components is a router/firewall. I'm using iptables for setting the required behaviour on the router. I'm having performance issues in forms of a constant ...
1
vote
1answer
129 views

Do programs access tools like grep, sed, tr, or sort due to their efficiency?

Or it's meaningful only when you are in the command line and want something simple done right away. Are these tools more efficient than a program library?
5
votes
2answers
6k views

Why is dd using direct slower writing to disk than to a file

I am trying to compare aggregate write rates when writing to a file in a GPFS file system, as compared to writing directly to a disk on a system with Red Hat Enterprise Linux Server release 6.4 ...
0
votes
1answer
202 views

Check multiple directory properties

I'd like to make this test as fast as possible: (Bash) if [[ -d $directory_path && -r $directory_path && -x $directory_path ]]
1
vote
0answers
54 views

memory consumption alert

My VPS has reported a memory consumption alert says reached 273% and I cannot access any of my sites. But I checked on the terminal today and it does not look like a memory problem. Am I correct in ...
4
votes
1answer
286 views

CPU is free, yet bash script not utilizing all CPU resources

I ran a simple script to generate a large (10000000 lines) csv file with 6 fields in which some fields changed in each line/row, using a while loop. The machine had all (32) CPUs free, lot of RAM (~31 ...
2
votes
2answers
1k views

What is the most accurate way to measure disk read/write speed for an OpenVZ VPS host from within the host itself?

CentOS 6.x | OpenVZ I have an openvz VPS host and would like to measure disk read/write speed. Historically, on other physical systems, I've ran hdparm to collect this information. I haven't been ...
2
votes
1answer
282 views

Does negative vs positive matching impact firewall performance?

I am curious if using negative vs. positive matching impacts the performance of the netfilter stack. e.g. is iptables -I INPUT -p tcp -s 192.168.0.0/16 -j DROP equivalent to iptables -I INPUT -p tcp ...
0
votes
1answer
191 views

ERROR: cube viewer is not available!

I have installed and configured the following: cube-4.2.1 opari2-1.1.1 papi-5.2.0 scalasca-2.0 scorep-1.2.1 I am trying to run scalasca -examine, but I get the following error: ERROR: cube viewer ...
11
votes
3answers
5k views

Why is rm slow?

I have been trying to use rsnapshot for making backups, but I'm finding it unusable. While it is able to diff a directory (50gb) and duplicate it (hardlinking every file) in a few minutes, and I can ...
4
votes
2answers
3k views

Basic sed command on large one-line file: couldn't re-allocate memory

I have a 250 MB text file, all in one line. In this file I want to replace a characters with b characters: sed -e "s/a/b/g" < one-line-250-mb.txt It fails with: sed: couldn't re-allocate ...
7
votes
2answers
353 views

How can other processes affect measurements made with `time`?

If I time a process using the time command, I get output for 'real', 'user', and 'sys'. My understanding from this discussion is that 'real' is wall time, whereas 'user' and 'sys' are process time. ...
1
vote
1answer
3k views

Performance of RAID 1 with 3 Disks under Linux

The standard way to setup a RAID 1 under Linux is to use two disks of the same size. The write performance is almost as good as with a single disk drive. The read performance can be up to twice the ...
0
votes
2answers
54 views

Fedora 17 Performance Issues [closed]

I have a Dell Latitude E4310. I have Windows 7 and Fedora installed on it. I rarely use windows and I have been using fedora for a good 9 months now. Recently the performance on my machine degraded ...
5
votes
2answers
11k views

Running thousands of curl background processes in parallel in bash script

I am running thounsand of curl background processes in parallel in the following bash script START=$(date +%s) for i in {1..100000} do curl -s "http://some_url_here/"$i > $i.txt& ...
3
votes
4answers
232 views

Does cron jobs per se represent a significant burden on a modern system?

I'd like to run a pretty simple script (is there a dir with name x in dir y if so move it to dir z–and x will only be there about once a day) every 15 seconds or so (one minute divided into 4*15 ...
2
votes
1answer
62 views

Multiple Lan interfaces on one VM rather than multiple VM

I'm looking if it's possible to give rights, to only allow the use of one network interface to a specific user on a Linux distribution. My use case: I want, for my studies, testing the ...
0
votes
2answers
210 views

Varing speed when reading sequentially from a HDD

I have just got a new HDD and I wanted to test the sequential read speed (the whole disk). I used: pv /dev/sda > /dev/null The disk is 500GB WD VelociRaptor (WD5000HHTZ). At the beginning the ...
0
votes
1answer
315 views

Performance Issue: AWS Medium Linux Instance V/S Hetzner Dedicated Instance

I am testing an AWS Medium Instance with CentOS (AWS AMI) and comparing it with Hetzner's EX40-SSD (http://www.hetzner.de/hosting/produkte_rootserver/ex40ssd). Software setup on both is comparable( ...
26
votes
9answers
2k views

for vs find in Bash

When looping through files there are two ways: use a for-loop: for f in *; do echo "$f" done use find: find * -prune | while read f; do echo "$f" done Assuming these two loops will ...
1
vote
1answer
338 views

Ubuntu 12.04LTS becoms slow and jerky randomly for a mintue and then becomes normal by itself [closed]

I am using Ubuntu 12.04LTS on my Toshiba satellite L510 and I have only Ubuntu installed. The system becomes slow and jerky by itself after every 10minutes or so and the remains like that for less ...
14
votes
2answers
2k views

Why is wc so slow?

Why is the wc utility so slow? When I run it on a large file, it takes about 20 times longer than md5sum: MyDesktop:/tmp$ dd if=/dev/zero bs=1024k count=1024 of=/tmp/bigfile 1024+0 records in 1024+0 ...
3
votes
3answers
1k views

Best way to benchmark different encryption solutions on my system

I want to compare different encryption solutions for encrypting my system, possibly different solutions for different parts of the system such as /usr or /home. In particular I look at dm-crypt ...
0
votes
2answers
21k views

CPU usage monitoring in AIX servers

In order to monitor the CPU usage in an AIX server I'm using the following script that is executed every 10 mins. lparstat 2 10 > cpu usage=$(tail -10 cpu | awk 'BEGIN {sum=0;} {sum+=$4} END{print ...
3
votes
1answer
1k views

Efficient way to print lines from a massive file using awk, sed, or something else? [duplicate]

If I had a plain-text file containing 8 million lines and I want to print out lines 4,000,010 to 4,000,000 to the screen, which would be more efficient: awk or sed? There is no pattern to the text, ...
6
votes
2answers
2k views

Massive, unpredictable I/O performance drop in Linux

I'm using Debian testing without any problems for ~6 years (I'm just regularly updating it), but recently it started to show a random behaviour that can be summarized as "Low I/O performance which ...
1
vote
0answers
328 views

Why does my CMS run extremely slow in my workstation (Ubuntu)

For over a year I have been struggling with the response speed on my Drupal v7.2x CMS install. Let me explain. I'm running Drupal 7.2x on an Ubuntu 12.10 (upgrade to 13.xx pending) for the purpose of ...
7
votes
2answers
8k views

Benchmark ssd on linux: How to measure the same things as crystaldiskmark does in windows

I want to benchmark a ssd (possibly with encrypted filesystems) and compare it to benchmarks done by crystaldiskmark on windows. So how can I measure approximately the same things as ...
3
votes
1answer
693 views

Rsnapshot via SSH speed issue

I am trying to backup bunch of desktops running RedHat 6.4 (i86_64) LVM on the top of ext4 to our file server running RedHat using rsnapshot and ssh. I am on 1GbE. I am finding the speed of the first ...
1
vote
0answers
148 views

Terraria Server Seems to be Slowing Down Web Server [closed]

I currently have a CentOS 6 Cloud server (2gigs of ram, 40gigs of SSD storage, 2.4ghz quad core, and 100M unmetered port for bandwidth) that has in the past run a TeamSpeak, Minecraft FTB (modded ...
4
votes
3answers
833 views

Why is bash's printf faster than /usr/bin/printf?

I have two ways of calling printf on my system: $ type -a printf printf is a shell builtin printf is /usr/bin/printf $ file /usr/bin/printf /usr/bin/printf: ELF 64-bit LSB executable, x86-64, ...
1
vote
2answers
555 views

Performance and limitations of using an X GUI remotely?

I don't really have any experience with X. It appears from what I read that X has always been built from the ground up to allow windows in the WM to be transmitting over the internet, without ...
0
votes
1answer
2k views

How can I install perf 3.4.25?

By installing perf using sudo apt-get install linux-tools-common sudo apt-get install linux-tools-3.2.0.23 gave me perf version 3.2.14 How can I install perf 3.4.25? Is it related to kernel ...
23
votes
2answers
17k views

Performance of unix sockets vs TCP ports

For example on php-fpm: #listen = 127.0.0.1:9000 listen = /var/run/php-fpm/php-fpm.sock Is there any major performance differences between using unix socket-based listeners over TCP ports? (Not ...
10
votes
2answers
18k views

rsync is very slow (factor 8 to 10) compared to cp on copying files from nfs-share to local dir

I have a freshly installed Ubuntu-server which is ought to be the new backup-server for our VM-storage. The server has 4 nics, 2 of them 10Gbit (in fact an intel x540-T2 with the newest driver ...
28
votes
3answers
12k views

grep: memory exhausted

I was doing a very simple search: grep -R Milledgeville ~/Documents And after some time this error appeared: grep: memory exhausted How can I avoid this? I have 10GB of RAM on my system and few ...
0
votes
2answers
1k views

Ubuntu is running slow

I'm not sure since when it became slow, but I think after I did apt-get update. Here's my machine details: I can see from the system monitor that the CPU is working hard specially when I run Chrome ...
1
vote
1answer
324 views

Are these throughput numbers typical for an SSD?

Device: rrqm/s wrqm/s r/s w/s rkB/s wkB/s avgrq-sz avgqu-sz await svctm %util sdb 19722.20 170.80 7141.60 27.80 114246.40 788.80 32.09 52.25 7.19 ...
10
votes
6answers
4k views

Can I parallelize sort?

For example for bzip there is pbzip, a parallel version of bzip. Is there any such parallelization tools for sort to improve performance?
135
votes
1answer
293k views

How do you empty the buffers and cache on a Linux system?

Prior to doing some benchmarking work how would one free up the memory (RAM) that the Linux Kernel is consuming for its buffers and cache?
4
votes
1answer
425 views

How accurate is Conky?

I'm on Crunchbang 64 bit, Conky shows that I'm using 4% of my CPU. But I can feel the CPU burning so hot, got Spotify, Chrome and couple other apps running. On windows 7 chrome uses about half of the ...