Tagged Questions

The tag has no wiki summary.

learn more… | top users | synonyms

1
vote
1answer
57 views

Slow Linux machine [closed]

Every time I login (via ssh) in my Linux/debian computer it takes too long for the password prompt to appear. Also, every time I try to run a python script or a tcpdump it takes too long until it ...
9
votes
1answer
121 views

Limit on the number of btrfs snapshots?

I am considering using btrfs on my data drive so that I can use snapper, or something like snapper, to take time based snapshots. I believe this will let me browse old versions of my data. This would ...
2
votes
0answers
55 views

Cgroups - memory subsystem

I want to set the memory.limit_in_bytes parameter for a control group and disable OOM, so processes freeze when the limit is reached. But i want to change that limit dynamically, if there is more ...
3
votes
2answers
85 views

Testing the Success of a Congestion Algorithm

How do you test whether a particular congestion algorithm is working for you? I ask because it's not as if I can easily re-create a representative workload for most algorithms. I'm current looking at ...
1
vote
1answer
62 views

apache mod_security and performance

I have a list of bots to block, so I was thinking that fail2ban could be a solution until I realized that mod_security would be more efficient in this kind of tasks. The number of bots is huge, so ...
0
votes
0answers
46 views

OTG musb and full speed bulk endpoint throughput

We are developing an application on an OMAP3 device (DM3730 ti). An acquisition board gets samples and sends them to the OMAP board via USB. This acquisition board does a 16KHz sampling which ...
3
votes
3answers
118 views

Advantages to uploading files to /tmp before moving off to permanent storage?

It seems the common trend in programming when building functionality for handling file uploads is to have the file first uploaded to a temporary directory/folder (e.g. /tmp on Linux). Once the file ...
5
votes
1answer
172 views

Does ionice work with the deadline scheduler?

My Debian Wheezy systems use the deadline scheduler. I'm accustomed to using ionice to reschedule the I/O priority of disk-intensive jobs at busy times, and anecdotally this seems to help (but I ...
1
vote
0answers
68 views

Do kernel threads seem to interfere with full tickless mode?

I'm trying to disable local timer interrupts for low latency. I have full tickless mode enabled in the kernel config and I have the boot parameter nohz_full set for the cores in question. However ...
3
votes
1answer
1k views

Very high CPU load, but nothing significant in top

I'm running Ubuntu Linux 12.04.1, with VirtualMin 4.08.gpl GPL and 2 CPU cores. Pretty much all the time for the last few weeks, it's been running at well above load average of 5, usually up closer ...
0
votes
1answer
310 views

How do I create a RAM disk on Linux Mint?

I am running a package that adds data to the end of 140–300 files each time through the process. I'm thinking of moving the process to a RAM disk, and using rsync to copy it back when done. My goal ...
7
votes
3answers
3k views

What are the exact differences between awk and cut with grep? [closed]

We know that we can get the second column of the line we want from a file using these two techniques: awk '/WORD/ { print $2 }' filename or grep WORD filename| cut -f 2 -d ' ' My questions are: ...
1
vote
2answers
354 views

Very poor read performance compared to write performance on md(raid1) / crypt(luks) / lvm

I'm experiencing very poor read performance over raid1/crypt/lvm. In the same time, write speeds are about 2x+ faster on the same setup. On another raid1 setup on the same machine I get normal read ...
0
votes
0answers
31 views

If a buggy application underperforms, it it possible server tuning could have no affect?

To set the stage, imagine if you will: A read-heavy Tomcat Application with MySQL on Red Hat Enterprise Linux with some problematic Java Class files which resulted in the application performing a ...
1
vote
0answers
108 views

Monitoring Disk Latency

We have quite a few physical machines in our environment, yet we have no trending data over a period of time for disk latency statistics. We can easily run the standard iostat commands to see what the ...
3
votes
2answers
531 views

What is the expected performance of obnam? Or: why is it so slow?

I've been playing around with obnam these last few days, and although it looks very promising and seems to offer basically everything I ever wanted in a backup tool, I am pretty disappointed in its ...
1
vote
1answer
256 views

CPU Placement in KVM

I have a configuration of KVM guests where the cpu placement is configured as follows: <vcpu placement='static'>1</vcpu> Now since I don't have a cpuset specified I was reading libvirt ...
0
votes
1answer
251 views

Is it useful to setup RAID0 on laptop? [closed]

I have a Dell laptop, which I am going to replace the CD-ROM hub with a HDD. I am thinking if I setup a RAID0 on my original HDD and the new HDD, would I have some I/O performance improvement? ...
1
vote
1answer
51 views

How does downloading speed vary between download managers? [closed]

I used several download managers on Ubuntu and found variation in downloading speed. uGet (recommended) Flareget xdm (Xtreme Download Manager) Steadyflow I find variation in downloading speed. My ...
3
votes
1answer
166 views

Performance differences between pipelines and process substitution

I tend to use pipelines in my bash scripts over process substitution in most situations, especially in cases of using multiple sets of commands as it seems more readable to do ... | ... | ... over ... ...
2
votes
1answer
192 views

speed up linux server [closed]

On my VPS, I have centOS 6.5 installed with 2 virtual cpu 2048 MB memory, 60 GB disk and 300 GB monthly data. Doing a speed test today resulted in 168.62 Mbit/s dload and 37.39 Mbit/s upload. Then my ...
3
votes
2answers
666 views

Large ext4 partition ridiculously slow when writing

We have four identical Linux servers with a large (5T) hard disk partition. We have Scientific Linux with this kernel: Linux s3.law.di.unimi.it 2.6.32-358.18.1.el6.x86_64 #1 SMP Tue Aug 27 14:23:09 ...
1
vote
0answers
70 views

is star faster than GNU and BSD tar? [closed]

I made serveral runs (create a tarball) on OS X Mavericks with BSD tar, GNU tar and star. star is always the winner. System is iMac (Mid 2010) only running Terminal. root@time var> du -sh log/ ...
3
votes
2answers
228 views

How to record the actual running time of a program with other programs running? [duplicate]

When timing the wall time performance of an OpenMP program on Linux while other programs are running, how can I get the actual running time?
2
votes
4answers
733 views

Why is writing SLOW on raw device, and FAST on filesystem (USB key)?

I have a USB key (PQI U822V-Speedy 32G) that I am trying to benchmark quick'n'dirty on Linux. I'm testing write bandwith. dd on raw partition I created a partition starting at sector 2048, then did ...
5
votes
1answer
274 views

Attempting to Abbreviate kSAR's PDF output

I'm currently writing a cronjob around kSar's command line (non-GUI) options in order generate PDF's. I'm just going to email a PDF of the previous day's activity to a different webmaster (basically ...
3
votes
1answer
536 views

RFC 2544 / Y1564 software implementation

Is there any RFC 2544 and/or Y1564 software available for Linux? I'm aware that tools like iperf, bw-ng and bmon exist, but I was not able to find something that mimics Ethernet tester functionality ...
12
votes
1answer
3k views

Why is my TCP throughput much greater than UDP throughput?

I haven't done anything unusual to my hardware or kernel configurations (all default settings, fresh OS install, Linux kernel 3.11 TCP/IP stack) and I'm averaging about 3.83 million messages per ...
1
vote
1answer
198 views

High performance routing with high churn ruleset. What approach is most likely to scale to C10K and beyond?

I've been asked to create a high throughput router using PC / server hardware. I'm modestly familiar with pf, iptables, and tc, but I've never had such high churn and so many rules. I hope you can ...
24
votes
5answers
3k views

Why is iterating over a file twice faster than reading it into memory and computing twice?

I'm comparing the following tail -n 1000000 stdout.log | grep -c '"success": true' tail -n 1000000 stdout.log | grep -c '"success": false' with the following log=$(tail -n 1000000 stdout.log) echo ...
1
vote
1answer
313 views

Can we make grep faster by indexing words in files? [duplicate]

Over a decade ago I imagined an improved version of grep that would use indexes to make recursive searching faster. I never got around to writing it, but I wonder if somebody else did! My original ...
44
votes
1answer
2k views

Diagram of Linux kernel vs. performance tools?

Is there a diagram that shows how the various performance tools such as ip, netstat, perf, top, ps, etc. interact with the various subsystems within the Linux kernel?
6
votes
1answer
124 views

Do processes in cgroups have to be set every boot? If so, how to persist them?

I was reading this answer to a question on setting limits for processes by using cgroups. The sample given sets limits for a process (in the example, sshd). In the answer, the PID of the process is ...
7
votes
7answers
940 views

Make disk/disk copy slower

Is there a method of slowing down the copy process on Linux? I have a big file, say 10GB, and I'd like to copy it to another directory, but I don't want to copy it with full speed. Let's say I'd like ...
3
votes
2answers
425 views

Why load is high despite the fact that neither CPU or disk is overused

I'm getting the following output from top: Cpu(s): 43.8%us, 32.5%sy, 4.8%ni, 2.0%id, 15.6%wa, 0.2%hi, 1.2%si, 0.0%st Mem: 16331504k total, 15759412k used, 572092k free, 4575980k buffers ...
2
votes
3answers
92 views

How to optimize this oneliner? (if second column empty, put the line in another file)

I have a little "oneliner": while read ONELINE; do if [[ -n "`echo $ONELINE | awk '{print $2}'`" ]]; then echo "$ONELINE" >> LIST-ok.txt else echo "$ONELINE" >> ...
2
votes
1answer
364 views

Analyse the performance of an rsync command from FreeNAS to a USB drive

I infrequently run a task where I rsync my photos (~30 directories with 10-100 files in each) from my FreeNAS machine to an external USB hard drive (500GB WD) as a redundant backup. I execute the ...
26
votes
4answers
2k views

python vs bc in evaluating 6^6^6

I am evaluating the expression 6^6^6 using python and bc separately. The content of the python file is print 6**6**6. When I execute time python test.py, I get the output as real 0m0.067s ...
5
votes
4answers
1k views

Can I just disable updatedb?

Is updatedb necessary at all? I never use locate and my servers tend to have dozens of millions of files which usually makes updatedb to run for a long time and consume I/O needed by MySQL and/or ...
0
votes
1answer
2k views

What is the effect of rsync --block-size on large files?

I want to backup a few terabytes of large files (500mb to 1500mb each) to a backup server (BULK storage) via rsync. For this I use the following command (updated with suggestions from @Gilles): ...
1
vote
0answers
16 views

Amount of memory transfer on a running Linux

Can I determinate the amount of RAM exchange (between the CPU and the RAM) on a running Linux system? I'm not looking for the max RAM speed (then memtest would be valid answer). I'm looking for the ...
1
vote
1answer
75 views

How to measure the time a packet spends on the system(router)?

I have a streaming system and one if its components is a router/firewall. I'm using iptables for setting the required behaviour on the router. I'm having performance issues in forms of a constant ...
4
votes
2answers
2k views

Why is dd using direct slower writing to disk than to a file

I am trying to compare aggregate write rates when writing to a file in a GPFS file system, as compared to writing directly to a disk on a system with Red Hat Enterprise Linux Server release 6.4 ...
1
vote
0answers
40 views

memory consumption alert

My VPS has reported a memory consumption alert says reached 273% and I cannot access any of my sites. But I checked on the terminal today and it does not look like a memory problem. Am I correct in ...
3
votes
1answer
164 views

CPU is free, yet bash script not utilizing all CPU resources

I ran a simple script to generate a large (10000000 lines) csv file with 6 fields in which some fields changed in each line/row, using a while loop. The machine had all (32) CPUs free, lot of RAM (~31 ...
2
votes
1answer
429 views

What is the most accurate way to measure disk read/write speed for an OpenVZ VPS host from within the host itself?

CentOS 6.x | OpenVZ I have an openvz VPS host and would like to measure disk read/write speed. Historically, on other physical systems, I've ran hdparm to collect this information. I haven't been ...
2
votes
1answer
145 views

Does negative vs positive matching impact firewall performance?

I am curious if using negative vs. positive matching impacts the performance of the netfilter stack. e.g. is iptables -I INPUT -p tcp -s 192.168.0.0/16 -j DROP equivalent to iptables -I INPUT -p tcp ...
0
votes
1answer
97 views

ERROR: cube viewer is not available!

I have installed and configured the following: cube-4.2.1 opari2-1.1.1 papi-5.2.0 scalasca-2.0 scorep-1.2.1 I am trying to run scalasca -examine, but I get the following error: ERROR: cube viewer ...
4
votes
2answers
1k views

Why is rm slow?

I have been trying to use rsnapshot for making backups, but I'm finding it unusable. While it is able to diff a directory (50gb) and duplicate it (hardlinking every file) in a few minutes, and I can ...
3
votes
2answers
1k views

Basic sed command on large one-line file: couldn't re-allocate memory

I have a 250 MB text file, all in one line. In this file I want to replace a characters with b characters: sed -e "s/a/b/g" < one-line-250-mb.txt It fails with: sed: couldn't re-allocate ...