The tag has no usage guidance.

learn more… | top users | synonyms (1)

23
votes
1answer
17k views

How OOM killer decides which process to kill first?

This answer explains the actions taken by the kernel when an OOM situation is encountered based on the value of sysctl vm.overcommit_memory. When overcommit_memory is set to 0 or 1, overcommit is ...
13
votes
9answers
3k views

Memory problems when compressing and transferring a large number of small files (1TB in total)

I have 5 million files which take up about 1TB of storage space. I need to transfer these files to a third party. What's the best way to do this? I have tried reducing the size using .tar.gz, but ...
12
votes
2answers
2k views

memory limit of the Linux kernel

I have a perplexing problem. I have a library which uses sg for executing customized CDBs. There are a couple of systems which routinely have issues with memory allocation in sg. Usually, the sg ...
11
votes
1answer
2k views

Why can't the OOM-Killer just kill the process that asks for too much?

It is explained here that the OOM-Killer can be configured via overcommit_memory and that: 1 = no overcommit. Allocations fail if asking too much. 0, 2 = overcommit. Kill some process(es) based on ...
9
votes
2answers
5k views

How to set OOM killer adjustments for daemons permanently?

Running some Linux servers with single or just a few vital system service daemons, I would like to adjust the OOM killer for those daemonized processes in case something odd happens. For example, ...
8
votes
2answers
343 views

How can my HDD swap without a swap partition?

I have no swap partition on my disk because I prefer having the OOM reaper kill anything it wants quickly rather than having to wait 10 minutes for my swap partition to get filled + 5 other minutes to ...
7
votes
1answer
5k views

OOM Killer - killed MySQL server

On one of our MySQL master, OOM Killer got invoked and killed MySQL server which lead to big outage. Following is the kernel log: [2006013.230723] mysqld invoked oom-killer: gfp_mask=0x201da, ...
7
votes
2answers
26k views

Debug out-of-memory with /var/log/messages

The following report is thrown in my messages log: kernel: Out of memory: Kill process 9163 (mysqld) score 511 or sacrifice child kernel: Killed process 9163, UID 27, (mysqld) total-vm:2457368kB, ...
7
votes
1answer
876 views

kvm killed by oomkiller

kvm version: QEMU emulator version 1.1.2 (qemu-kvm-1.1.2+dfsg-6+deb7u3, Debian), Copyright (c) 2003-2008 Fabrice Bellard libvirtd version: libvirtd (libvirt) 0.9.12.3 debian version: 7.5 I'm running ...
5
votes
1answer
901 views

Wget out of memory error kills process

I wanted to backup all my .vcf files from my carddav server (ownCloud). The script is very simple and is the following: $ wget -Avcf -r -np -l0 --no-check-certificate -e robots=off --user=user \ ...
4
votes
2answers
3k views

Basic sed command on large one-line file: couldn't re-allocate memory

I have a 250 MB text file, all in one line. In this file I want to replace a characters with b characters: sed -e "s/a/b/g" < one-line-250-mb.txt It fails with: sed: couldn't re-allocate ...
4
votes
2answers
892 views

Out of memory while using sed with multiline expressions on giant file

I am currently trying to remove all newlines that are not preceded by a closing parenthesis, so I came up with this expression: sed -r -i -e ":a;N;$!ba;s/([^\)])\n/\1/g;d" reallyBigFile.log It does ...
4
votes
0answers
546 views

receive signal before process is being killed by OOM killer / cgroups

In our cluster, we are restricting our processes resources, e.g. memory (memory.limit_in_bytes). I think, in the end, this is also handled via the OOM killer in the Linux kernel (looks like it by ...
3
votes
1answer
447 views

OOM Killer value always one less than set

I am trying to set the oom_adj value for the out of memory killer, and each time I do (regardless of the process) I get back exactly one less than I set (at least for positive integers. I haven't ...
3
votes
1answer
198 views

Exclude user from OOM killer in unix

Is there anyway to exclude some users from the out-of- memory killer in Unix? On the other way, can I set priority for user?
3
votes
1answer
298 views

What happens when a tmpfs volume is full and swap is full? Is Linux's OOM-killer involved? [duplicate]

I understand that if a persistent / disk-based volume is full, files need to be explicitly deleted to free up space before more can be added. Further, I understand that if memory is exhausted, the ...
3
votes
1answer
371 views

bash runs out of memory

This question is a fork of this SO question. Here is the MCVE version: $ PS1='Parent-$ ' Parent-$ type seq seq is /usr/bin/seq Parent-$ bash $ PS1='Child-$ ' Child-$ for i in $(seq 1000000000); do ...
3
votes
2answers
2k views

Log from oom killer

I'm running a virtual machine at a provider where you pay for everything you use (CPU, memory, disk IO, bandwidth, etc). Currently my machine has 512MB ram and 1GB swap area. The kernel version is ...
3
votes
1answer
124 views

How do you prevent system from freezing when memory is used up?

I've been running a process (gdb) that can easily use up all my ram and swap space. Every time that happens the whole system becomes very non-responsive and Xorg will barely update, I can't swith to ...
2
votes
2answers
3k views

Out of Swap - What happens?

On my debian VM machine with 512MB RAM and 348MB Swap, what will happen if i open a 1GB file in an editor and get out of memory? Will it crash the system? Or if not, how will linux handle this? ...
2
votes
1answer
249 views

Find something that is occupying lots of memory and not visible in `ps` or similar

I have a VM that's having memory issues. One of the tasks I'd like to run in it is crashing with out-of-memory errors. However, when it crashes, the system still stays memory starved. I'm not sure if ...
2
votes
2answers
2k views

Linux freezing randomly

My Computer has been freezing a lot lately, and with no apparent reason.It freezes even if my usage is 3% CPU and 9% RAM. I was using Windows 8 until I decided I'd try to move on to linux, so I ...
2
votes
1answer
64 views

Why is IO so high when almost out of memory

On my work laptop with an SSD and no swap, I sometimes run out of memory when running RAM-expensive applications (virtual machine, etc). When that happens, the system becomes slow (expected) but what ...
2
votes
2answers
267 views

cannot find what has used all the memory

The server has about 24GB memory. By running free -g I find the memory is used up total used free shared buffers cached Mem: 23 23 0 ...
2
votes
2answers
389 views

Why is scdaemon ballooning out of control?

My system keeps getting wedged because an scdaemon process has been spawned that has grown to consume all free memory on the computer. (I do not use, and have never used, smart cards in the vicinity ...
2
votes
1answer
118 views

kvm_open: cannot open /proc

I have 100+ boxes running FreeBSD 8.4 amd64 RELEASE (p9) with the same configuration. And only one of them sometimes behaves strangely: load average (generally 4~6, it's ok course box have 8 CPU ...
2
votes
3answers
393 views

Linux freezes under high memory usage

When I start memory-intense processes (such as git gc in a repository with huge files), Linux starts becoming unresponsive after some time, at first the UI lags a little, then the mouse stops moving ...
2
votes
1answer
5k views

How do I read the output of `dmesg` to determine how much memory a process is using when oom-killer is invoked?

I asked this question: Running `sudo /sbin/service mysqld start` causes system to crash In the comments of one of the answers, a very helpful individual is asking for more information regarding how ...
2
votes
0answers
33 views

OOM Killer: Processes have a score of over a 1000

All top links when Googling for OOM score seem to indicate that the values must be between -1000 and 1000. I tried to verify that with a simple cat /proc/*/oom_score | sort -n | less and I ...
2
votes
1answer
29 views

How does OSX handle Out of Memory conditions?

Linux uses the OOM killer; what do Macs do?
2
votes
0answers
29 views

Any way to specify process to call on Linux when OOM activates?

On my embedded system I'd like to record when the system OOM killer actives, e.g. by setting an env. variable in u-boot. Is there any way to specify a hook function to call on the OOM event?
2
votes
0answers
193 views

Is unreclaimable memory allocated to slab considered used or available cache?

After evaluating /proc/meminfo, I see the following information: $cat /proc/meminfo MemTotal: 197852592 kB MemFree: 64755992 kB MemAvailable: 65655112 kB Buffers: 4388 kB ...
2
votes
0answers
96 views

wProcess killed by OOM killer when plenty of memory apparently free

I'm working on an embedded ARM-based platform. 32-bit, 512MB of RAM, no swap. Linux 3.10.53 (some variety of Ubuntu, if that's relevant). Some code I'm working on is getting consistently oom-killed, ...
2
votes
0answers
574 views

Xorg consuming 1.1GB, is it a leak?

I am facing a problem wherein Xorg starts to consume more and more memory and finally eats up the whole swap space. As shown below, Xorg's virtual memory is about 1.1GB. My system runs only one GTK ...
1
vote
2answers
6k views

Linux reboot out of memory

I have a server with Intel(R) Atom(TM) CPU D525 and 1 GB memory. I noticed the server would shut down and restart automatically about every 7 days. I checked the memory usage and found that when the ...
1
vote
2answers
415 views

How to increase the memory used by Java in linux?

I have a program Vuze that is written in Java, which I use to download very large files, and I'm having a problem with it. I need to increase the amount of memory it uses. I've followed the directions ...
1
vote
1answer
174 views

Fastest and Safest way to increase Swap Space on Scientific Linux

Memory Swap Ratio Company System Today, a monitoring system indicated that one of the systems in the company has run out of memory. Executing htop on this system indicated that the Memory was nearly ...
1
vote
1answer
1k views

“grep: memory exhausted” error on large partition

I was editing a text file with my notes on linux commands when I noticed a big chunk of it was missing (copy without paste, probably). The problem is that I already saved the document. (And this is a ...
1
vote
2answers
633 views

“Out of Memory” error while copying large files with pcmanfm

This is an older machine running a Debian-based distro with lxde and pcmanfm used as file manager. pcmanfm normally runs quite well, except when it comes to copying very large files (e. g. *.VOBs from ...
1
vote
0answers
24 views

pmap hangs on OOM process

I did attempt a search, but there doesn't appear to be much out there on pmap so here goes. I have a script that works with WebLogic instances to gather data on them which we can send to our Devs for ...
1
vote
1answer
55 views

OOM-kill a process from user with highest memory consumption?

I have a multi-user system, where active users should get a fair share of the available memory. Can I set up Linux to kill a process of the user with the highest total memory consumption? This will ...
1
vote
0answers
60 views

Extremely high shmem usage

I'm trying to debug the issue that's periodically taking down my work machine. It's an OOM-type problem, and based on this /proc/meminfo output: Total: 32902608 kB MemFree: 4054100 kB ...
1
vote
0answers
41 views

Memory usage inexorably creeping upward

Just within the past day, my Arch Linux system has begun eating memory. This seems to begin when the system is powered on, and I cannot find a way to stop it. The symptom is that the reported memory ...
1
vote
0answers
2k views

Bash session errors on commands: “fork: Cannot allocate memory”

I have a bash session open to a remote server and something is wrong. I created a directory "test" and touched the files inside touch 1 2 3 4 5. I then tried to copy the directory cp test/ test2/ and ...
1
vote
0answers
125 views

Out of Memory with unused memory and swap

I have a strange error on my Raspberry Pi2. System is archlinuxarm. Short after boot (about 30 secs), the system states that it is out of memory, resulting in closing many applications, most time ...
1
vote
0answers
326 views

Java process gets killed frequently by OOM - Killer on upgraded hardware

I am running solr on an Ubuntu server along with 4 other java processes. Current index size is 30 GB. My solr process gets killed frequently in few hours. It clearly mentions that its an OOM killer. I ...
1
vote
1answer
83 views

Configure the OOM to avoid having the system grind to a halt [duplicate]

I have an SSD and therefore no swap. However, when I open a lot of tabs in the browser, the system tends to grind to a halt. If I'm lucky, I can close one or two tabs before the system is completely ...
1
vote
0answers
467 views

How to cause memory fragmentation on a Linux based embedded device?

Hardware ARM What am I trying to do: Answer: I am trying to create memory fragmentation on a Linux 2.6.31 based swapless embedded device. Why: Answer:I am trying to port some patches to Linux ...
0
votes
1answer
29 views

Why does OOM-killer sometimes fail to kill resource hogs?

If I type in my shell x=`yes`, eventually I will get cannot allocate 18446744071562067968 bytes (4295032832 bytes allocated) because yes tries to write into x forever until it runs out of memory. I ...
0
votes
1answer
70 views

How can I clear my cache?

I'm running a live CD linux distro and I'm getting out of memory exceptions. >java -version #Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000646e00000, 264241152, 0) ...