Questions tagged [out-of-memory]
The out-of-memory tag has no usage guidance.
183
questions
0
votes
0
answers
16
views
In what order does kernel reclaim memory?
As far as my knowledge goes, when Kernel requires more memory for allocation for the processes it does a few things before entering OOM state.
Such as freeing SlabReclaimable, Dropping annonymous page ...
- 101
1
vote
2
answers
54
views
Why oom_reaper when having vm.panic_on_oom = 1
From what I understand from its author :
The OOM killer currently allows to kill only a single task in a good
hope that the task will terminate in a reasonable time and frees up
its memory. (…)
It ...
- 2,151
0
votes
0
answers
30
views
Memory runs out and PC freezes
I have been having issues playing video games on my PC, as I keep running out of RAM (8GB).
When I run out of RAM, my displays and everything else freezes, except playing audio keeps looping. I have ...
- 67
0
votes
0
answers
28
views
unexpected reset above 90% /tmp usage
There is 1GB /tmp folder on an embedded system with 8GB RAM. No swap is configured.
If /tmp grows to its limits, I assume OOM-killer does its job and one random service is killed, together with the ...
0
votes
1
answer
71
views
System ran out of memory during MX Linux installation
Hardware specs :
Product Name HP ProBook 430 G4
Processor 1 Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz (x86)
Memory Size 4096 MB
System BIOS P85 Ver. 01.03 12/05/2016
Serial Number ...
- 21
1
vote
0
answers
45
views
Upgraded to 16gb memory, but still frequently running out and freezing [duplicate]
2 years using linux, reasonably comfortable and confident at it now, but this is something that keeps plaguing me and I have lost so many work hours because of freezes/lockups.
My understanding of ...
3
votes
1
answer
137
views
Clamav - can you only load the linux-specific definitions from /var/lib/clamav/*.cld?
We're investigating applications that seem to use large amounts of memory, one of those being clamav. We noticed that there are lots of av definitions for windows, osx, xls, doc, rtf etc. in /var/lib/...
- 41
2
votes
0
answers
29
views
Hint kernel that a particular process is safe to OOM kill? [duplicate]
Sometimes I run scripts that have a risk of making the server run out of memory. Is there a way to make kernel eager to kill them when this happens, so that the system regains stability as soon as ...
- 1,330
0
votes
1
answer
29
views
How to fix improperly uninstalled software on Raspberry Pi (Buster)
First and foremost, I'm trying to purge an improperly uninstalled version of Intellij-Idea on Raspberry Pi and reinstall.
I installed IntelliJ-Idea on the Raspberry Pi using the below page as a guide:
...
- 1
0
votes
1
answer
81
views
oom_kill counter in CentOS 7
In Ubuntu 20.04 I can find oom_kill counter at file /proc/vmstat. Where I can find this metric in CentOS 7?
0
votes
0
answers
141
views
OOM killer invoked but plenty of RAM
I've got an ARM-based Linux kernel v5.4.3 256 MBytes of RAM system with no swap space enabled, and I occasionally see processes get killed by the OOM-killer even though there is plenty of RAM ...
1
vote
0
answers
61
views
How to determine whether a process would run out-of-memory?
A testsuite has a couple of tests, that will consume a quite a lot of memory (11GB) or so.
This is typically not a problem when running those tests on my developer machine, but within the context of ...
- 5,961
1
vote
2
answers
350
views
Creating swap when out of memory
Out of memory is a common issue and the official OOM is not efficient. Several other programs have been introduced to do the killing job faster.
I wonder why there is no approach to creating swap ...
- 1,663
1
vote
0
answers
33
views
cgroups - controlling memory
I am trying to understand how cgroups and namespaces work. I have been able to get to a point where I can execute example programs in example cgroups and see how the memory resource can be controlled.
...
- 23
0
votes
0
answers
46
views
Reset memory.oom_kill
I am learning about cgroups and trying out a few examples to see how it works. For the memory controller, I created an example group, ran an application that tries to use more memory than it has been ...
- 23
2
votes
0
answers
153
views
How to diagnose high `Shmem`? (was: Why `echo 3 > drop_caches` cannot zero the cache?)
I have a problem with my Linux machine where system now seems to run easily out of RAM (and trigger OOM Killer) when it normally can handle similar load just fine. Inspecting free -tm shows that buff/...
- 3,387
-5
votes
1
answer
54
views
Out of Memory Killer OOM and Swap [duplicate]
Greetings to the service of dear masters and masters
I have a question :
Thanks for pointing me to a process called Out of Memory Killer in Linux, or OOM for short, how it works and what the processes ...
0
votes
0
answers
68
views
SLURM: "unsafe" code, forking and restarting processes which exceed memory limit
I am running code in the open-source computer algebra system Sage in a SLURM-managed multi-node cluster environment. The code is highly parallel: I use the Python package mpi4py to manage a task queue ...
1
vote
1
answer
219
views
xz: OOM when compressing 1TB .tar
I'm trying to compress a large archive with multi-threading enabled, however, my system keeps freezing up and runs out of memory.
OS: Manjaro 21.1.0 Pahvo
Kernel: x86_64 Linux 5.13.1-3-MANJARO
...
- 113
0
votes
0
answers
471
views
Kernel panic during shutdown: "System is deadlocked on memory"
I am running Debian Buster within a VM with 70 MiB of memory allocated to it. Curiously, it can boot and run fine, but panics when I try to shut it down.
Here is the log of the panic, which I captured ...
- 2,038
1
vote
0
answers
55
views
What could account for a very, very large change in pid's in a short amount of time?
On an Ubuntu 20.x server, we are having some OOM Killer issues, where it kills a Java process. We have been unable to find any memory leaks.
But this morning, we got a rare gift, which is two oom-...
- 111
0
votes
1
answer
121
views
What does order=0 mean in mem-info data (Orders are powers of two allocations, so does it mean no pages were being allocated?)
foobar.exe invoked oom-killer: gfp_mask=0x201da, order=0, oom_score_adj=0
What is an order=0 allocation? That's less than one page, so is it like a kmalloc32 or something smaller than page_size? ...
2
votes
0
answers
108
views
Linux kernel with ZFS eating my ram (2x of arc_max)
First up, It seems my kernel is using way too much ram
$ grep Slab /proc/meminfo
Slab: 21794184 kB
See all of /proc/meminfo
and /proc/slabinfo
$ free -h
total used ...
- 371
1
vote
0
answers
51
views
Why oom may still happen even when overcommit_memory is set to 2?
2: always check, never overcommit
In mode 2 (available since Linux 2.6), the total
virtual address space that can be allocated
(CommitLimit in /proc/meminfo) is calculated as
...
- 267
0
votes
2
answers
71
views
How can I kill a process that kills the computer if it hangs?
I would like to write a script that detects when my Ubuntu machine hangs for more than 10 seconds, for example, and kills the offending process so I don't have to force-power-off my device.
The ...
- 15
0
votes
1
answer
809
views
Identify high memory allocator / leaking process in Linux causing oom (out of memory) kernel killing processes
I have come across plenty of info on oom in general but not much to identify the root cause of the issue. OOm killer kills processes based on its scoring but the process it kills need not be the one ...
- 101
5
votes
1
answer
443
views
Can ** (bash's globstar) run out of memory?
Can using bash's globstar (**) operator cause an out of memory error? Consider something like:
for f in /**/*; do printf '%s\n' "$f"; done
When ** is being used to generate an enormous list ...
- 215k
1
vote
0
answers
245
views
How to best hard-limit my Firefox' memory hogging?
I use Firefox 83 on my Devuan GNU/Linux Beowulf desktop.
Unfortunately, for reasons which are not clear to me, FF has memory issues which cause it to gradually take up more and more of my system's ...
- 7,249
2
votes
1
answer
464
views
RAM Free decreases over time due to increasing RAM Cache + Buffer
When visualizing some memory related metrics on server level, I get a chart which looks like this:
The area below the blue line is RAM Used. The area below the red line and above the blue line is RAM ...
- 125
0
votes
0
answers
55
views
Finding root cause for out of memory killer
Recently, I stumbled upon this error which, I can understand happening because of Out Of Memory , but not sure who is requesting memory.
[ 8539.677000] syslog-ng invoked oom-killer: gfp_mask=0xd0, ...
- 63
0
votes
1
answer
189
views
How to free up disk space when the disk is full?
I recently tried to install a large program and inadvertently filled up my Linux partition. I am now seeing a bunch of errors stemming from this issue. I tried to empty the trash, but I get an error ...
- 101
4
votes
2
answers
778
views
Linux OOM randomly when there is still free memory
I got the OOM problem randomly (about once per month), but it seems that there is enough free memory.
I can not understand the reason and how to resolve it ....
vm.min_free_kbytes = 90112
Linux xxx-...
- 141
2
votes
1
answer
688
views
Force use Swap over Memory
I have a Debian server that I'm really cheaping out on, but for some reason the Java processes use all the memory then throw a "OutOfMemoryError" rather than using the swap space.
I've got ...
- 269
1
vote
0
answers
81
views
gkrellm: can you display a chart of the memory usage?
little background:
I had some processes on a machine with 128GB memory that reported python memory allocation errors (the machine ran out of memory). My code only uses like 1-3GB memory... so I should ...
- 3,275
13
votes
3
answers
19k
views
Python programs suddenly get killed
I'm running some python programs that are quite heavy. I've been running this script for several weeks now, but in the past couple of days, the program gets killed with the message:
Killed
I tried ...
- 231
1
vote
0
answers
723
views
CentOS 7 yum-cron - Out of memory: Kill process or sacrifice child
I am on centos 7 hosted on a vps. The server would stay alive for a couple of days before everything gets killed by OOM. A restart fixes things, but it's a temporary fix.
The error (there is a full-...
- 11
0
votes
0
answers
28
views
Seelnium crashes since RAM is not enough... but what is RAM used for?
We run Selenium (JAVA) with headless Chrome. This all takes about 300 MB RAM.
VPS has 1 GB RAM but selenium "crushes":
Exception in thread "pool-1-thread-115" org.openqa.selenium....
- 141
0
votes
1
answer
271
views
Explanation for "Killed Process"
The system has killed a process due to "Out of memory" but I cannot understand these messages.
I am not able to find the memory issue.
[Mon Jul 20 21:20:39 2020] crawler invoked oom-killer: ...
- 103
0
votes
3
answers
259
views
What is done when memory gets filled: One page eviction or an entire process is killed?
The question is simple but I haven't found information (to be more precise, I have found information about both options (options below) but without saying which one is used in each situation).
Option ...
- 5
1
vote
1
answer
206
views
When kernel space is used up, will OOM killer be triggered?
We know if a user space program keeps malloc(), it may finally trigger OOM killer. But what about kernel space, when kernel space memory is used up, will it trigger OOM killer to free memory?
Thanks
- 11
0
votes
2
answers
290
views
Why does Linux become unresponsive when a large number of memory is used (OOM cannot be triggered)
I am using a CentOS 7.5 instance in AWS which has 16 CPUs and 32GB memory. I found when I run the following command, the whole system will be unresponsive, I cannot run any commands on it anymore, ...
- 103
4
votes
1
answer
684
views
Trigger a script when OOM Killer kills a process
I do a lot of work on in the cloud running statistical models that take up a lot of memory, usually with Ubuntu 18.04. One big headache for me is when I set up a model to run for several hours or ...
- 155
1
vote
2
answers
148
views
How can I prevent repeated malloc from slowing down system to a halt before the program is killed with SIGKILL?
Obviously I don't typically run:
#include <stdlib.h>
int main() {
while (malloc(50));
return 0;
}
But I have been attempting to compile large projects. When running cmake, my computer'...
- 111
0
votes
0
answers
451
views
Unix SORT not respecting its memory limit
I am facing an issue regarding sort being killed due over usage of memory and can not understand why it surpasses the given limit by a significant margin.
Context:
Available physical RAM: 8GB
...
1
vote
0
answers
17
views
manually pre-assign which process should be killed by oom
I have a process that writes large files to /tmp which happens to be a tmpfs. When starting the process, I don't know if I have enough RAM. The process doesn't use excessive RAM itself. So I have to ...
- 738
1
vote
0
answers
343
views
Why is process killed with free memory in other zones?
I've read in my syslogs that the Out of Memory Killer is terminating processes when the "Normal" memory zone is underneath the minimum limit, but I still have tons of free memory in the "HighMem" zone....
- 11
1
vote
1
answer
35
views
How to print several copies of a large postscript file on a printer with little memory?
I'm printing a postscript file containing a folder on my HP Laserjet 1320. I can print the folder one by one, but when I try to print a couple of them at one time, say 10, the printer doesn't have ...
- 1,137
1
vote
0
answers
45
views
Reliably automatically detect OOM killer post-mortem
I have a misbehaving service which is being repeatedly OOM killed which I would like to better diagnose. It's being called by a wrapper script, so the best first step I can think of is to have the ...
- 111
-1
votes
7
answers
643
views
Bash - How can I add a string to the beginning of a text file without reading all of it?
i'm trying to insert a string "hello world" before of a text file named "test.txt", i already do it with sed, but unfortunately "sed command" kill my memory, because it reads a entire file.
my file ...
3
votes
1
answer
2k
views
Hibernate to a swap partition without using it as actual swap space
For many years I set up my Linux machines with no swap, as they had enough memory to do what I needed and I would rather a process get killed if it used too much memory, instead of growing larger and ...
- 5,816