Questions tagged [out-of-memory]
The out-of-memory tag has no usage guidance.
144
questions
0
votes
0answers
14 views
OOM - How to get full details of killed processes?
Assume there are 40-50 large memory-hogging processes running on one server.
Is there a way to setup the environment, or create a script, which will capture the full command line (as shown in ps -ef)...
0
votes
0answers
12 views
Shrinking GPU memory objects that no are no longer needed
After some searching , I didn't find any standard way to release GPU memory that is allocated to Tensorflow.So I want to know is there a way to manually shrink VRAM objects that are no longer needed ...
1
vote
0answers
16 views
manually pre-assign which process should be killed by oom
I have a process that writes large files to /tmp which happens to be a tmpfs. When starting the process, I don't know if I have enough RAM. The process doesn't use excessive RAM itself. So I have to ...
0
votes
0answers
24 views
Why is the Normal memory zone full while HighMem is almost empty?
I've been having problems on my 32 bit system (Kernel version 3.14) that when the Out of Memory Killer terminates a process the logs show that my Normal memory zone has a capacity of ~880MB of which ...
0
votes
0answers
21 views
Why is process killed with free memory in other zones?
I've read in my syslogs that the Out of Memory Killer is terminating processes when the "Normal" memory zone is underneath the minimum limit, but I still have tons of free memory in the "HighMem" zone....
1
vote
0answers
16 views
How to print several copies of a large postscript file on a printer with little memory?
I'm printing a postscript file containing a folder on my HP Laserjet 1320. I can print the folder one by one, but when I try to print a couple of them at one time, say 10, the printer doesn't have ...
1
vote
0answers
13 views
Reliably automatically detect OOM killer post-mortem
I have a misbehaving service which is being repeatedly OOM killed which I would like to better diagnose. It's being called by a wrapper script, so the best first step I can think of is to have the ...
-1
votes
7answers
124 views
Bash - How can I add a string to the beginning of a text file without reading all of it?
i'm trying to insert a string "hello world" before of a text file named "test.txt", i already do it with sed, but unfortunately "sed command" kill my memory, because it reads a entire file.
my file ...
2
votes
1answer
264 views
Hibernate to a swap partition without using it as actual swap space
For many years I set up my Linux machines with no swap, as they had enough memory to do what I needed and I would rather a process get killed if it used too much memory, instead of growing larger and ...
1
vote
0answers
46 views
Linux: keeping GUI responsive during low free memory
I just had it (it kind of solved itself for now, but took about 5-10 minutes): a situation which several minutes ago I was afraid could happen but still believed Linux optimally uses memory for ...
0
votes
1answer
73 views
Black screen after splash screen
Im using Debian 10 Buster GNOME Editon. Yesterday I met with this issue. After I boot Debian, the splash screen comes correctly, but after that it simply gets stuck (ie becones a still image) and ...
0
votes
0answers
37 views
How does oom killer behave after alt+sysrq+f?
I learned that after ALT+SysRq+f "oom_kill is called, to kill a process to alleviate an OOM condition". On the other hand I know that oom killer starts automatically if there is not enough memory for ...
0
votes
1answer
109 views
After a heavy I/O load, and storing many things in Zram, used space is close to total in `free`
I do not think that this is Linux's disk cache. In htop, the memory bar is green (not orange for cache) and I removed the files stored in Zram. No processes seem to be using a lot of memory.
The load ...
0
votes
1answer
165 views
system MemoryMax by percentage not working?
I am trying to configure my .service file to limit how much memory a given service can use up before being terminated, by percentage of system memory (10% as an upper limit in this case):
[Unit]
...
3
votes
1answer
70 views
Concatenate thousands of files already sorted and re-sort the output file quickly
I have ~100000 files each of one with unique rows such as:
File1.txt
chr1_1_200
chr1_600_800
...
File2.txt
chr1_600_800
chr1_1000_1200
...
File3.txt
chr1_200_400
chr1_600_800 ...
2
votes
1answer
108 views
OOM Killer - save cmdline & owner about process being killed
I'm aware OOM killer save info about a pid in syslog, but I would like to collect also cmdline & owner of process being killed.
Info is relevant for debugging and ELK metrics, just PID isn't ...
0
votes
0answers
203 views
How to know why oom-killer triggerd and decode the oom-killer logs?
Below are the logs :-
[ 727.941258] kworker/u8:2 invoked oom-killer: gfp_mask=0x15080c0(GFP_KERNEL_ACCOUNT|__GFP_ZERO), nodemask=(null), order=1, oom_score_adj=0
[ 727.954355] CPU: 0 PID: 56 Comm: ...
0
votes
1answer
62 views
Is cached/buffered memory always instantly freed when an application requests it?
I have an ongoing discussion with the support of one of the cloud services. The problem is that we get "Cannot allocate memory" errors (for allocating shared memory segments by PostgreSQL) despite ...
1
vote
1answer
176 views
Why “Sum of RES” not equal to “Mem Used + Swap Used” (Ubuntu 18.04)?
I'm trying to host java8 UI application on VPS server (Digital Ocean) with 1GB of RAM. Java is started with -Xms600m -Xmx600m(startup and max memory usage). Also it runs VNC + mate-core. My assumption ...
0
votes
1answer
42 views
Getting trouble installing HPjmeter
I'm trying to install HPjmeter console on centos 7 desktop in order to monitor my web app GC status . I've follwed all the steps mentioned on the official user guide but when executing this command ...
1
vote
0answers
351 views
Decoding oom-killer to find the fragmentation
This is a 59GB RAM system that's hitting OOM-Kills with plenty of recoverable memory around. This one is stubborn.
kthreadd invoked oom-killer: gfp_mask=0x26080c0, order=2, oom_score_adj=0
kthreadd ...
2
votes
0answers
46 views
How to free memory allocated to Main, running out of memory
I'm having trouble on my Ubuntu 18.04 system where all of my memory is running out. Stopping all of the programs running does not seem to release all the memory (it only made 42Mb available).
After ...
0
votes
0answers
36 views
Memory Issue and getting OOM
Linux total memory is full but not showing any usage by any process but getting OOM ,how to troubleshoot this ?
free -m
total used free shared buffers cached
Mem: ...
1
vote
1answer
39 views
Is there a library call or syscall to set /proc/self/oom_score_adj?
I have an important process that the OOM Killer has taken a fancy to with unfortunate results. I would like to make this less likely. All google turns up is stuff like:
echo -1000 > /proc/${PID}/...
1
vote
1answer
224 views
What do the abbreviations in OOM Killer memory statistics report mean?
When OOM Killer or kernel reports memory state, it uses the next abbreviations
Node 0 DMA: 26*4kB (M) 53*8kB (UM) 33*16kB (ME) 23*32kB (UME) 6*64kB (ME) 7*128kB (UME) 1*256kB (M) 2*512kB (ME) 0*...
4
votes
2answers
316 views
Solaris 10: Virtual Memory Exhausted
Our group is all programmers and exclusively use Linux or MacOS, but a customer uses Solaris 10, and we need our code to work there. So we scrounged up an old SunFire V240, and a rented Solaris 10 VM ...
1
vote
2answers
77 views
Prevent the machine being slowed down by running out of memory
My software runs a command that looks something like:
find | xargs do a potentially memory hungry job
The problem is that sometimes a potentially memory hungry job gets too hungry, the system gets ...
0
votes
0answers
203 views
When exactly OOM_KILLER will be invoked
I currently have the situation where OOM_KILLER is invoked while (i think) there is some RAM not used. I know that is will happen when "there is no more memory in the system", but then what is the ...
2
votes
1answer
739 views
How to limit swap usage in Solaris?
I have an Oracle Solaris 11.3 which has 128 GB of Memory (RAM) and 80 GB of Swap.
I want to limit the use of swap space (not its size just the usage).
I know in more modern linux distros ...
0
votes
1answer
438 views
httpd hogging all memory until server crash
The server in question is used for processing data into reports, it has three cron jobs which execute every minute to check the process queue and if anything is found they'll keep running until the ...
0
votes
1answer
629 views
Shell-script to periodically free some memory up with Ubuntu 18.10 LiveCD with only 4GB of RAM. Need some improvement
Edit 1:
The freezing just happened and I was able recover from it. Log(syslog) from the freezing until 'now': https://ufile.io/ivred
Edit 2: It seems a bug/problem with GDM3. I'll try Xubuntu.
Edit ...
7
votes
2answers
1k views
Why does linux out-of-memory (OOM) killer not run automatically, but works upon sysrq-key?
I have found that when running into an out-of-memory OOM situation, my linux box UI freezes completely for a very long time.
I have setup the magic-sysrq-key then using echo 1 | tee /proc/sys/...
1
vote
1answer
2k views
Why is the Linux OOM killer terminating my programs?
I am running a complex workflow via bash scripts, which are using external programs/command to do different things. It runs fine for several hours, but then suddenly the OOM killer terminates programs ...
0
votes
0answers
507 views
How to send a notification alert when a process is killed by the OOM killer?
So every now and then (once in a month or two) one of our processes, running a critical piece of code that we don't want to touch, is being killed by the Out Of Memory killer. It says so in /var/log/...
4
votes
1answer
6k views
systemd memory limit not working/example
I'm trying to use the systemd infrastructure to kill my memory leaking service when its memory usage reaches some value. The configuration file used is this:
[Unit]
Description="Start memory gobbler"
...
1
vote
1answer
393 views
What is the relationship between oom_score and badness?
Whilst reading both https://lwn.net/Articles/391222/ and http://man7.org/linux/man-pages/man5/proc.5.html I have come across the terms oom_score and badness. Both numbers have the same basic meaning; ...
2
votes
1answer
266 views
How to reduce OOM score for X11 with systemd
When my PC runs out of memory, the Linux OOM killer likes to kill Xorg first rather than the actual app using a lot of memory, which for the most part takes down the whole system (killing all my apps ...
3
votes
0answers
2k views
Slab cache affecting used memory much more than /proc/meminfo suggests
I'm dealing with a memory issue that is affecting hundreds of machines in AWS. They are i3.4xl instances with 120GB of RAM. There is a Java database server running inside a Docker container that ...
15
votes
1answer
744 views
Is it wrong to think of “memfd”s as accounted “to the process that owns the file”?
https://dvdhrm.wordpress.com/2014/06/10/memfd_create2/
Theoretically, you could achieve [memfd_create()] behavior without introducing new syscalls, like this:
int fd = open("/tmp", O_RDWR | ...
0
votes
3answers
174 views
What happens if a Linux distro is installed with no swap and when it’s almost out of RAM executes a new application? [duplicate]
What happens if a Linux, let’s say Arch Linux or Debian, is installed with no swap partition or swap file. Then, when running the OS while almost out of RAM, the user opens a new application. ...
2
votes
1answer
3k views
Completely disable oom killer
I'm having some intermittent issues that appear to be related to the oomkiller purging some child processes, but I can't see why.
Is there a convenient way that I can suppress all oomkiller activity ...
2
votes
1answer
43 views
Is there a way in Linux to preserve folder size for safety
I want to install a data manipulation solution. The solution is deployed in a folder in home directory. Free space in disk is uncontrollable and can shrink at any moment (other users data).
How can I ...
1
vote
2answers
532 views
How to avoid high latency near OOM situation?
Minimal test case when Linux system does not have swap (or run sudo swapoff -a before testing). Run following bash one-liner as normal user:
while true; do date; nice -20 stress --vm-bytes $(awk '/...
2
votes
2answers
548 views
Why the kernel doesn't stop processes starving the resources?
I'm running a linux box(ubuntu) and every few months it freezes and I'm left with no choice(SysRq-F and other keyboard shortcuts are not working) but to reboot it losing all the data.
I'm wondering ...
6
votes
2answers
26k views
Memory runs full over time, high “buffer/cache” usage, low “available” memory
Whenever I reboot my laptop, everything runs amazingly and I have a maximum of 40% memory usage (out of 8GB). However over time (~ 1 day of usage), memory usage goes up to 90%+, and the system starts ...
2
votes
2answers
3k views
How set the “oom_score_adj” when(before) run target program?
Directly set by echo 1000 >/proc/<pid>/oom_score_adj is unreliable because target program is already running , in this case maybe target program caused OOM before echo 1000 >/proc/<pid&...
1
vote
1answer
111 views
Can a process allocate cache memory such that the kernel can seize it when necessary?
I'm asking specifically about Linux, but an answer that applies to Unix in general (i.e. POSIX or similar) would be even better, obviously.
Linux uses free memory (i.e. that memory which is not yet ...
0
votes
0answers
51 views
How to avoid a situation where the system is too out-of-memory to even show or kill processes?
I recently ran into a situation where a system was too out-of-memory to even run pkill or htop, or to even create a swap file.
(But somehow I could still SSH into the system, so at least I had a ...
1
vote
1answer
216 views
reserve memory for a set of processes
How can I reserve some amount of memory for a set of UI processes(window manager, x server, a terminal and a shell) running on my system. I'm tired of having to force a reboot because of some resource ...
1
vote
1answer
1k views
Debugging Linux oom-killer - little to no swap use
We build a system that's intended to be on all the time - it collects and displays graphs of data. If we leave it without changing anything for long enough, we end up with an oom-killer event. That ...
