Questions tagged [ulimit]
All about resource limits that can be set with the ulimit command
1
vote
0answers
9 views
linux mint ulimit configuration
In my Linux Mint desktop, ulimit -Hs shows values greater than fs.file-max. As far as I know it should be smaller values than the system-wide settings. Is this OK for Debian-based systems or do I have ...
-1
votes
0answers
16 views
Nginx extras on Ubuntu 14 opens too many file descriptor
We were using Nginx on our machines and it worked fine for years. Recently we installed nginx-extras because of the need of some 3rd party module.
After this, the file descriptor opened by nginx keeps ...
-1
votes
1answer
28 views
hive + what is the meaning of nofile and nproc
regarding to hive in hadoop cluster
what is the meaning of the following
hive - nofile 30000
hive - nproc 18000
the file:
more /etc/security/limits.d/hive.conf
# Licensed to the Apache ...
3
votes
1answer
216 views
'pthread_create: Resource temporarily unavailable' when running multiple docker instances
TLDR
When spinning up multiple docker containers in which I run npm ci, I start getting pthread_create: Resource temporarily unavailable errors (less than 5 docker containers can run fine). I deduce ...
0
votes
1answer
16 views
Setting soft limit above hard does not fail in terms of exit code?
root@Andromeda:/# ulimit -n -S
2048
root@Andromeda:/# ulimit -n -H
2048
root@Andromeda:/# ulimit -n -S 4096
2048
root@Andromeda:/# echo $?
0
Failure to set soft limit above the hard one makes sense.
...
0
votes
0answers
29 views
No locks available
I am using ssh logging on a remote server and ran a parallel computing application. I use htop to monitor the CPU usage. But after running a long time, htop exit and shows:
htop: too may open files ...
0
votes
1answer
72 views
Maximum value for /proc/sys/fs/file-max
Today my server crashed with Too many open files in system: but I already have high values, what is a maximum value for this?
I feel like there aren't good results on google for this, explaining ...
1
vote
0answers
41 views
Limit memory usage for a single Linux process with only a function?
This is a shell script with a function timeout() to limit the CPU time usage for a single process. Is it possible to limit memory usage for a single Linux process with a similar function?
#!/bin/bash
...
0
votes
0answers
22 views
Process only takes 50% of RAM on Debian [duplicate]
I have a program in python which takes lots of ram. My server has 16gb of ram, but when the program reaches ~8gb of ram, the os starts writing on disk which breaks performance.
I want the process I'm ...
1
vote
1answer
48 views
shellcheck: “In POSIX sh, ulimit -H is not supported”
I am using shellcheck to fix warnings in a sh script. The script checks for the hard fd limit with:
ulimit -H -n
It sets the soft fd limit with:
ulimit -n "$MAX_FD"
This generates the shellcheck ...
0
votes
0answers
8 views
Concurrent requests from node.js process are far too slow - is the OS limiting them
I have a node.js script, it makes a http request to a url N number of times using two different techniques. First it does it serially, then it does it using the node.js Promise api (all the requests ...
0
votes
1answer
239 views
Open file limits not increased for redis user despite change in /etc/security/limits.conf
I got
ERR max number of clients reached
from my redis server so I decidied to increase the allowed max client connections in its configuration. This also requires according to the documentation, ...
1
vote
2answers
44 views
Prevent the machine being slowed down by running out of memory
My software runs a command that looks something like:
find | xargs do a potentially memory hungry job
The problem is that sometimes a potentially memory hungry job gets too hungry, the system gets ...
1
vote
2answers
58 views
Who would win, RLIMIT_NPROC or user namespaces?
Depending on configuration, unprivileged (non-root) processes can create a user namespace.
RLIMIT_NPROC limits the number of processes per user.
If I enter a user namespace, can I create processes ...
2
votes
0answers
138 views
Restart a process if cpu usage is more than 90% for more than a 60sec
Normally one of my systemd services will take about 0...5% cpu Usage. In some cases it can reach up to 100% but only for some seconds. If the Service "crashes" it takes up to 100% continuously.
So I ...
0
votes
1answer
215 views
What level is the value `ulimit -n`mean? user level or process level? [duplicate]
I want to increase the ulimit -n value,so I add
* soft nofile 20000
* hard nofile 20000
in the /etc/security/limits.conf file, but there is a question confuse me all the time.
what ...
3
votes
0answers
50 views
What are the differences between process data segment and resident set size? [duplicate]
I searched how to limit memory usage for a single process and found 3 results,ulimit -d, -m and -v, which stand for data seg size(process's data segment), max memory size(resident set size) and ...
1
vote
1answer
46 views
mixed results from the same command (related to ARG_MAX) [duplicate]
I'm asking a question based on this link How to cause "Argument list too long" error?
From the thread, I'm seeing the equivalent error, if i'm running this:
>/bin/echo `perl -e 'print "...
0
votes
1answer
858 views
Why ulimit -n modifies hard limit
Checking open files (soft) limit on current shell
/home/pkaramol
$ ulimit -n
1024
Checking hard limit
/home/pkaramol
$ ulimit -n -H
1048576
Setting (soft) limit to hard limit value and verifying ...
0
votes
1answer
276 views
ulimit configuration explanation of different types
I am setting several ulimits (system is rhel 7.5) and i can't find any clarification on the values of type. From inside the /etc/security/limits.conf i get that type can get two values while in the ...
54
votes
3answers
11k views
Why can't I crash my system with a fork bomb?
Recently I've been digging up information about processes in GNU/Linux and I met the infamous fork bomb :
:(){ : | :& }; :
Theoretically, it is supposed to duplicate itself infinitely until the ...
-1
votes
2answers
387 views
Beyond ulimit limit [duplicate]
I execute below command:
ulimit -a
And it gives output as:
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size ...
0
votes
1answer
1k views
How to permanently Set/change the Limits in Solaris 10 system wide
I received email from oracle to change the limit on solaris 10 server to make oracle application work,
unfortunately i have no experience in Solaris, so need assistance
Values will be like below
...
0
votes
1answer
224 views
How to make sure nproc values are taking effect for all the users?
In the /etc/security/limit.conf file I have added the following values:
user1 - nproc unlimited
user2 - nproc unlimited
Both user1 and user2 have sudo privileges and I ...
13
votes
4answers
5k views
How to cause “Argument list too long” error? [duplicate]
Context for the question: According to POSIX specs, ARG_MAX is maximum length of command-line arguments to exec() family of functions. Which lead me to believe that's actual number of arguments, ...
1
vote
2answers
3k views
getting 'Operation not permitted' error when setting ulimit for memlock in a Docker container running ubuntu:xenial (macOS host)
I am having trouble setting the 'memlock' system limit in a container that I launch like this:
docker run -it ubuntu:xenial
Here is what I tried in a nutshell:
In bash terminal session 1:
...
3
votes
1answer
3k views
Meaning of the values for ulimit memlock flag
When I run docker and use the --ulimit memlock=-1:-1 option, what do the soft/hard values of -1 mean? Does it mean that I am allowing an unlimited amount memory to be locked by this container/process?
2
votes
1answer
2k views
ulimit vs file-max
Could someone explain limit on open files in linux? The problem is that one of my applications if reporting "Too many open files".
I have
ulimit -n
1024
but
cat /proc/sys/fs/file-max
6578523
and
...
0
votes
1answer
316 views
Are the limits shown or set by ulimit per resource and per process?
Bash's ulimit concerns about limits on different kinds of resources.
Is it correct a limit shown or set by ulimit is per-resource?
Is each such limit the sum of the resources available to all the ...
3
votes
5answers
2k views
Why does the following way not change core file limit size?
To solve the problem in https://unix.stackexchange.com/a/446428/674, I followed https://stackoverflow.com/a/17483998/156458, but it doesn't set core file limit size?
$ sudo sh -c "ulimit -c 1024 &...
2
votes
1answer
1k views
Is setting ulimit -v sufficient to avoid memory leak
We have a process that in recent weeks had a once-off memory leak that resulted in it consuming all memory on our RHEL 7 box
We now wish to set limits around this such that it will never take any ...
3
votes
1answer
6k views
Where is the limit set? bash: fork: retry: No child processes
This:
$ seq 100000 | xargs -P0 -n1 -I {} bash -c 'echo {};sleep {}'
:
5514
bash: fork: retry: No child processes
started complaining around 5500 when the system had 11666 processes running. Now, ...
0
votes
1answer
2k views
How can I automatically set the core dump size on a single user?
I am running OpenSUSE. I usually open the console with an interactive non-login shell bash, and frequently use tcsh after logon. I am writing some C code, compiling with gcc, and I'd like to have the ...
3
votes
1answer
5k views
Increase number of open files in mac high sierra [duplicate]
On a mac high sierra 10.13.3 I have 256 open files.
I want to raise it and I open a terminal and enter
sudo launchctl limit maxfiles 1000000 1000000
This doesnt change anything when I enter
ulimit ...
3
votes
0answers
6k views
How to increase the maximum number of open files on Fedora?
I want to increase the maximum number of open files in Fedora 27,
since the default settings are too low:
$ ulimit -Sn
1024
$ ulimit -Hn
4096
First, I ensure that the system-wide setting is high ...
1
vote
0answers
393 views
Why did ulimit not stop my fork bomb that was running as the superuser?
I'm studying the fork bombs and I have some troubles to find a way to protect from this type of attack.
As far as I know there are two possible solutions:
ulimit
cgroup
I'm studying the first one on ...
1
vote
0answers
88 views
systemd resource management (specific case: mysql)
I have a problem tying to figure out, how the resource management in systemd works.
To make clear where I am and how I got there, I should start with explaining my situation:
After migrating a mysql-...
0
votes
0answers
66 views
System logging for: “unable to create new native thread” by JVM
OutOfMemoryException by whatever JVM service is a popular error message. What strives me is the fact it does not get logged somewhere in the system. Also the JVM does not report the underlying reason. ...
2
votes
0answers
108 views
How to check usage of mqueues reliably?
I run a testing server for a software that depends on the massive usage of mqueues (POSIX messages queues). I increased limits to a reasonable level and got it working a long time ago. However, the ...
0
votes
1answer
36 views
concurrent max process limit when gnuparallel used in unix
I am using gnu parallel to fire some concurrent process. Below is the command am using.
parallel 'node /home/parunkarthick/NodeProject/nodescript_pd.js F_CHARGES' ::: 1 2 3 4 5 6 7 8 9 10 11 12 13 ...
0
votes
1answer
1k views
How can a process have a higher open file descriptors limit than that set by the hard limit?
I am using Solaris 11 and it is my understanding that a non-privileged user can increase or decrease the soft limit of maximum open file descriptors while staying within the hard limit. It is also ...
0
votes
2answers
535 views
Set Limit on File Size Across Entire System
I am trying to set the limit on files to be 10GB across the entire system. When ulimit -f is run, I get back unlimited.
When ulimit -a is run, I see that the units of file size are blocks. How do ...
4
votes
1answer
1k views
Figure out which process forks too many threads
I have a process in a Linux installation that at some point has some kind of spike and passes the max allowed number of threads/processes allowed by the system. I found this by checking ps -elfT | wc -...
2
votes
3answers
7k views
Increasing open files limit for all processes: Do I need to set Soft/Hard limits?
I'm trying to fix the following error that I get after a day or two of running my game server.
2017/12/13 12:08:35 http: Accept error: accept tcp [::]:8081: accept4: too many open files; retrying in ...
1
vote
1answer
289 views
process is not using new open file configuration which I have set?
I have a process which is running as golden user and I am trying to increase the open file limit for that user so that all the process that gets started up by that user, it should uses that settings. ...
2
votes
1answer
218 views
ulimit on a Specific Directory
I know about ulimit, which is used to set the size of the maximum file size, but this setting is global on the server. Is there a way to set a limit to the file size per directory? For example, I want ...
0
votes
1answer
868 views
RHEL setting a user specific max number of open files
I've set up below values in /etc/security/limits.conf in my RHEL machine.
* hard nofile 65535
@student hard nofile 100000
Is this the correct approach when setting a user specific max number of ...
1
vote
1answer
4k views
Debian 9.1 - system is ignoring ulimit for maximum open files for rtorrent
For testing purposes i even raised root's limit.
# /etc/security/limits.conf
* soft nofile 65535
* hard nofile 65535
root soft nofile ...
4
votes
2answers
5k views
Systemd LimitNOFILE capped to 4096
I have a systemd user service with LimitNOFILE set. The value is respected until it hits 4096. After that point, it's capped to 4096. I've also tried increasing DefaultLimitNOFILE in /etc/systemd/user....
6
votes
1answer
2k views
What's the difference between setting open file limits in /etc/sysctl.conf vs /etc/security/limits.conf?
I've read two separate ways of increasing the allowed open file count (I'm attempting to modify for root, if it matters).
One way is to update the settings in /etc/security/limits.conf with something ...
