Questions tagged [cluster]
discussion related to cluster mechanisms.
207
questions
0
votes
0
answers
18
views
Stonith create fails to start
I'm creating a cluster with two nodes: node1.example.com, node2.example.com in a kvm environment, both are centos7 vm's and I also have another vm server.example.com that should be the fencing device.
...
0
votes
0
answers
12
views
Ways to supply common arguments to qsub/slurm using single file?
My team is building a small HPC pipeline that requires multiple cluster jobs to be submitted.
So far, we've been using 5+ submission scripts, but this makes changing configuration options a hassle.
We ...
- 13
0
votes
0
answers
36
views
How to update computing nodes in a cluster?
I am in the process of small computing cluster assembly. It will run Ubuntu/Slurm for job scheduling. Only the head node will be connected to the Internet, all others will be accessible from the local ...
- 11
1
vote
0
answers
22
views
Will execution of many parallel instances of an application from NFS drive affect performance?
I am assembling a simple computing cluster under Ubuntu 20.04 and Slurm as a job scheduler.
The cluster will be primarily used for quantum-chemical calculations, so, as a rule, each job will run its ...
- 11
0
votes
1
answer
40
views
Does the size of a file system cluster have to be even bytes?
Basically, could we have a file system with odd byte size clusters? Why is everything even? Thanks
- 1,146
0
votes
0
answers
21
views
Error locking on node NODEX-HB: Command timed out
I am having issue whenever issue the command lvcreate -n lv12_9 100%FREE clusvg12_9
The RHEL 6.10 return the following message.
Error locking on node DCCEBRSMA11-HB: Command timed out
Error locking on ...
0
votes
0
answers
19
views
How to remove "left" members from serf
Hi have a working serf cluster.
For some reason, I had to remove some nodes from this cluster:
on these nodes I ran serf leave
on the others nodes of these cluster I ran serf force-leave node-to-...
- 113
0
votes
0
answers
124
views
Warnings Resource is promotable but has not been promoted on any node
when i configuring cluster i get warning:
Resource is promotable but has not been promoted on any node
My conf.
pcs resource create pgsqld ocf:heartbeat:pgsqlms \
op start timeout=60s ...
- 1
0
votes
0
answers
184
views
What is "quorum-manager" under Designation in GPFS Cluster Information?
I get this block of information under my GPFS cluster information when I execute /usr/lpp/mmfs/bin/mmlscluster and I can't find documentation on what the Designation actually means. Does quorum-...
- 101
0
votes
0
answers
12
views
Abaqus GUI is not supported on compute node?
One of instructor says that Abaqus GUI is not supported on compute nodes. I will have to run abaqus via commands on compute nodes.
and that If parallel/ distributed computing is available in abaqus, ...
- 1
0
votes
0
answers
87
views
Sharing ssh keys between cluster nodes
I have a cluster with several login nodes and many compute nodes (call it the cluster). Then I have another server with a large shared storage (call it the storage). I need to be able to rsync (i.e. ...
- 135
-1
votes
1
answer
21
views
Sync sudo anthority to all nodes
I want to submit a task that is interpreted by /bin/csh, which only exists in master node. And I have no root permission but only sudo, which is limited in master node. So I can't use sudo apt install ...
- 1
1
vote
0
answers
40
views
Jetson Nano Picocluster not accessible from network
I recently received a Picocluster with five Jetson Nano boards running MicroK8S. The cluster has a built in switch, which I know works as I can route my own network traffic through it just fine. All ...
1
vote
0
answers
35
views
Is it possible to mount an ATA over Ethernet (AOE) block device on multiple clients, if so how?
I have a lab consisting of 3 machines connected with 2 10gbe links on 2 segregated networks. Each device has 100tb in block storage connected to it. I want to use ATA over Ethernet to create a storage ...
- 111
0
votes
1
answer
234
views
How to create a ocfs2 filesystem in ubuntu?
Can someone please walk me through the step-by-step process of configuring a ocfs2 filesystem right from splitting an existing partition? When I tried, I am seeing the below error:
mount.ocfs2: ...
0
votes
0
answers
20
views
Why non-root python installation can work across the whole cluster?
I recently installed anaconda (which includes a python3) locally in my account folder on a cluster with a dozen of nodes (each node with several cores). I use it to install some package P that is used ...
- 101
1
vote
1
answer
246
views
Debian 10 Pacemaker-Cluster: GFS2 Mount fails because of "Global lock failed: check that global lockspace is started."
I'm trying to setup a new Debian 10 cluster with three instances. My stack is based on pacemaker, corosync, dlm, and lvmlockd with a GFS2 volume. All servers have access to the GFS2 volume but I can't ...
- 11
0
votes
1
answer
846
views
Error: #error This file requires compiler and library support for the ISO C++ 2011 standard
I am running a c++ code with TAU (analyzing and profiling tool) on Ubuntu 20.04 LTS using some cluster. The command I am running looks like this:
tau_cxx.sh -I$FFTW3_INC wrappingScript.cpp ...
- 1
1
vote
1
answer
594
views
How can I submit multiple R job at once?
I have a R-script which runs multiple files say file=1 to 50.
I usually submit repeated jobs say 5 times with 10 files each time by changing the number in R-script.
So, how can I submit the 5-job at ...
- 21
0
votes
1
answer
17
views
What are the existing open source tools to develop on-premise organizational app store on linux?
We have a Linux cluster in our organization and my data science team is developing a number of ML projects to be utilized by teams across the organization. To enable the teams to access the ML models, ...
- 101
0
votes
0
answers
76
views
Where are libvirt's VM definitions "originals" stored, and how to sync them across multiple nodes?
Migrating from Xen's xm to Xen's xl under control of libvirt, I wonder:
Where does libvirt store the "originals" of VM configurations?
I found that my PVM configurations are stored in /etc/...
- 804
1
vote
1
answer
354
views
Python error only when I run script on Linux cluster: _tkinter.TclError: no display name and no $DISPLAY environment variable
My question is related to a python error, but I suspect that it is more a Linux question than a python one. Thus I post it first here.
I am running a python script which does a calculation and then ...
- 155
0
votes
0
answers
869
views
How can I cancel all waiting jobs with qsub?
I am running a lot of jobs with qsub: some are running, some are waiting. Is there a way to cancel all the jobs for a given user which are queued/waiting without giving the individual job IDs?
- 123
2
votes
1
answer
412
views
how to set passwordless authentication in a cluster where users /home directory from headnode is mounted to all machines /home of the cluster
First of all thank you in advance for your help.
I hope the title makes sense. Basically, on the headnode the users' home directory (i.e: headnode:/home/eric) are NFS shared and mounted to all the ...
- 33
0
votes
1
answer
907
views
Pacemaker apache resource is Failed to access httpd status page after change to HTTPS
I get this error from pacemaker after i change apache from http to https.
now my ocf::heartbeat:apache resource is not find status page.
I generate SSL certificate separately for 3 servers.
Everything ...
2
votes
1
answer
603
views
Simple cp command not working (inside shell script and submitted using sbatch on a cluster)
I am working on a cluster running RHEL and I submit jobs using the following command.
sbatch MyScript.sh
The content of the MyScript.sh are as below.
#!/bin/sh
# ....
# Other SBATCH related commands ...
- 121
1
vote
1
answer
128
views
compiling HPL-2.0_FERMIv15
when i compile xhpl i always get the error message:
./xhpl: error while loading shared libraries: libdgemm.so.1: cannot open shared object file: No such file or directory
when i type ldd xhpl:
linux-...
- 11
1
vote
0
answers
312
views
Cannot seem to start pcs cluster (NFS Cluster) disk_fencing trouble
For the life of me, I can't find a clear answer on how to start my NFS active / passive cluster. I have two nodes, node1 and node2 and followed the guide here: https://www.linuxtechi.com/configure-nfs-...
- 11
0
votes
1
answer
2k
views
DRBD: "Couldn't mount device [/dev/drbd0] as /mydata" when failing over or rebooting node
I'm creating a cluster system using two ESXi hosts, with a CentOS 7 server on each.
Going through I created the filesystem, and it mounts on node1.
When I perform a standby or reboot from node01 to ...
- 113
0
votes
2
answers
2k
views
How to Remove caavg_private Properly on AIX?
I am trying to cleanup a server which had a PowerHA configuration. I have stopped cluster (smitty clstop) and removed resource groups. How do I remove the caavg_private properly?
hdisk5 ...
0
votes
1
answer
46
views
RHEL 6.9 HA clustering issue with one node completely down
I have two node servers with SAN storage.
Each node have RHEL 6.9 with HA and the partition are mapped from the storage using fiber cables with clustered resources.
The thing is when the two nodes ...
0
votes
1
answer
140
views
Trying to Create an AFM relationship by using GPFS protocol. Having error in cache side cluster
I am trying to create an AFM relationship by using GPFS protocol. Having error in cache side cluster.
Steps of Home cluster :
1) Create a home cluster (cluster name - gpfs01).
2) Create a file ...
1
vote
0
answers
229
views
OpenLDAP Cluster
Trying to implement an OpenLDAP cluster, I already managed to set up the two backend LDAP servers in mirroring mode.
The application (iRedMail) using the LDAP service is running on the same systems ...
- 11
1
vote
0
answers
285
views
How does htop calculate times? (Impossible times shown)
I was running what was supposed to be a small make job on a small node in our cluster, but a sorting process seemed to be overwhelming the allocated RAM, so I killed it after 20 hours (same jobs on ...
- 111
0
votes
1
answer
49
views
how to move fs resource in service group in ccs cluster
I have a ccs cluster running on RHEL 6.4 where there is no luci service, i have added a filesystem resource to the cluster with the below command but i need to move the resource inside a service group....
0
votes
1
answer
226
views
How to setup a compute cluster in local network on top of linux
I have 3 machines in my local network running manjaro. I am running python scripts using dask, pandas, etc which max out the cpu on the first machine and I usually need to wait more than 30 min until ...
- 123
0
votes
2
answers
119
views
Why worker nodes are not fault-tolerant?
A swarm manager nodes handles cluster management tasks such as:
1) Maintaining cluster state
2) Scheduling services
3) Serving swarm mode HTTP API endpoints
You may execute any of the - docker ...
- 1,286
1
vote
1
answer
459
views
what is the purpose of overlay network driver?
Below is the command run on ubuntu to create overlay network driver for swarm cluster instead of using bridge network driver
$ docker network create -d overlay xyz
$ docker network ls ...
- 1,286
0
votes
1
answer
300
views
Performing maintenance on GFS2 inside pacemaker cluster
I will need to perform a maintenance on one of storage servers that provides GFS2 volume to a three node pacemaker cluster.
Same cluster has an addition of 2 GFS2 volumes as well.
Would it be safe to ...
- 347
1
vote
1
answer
58
views
Run a shell script within an already running shell script
I have a small SLURM cluster, which I am using to run jobs. I run a script and while that script is running, I want to enter a specific key command "t + enter". I believe I should do it by submitting ...
- 111
2
votes
1
answer
734
views
Slurm on desktop computers, how to prioritize the owner
In short: On a Slurm cluster, I need some computers to be available and responsive to their respective owners during work hours.
Problem: I manage a small (but growing) heterogeneous cluster with ...
- 141
2
votes
1
answer
2k
views
PCS Stonith (fencing) will kill two node cluster if first is down
I have configured a two node physical server cluster (HP ProLiant DL560 Gen8) using pcs (corosync/pacemaker/pcsd). I have also configured fencing on them using fence_ilo4.
The weird thing will happen ...
- 347
1
vote
1
answer
422
views
Pacemaker: stopping pacemaker doesn't always move resources to other node
I have created a 2 node cluster on sles12. Following is the configuration -
msnode1:~ # crm --version
crm 3.0.0
msnode1:~ # corosync -v
Corosync Cluster Engine, version '2.3.6'
...
- 11
1
vote
0
answers
31
views
OpenLDAP cluster: deletion of an entry is not replicated
We have an OpenLDAP 2.4 cluster of three nodes configured in multi-master and accessed through a VIP in round-robin. The three machines run RHEL7.
We noticed that deletion of an entry (done from a ...
- 25.9k
0
votes
1
answer
517
views
How to verify which is primary node in a HANA DB cluster operating on SLES 12?
Currently I have two HANA DB servers in a cluster and replication is not running. Upon checking from SUSE Hawk, node 2 is acting as primary node and node 1 is available. How do I confirm that node 2 ...
- 11
0
votes
0
answers
2k
views
Pacemaker cluster service can't start properly Couldn't mount filesystem
I have 3 nodes MySQL cluster on RHEL 7.5 with DRBD, Pacemaker and after start cluster getting following error. How can I overcome ?
[root@db1 ~]# pcs status
Cluster name: mysql_cluster
Stack: ...
- 413
0
votes
2
answers
987
views
Fencing of Redhat cluster 7 on VirtualBox
I am trying to create a 3 node Redhat Cluster 7 on Oracle VirtualBox VMs hosted on Windows Server 2012 R2.
What agent can I use for fencing?
How do I go about it?
Note : I am creating a cluster for ...
4
votes
2
answers
2k
views
Expanding only certain variables inside a heredoc
This is an extension of the question I asked .
Passing directory from command line to shell script
I have a script which writes another script using a heredoc. I need to be able to write unexpanded ...
- 967
0
votes
0
answers
783
views
Passing directory from command line to shell script [duplicate]
I want to pass directory as a command line argument to the shell script.
#!/bin/bash
sourcedir=/home/dir/data
cd $sourcedir
find "$PWD" -maxdepth 2 -name \*_R1*.fastq.gz > list1
fastq_list=$...
- 967
3
votes
1
answer
246
views
restore $0 or $BASH_SOURCE after it is modified by the cluster
I am using a shared SLURM cluster. I am trying to get the path of the bash script from inside the script itself.
There is already an excellent thread here: https://stackoverflow.com/questions/59895/...
- 199