Questions tagged [cluster]
discusion related to cluster mecanism.
0
votes
0answers
11 views
Output name of parallel jobs on the same node using Slurm
I am using a small cluster with 4 nodes containing two GPUs each. I am quite new to Slurm so I hope I understood everything correctly.
When I submit a job with sbatch, a whole node gets reserved ...
1
vote
2answers
52 views
Expanding only certain variables inside a heredoc
This is an extension of the question I asked .
Passing directory from command line to shell script
I have a script which writes another script using a heredoc. I need to be able to write unexpanded ...
0
votes
0answers
17 views
Passing directory from command line to shell script [duplicate]
I want to pass directory as a command line argument to the shell script.
#!/bin/bash
sourcedir=/home/dir/data
cd $sourcedir
find "$PWD" -maxdepth 2 -name \*_R1*.fastq.gz > list1
fastq_list=$...
0
votes
0answers
12 views
Bridge network in docker uses 1 vip
I need to get the virtual IP of the container on our UAT server. I deployed docker services on global mode.
Snippet config
docker service create \
--publish mode=host,target=8080,published=...
0
votes
0answers
14 views
elasticsearch and transport tcp problem
I have 3 nodes fro cluster elasticsearch with this config and I have this error!
node-1:
cluster.name: graylog-production
node.name: elasticsearch1
node.master: true
node.data: true
node.ingest: ...
0
votes
0answers
14 views
Is there a way to put an interactive session `qsub -I …` in sleep mode
Is there a way to put an interactive session qsub -I ...
in sleep mode (for instance like the ctrl+z command in the shell - I mean reduce it in order to perform other tasks on the login node)?
My ...
1
vote
1answer
44 views
restore $0 or $BASH_SOURCE after it is modified by the cluster
I am using a shared SLURM cluster. I am trying to get the path of the bash script from inside the script itself.
There is already an excellent thread here: https://stackoverflow.com/questions/59895/...
0
votes
0answers
7 views
PBS Pro Stop waiting jobs for execution
I want to out some of the nodes for maintenance but I have a confusion if I run "qstop @server" will it affect the running jobs ???
My focus to stop only queued jobs those are waiting for free ...
0
votes
1answer
7 views
Redirect DB traffic dependent on type of request
I have a Postgres cluster managed by Patroni and want to be able to redirect DB requests to the replica if they are read requests and write requests to the master.
Does anyone know of any tools that ...
1
vote
1answer
119 views
After failover Pacemaker moves resource back when node comes back
I'm using Pacemaker & Corosync for my cluster.
When a node dies pacemaker moving my resources to another online node. Everything ok here.
But when the dead node comes back, Pacemaker moving the ...
1
vote
1answer
122 views
PVS output not showing drive
I had created physical volume earlier i.e. /backup, /ndasdb, /processor, /latro.
Don't know what exactly happened, but /ndasdb is not showing in any of this output result:
Pvdisplay, Vgdisplay, and ...
0
votes
0answers
57 views
ORTE_ERROR_LOG, what does it mean?
1 [node18:02644] [[37701,0],0] ORTE_ERROR_LOG: File open failure in file ras_tm_module.c at line 142
2 [node18:02644] [[37701,0],0] ORTE_ERROR_LOG: File open failure in file ras_tm_module.c at line ...
5
votes
2answers
398 views
How do commands like fdisk -l find the sector size?
Does the MBR of the disk contain this information and therefore when i call a command like fdisk, a kernel level code eventually runs and reads it from a specific part in MBR? If so, which part of it? ...
1
vote
0answers
31 views
Distributed Block Device Cache for Linux
Is there an open source software available for Linux that implements a
new block device based on an underlying block device (DRBD or shared SAN) and
a distributed memory cache ?
What I'm looking for ...
0
votes
0answers
37 views
MariaDB Galera Cluster on Ubuntu 16.04 does not start after rebooting
I've installed a MariaDB Galera Cluster on Ubuntu 16.04 in 2 nodes.
Here the info from node1:
root@localhost:~# sudo more /etc/mysql/conf.d/galera.cnf
[mysqld]
binlog_format=ROW
default-storage-...
0
votes
0answers
23 views
MariaDB Clusters in Ubuntu 16.04
I've installed MariaDB Clusters in Ubuntu 16.04
I've Restarted the MariaDB service on the primary Linode, with the --wsrep-new-cluster flag:
sudo mysqld --wsrep-new-cluster
but it seems that the ...
0
votes
1answer
105 views
Installing Percona XtraDB Cluster server
I want to Install the Percona XtraDB Cluster server package in Ubuntu 16.04.4 LTS
but I got this error:
sudo apt-get install percona-xtradb-cluster-57
Reading package lists... Done
Building ...
2
votes
2answers
657 views
Memory Per Core [closed]
I am using the super computers in the network provided by Compute Canada and in the documentation page I see the following:
I am quite curious - what is the concept of memory per core here? I thought ...
1
vote
1answer
33 views
Failover physical and virtual machine with replication. Is it possible?
I want to create HA cluster with 2 nodes. First node is physical machine, second is virtual (under ProxMox). Both running under Ubuntu. I know how to make HA with corosync and pacemaker. How i can ...
1
vote
1answer
29 views
NAT/Masquerade. Was working before, now is not
So for at least two months I had an IP tables configuration that was working on a compute cluster to provide internet access to compute nodes that were technically offline, via the headnode. We ...
2
votes
1answer
3k views
How to submit a job to a specific node using Slurm's sbatch command?
Our nodes are named node001 ... node0xx in our cluster. I wonder, is it possible to submit a job to a specific node using Slurm's sbatch command? If so, can someone post an example code for that?
1
vote
1answer
196 views
how to unexport NFS share on VCS HS cluster
**see imp update at bottom of orig. question.
not sure how to unexport only the 'world' mountable share? I have a NFS server which had a share with world-mountable permissions. To make it mountable ...
1
vote
1answer
86 views
Clustered file services failure causes all nodes down? [closed]
I am planning a cluster of 3 active-active nodes running Red Hat Linux 6.7, with local and shared file systems, such that the 3 servers can read / write some shared files concurrently. However, my ...
0
votes
1answer
730 views
install Open MPI on HPC
I want to install OpenMPI on a linux HPC cluster with a Slurm resource manager. I know how to build OpenMPI regulariy from source , however, how do I install it so that it is installed properly on ...
0
votes
1answer
146 views
Lustre and HPC configuration
I have an HPC cluster with 22 nodes, and one head node as a master running Rocks Cluster OS (which is based on CentOS).
The nodes and master communicate with private network (10.10.0.0/16). And we ...
1
vote
0answers
278 views
How to increase memory limit and number of cores that Rstudio uses on a cluster
I launched Rstudio using FastX on Rivanna cluster (CentOS Linux release 7.3.1611 (Core)):
https://arcs.virginia.edu/rivanna
The main goal for doing that was to significantly increase the speed of ...
2
votes
0answers
204 views
Python script to re-configure the network topology of a linux cluster [closed]
Setup: I have 4 Raspberry Pis at home interconnect via a switch (normal router) in my home network. Now I can access them on my pc and use SSH.
What do I want: I want to write a python script that ...
1
vote
2answers
65 views
How to ensure that I've entered the server and how to create a directory there?
I want to run a Fortran code on the server. I am able to log into the server using the command ssh -X username@I.P.address
There is no error message. It asks for the password. After I provide the ...
0
votes
1answer
45 views
How to use all CPU in a cluster with PBS
I'm very new to MPI, my apologies if this sounds naive. I have access to an HPC cluster and am trying to run a serial script on a 40-core cluster. Here is my PBS file:
#PBS -l nodes=1:ppn=40,...
0
votes
1answer
185 views
Are there implicit constraints for resource groups in a pacemaker cluster?
According to redhat's official documentation, all resources in a resource group implicitly have colocation and order constraints. But from the tests i did in my lab setup i can't see any constraints ...
0
votes
1answer
1k views
RHEL High-Availability Cluster using pcs, configuring service as a resource
I have a 2 node cluster on RHEL 6.9. Everything is configured except I'm having difficulty with an application launched via shell script that created into a service (in /etc/init.d/myApplication), ...
1
vote
2answers
63 views
How to connect to the internet through another PC?
I have a small cluster with several nodes. Only one node (let's call it root), can connect to the internet. All nodes are connected, so we can ping from one to another, but we can't reach Internet ...
0
votes
1answer
70 views
How to send a request to Pgpool2 server from php script?
Actualy i'm trying to create a postgres replication system using pgpool2 and docker containers, I created 2 containers running postgres and another container for pgpool2, so when I tried to connect to ...
0
votes
1answer
60 views
Clustered infrastructure on VPS
I want to build infrastructure which is clustered. Only option I have is VPSs in container. The following is how should infrastructure should look like.
All incoming traffic comes to Fw1. Proxy ...
0
votes
1answer
187 views
MySQL NDB Management Node Got Different Node IP Address Against the config.ini
I am engaging with a MySQL HA configuration. Currently, I setup the config.ini on my management node:
root@ndb-mgmd:~# cat config.ini |grep -v ^#
[tcp default]
SendBufferMemory=2M
...
1
vote
1answer
3k views
Automatically input “yes” on the bash file [closed]
Slurm is workload manager. There are two kinds of modes to run job, interactive(srun) and batch mode(sbatch).
When using interactive mode, one needs to leave the terminal open which may lead extra ...
0
votes
1answer
700 views
distribute the JVM across a cluster of machines
Grasping at straws for search parameters and terminology.
The key attribute to the JVM is the V for virtual (at least within the context of this question). How do you span a JVM across a cluster of ...
3
votes
1answer
874 views
Single system image (clustering) solutions
Are there any Single System Image (clustering) solutions being actively developed? Kerrighed's last version targeted Linux 2.6.30 and the latest OpenSSI seems to target Linux 2.6.14.
Perhaps there's ...
0
votes
1answer
360 views
Grid engine/cluster management and job scheduler for Debian/ubuntu
I need to perform large amount of computations on a something resembling a cluster, the hardware and the OS are identical (the OS is ubuntu) but no central management software or grid engine is ...
1
vote
0answers
79 views
Mariadb cluster doesn't start on reboot
I make cluster for mariadb on 3 VMs(called controller1, controller2, controller3), them works fine.
But however, after I reboot the VMs, the mariadb is not start:
[root@controller1 ~]# rabbitmqctl ...
0
votes
1answer
3k views
How to monitor the Pacemaker cluster using a script?
I have created a two node cluster (both nodes RHEL 7) using pacemaker. It is used to run a custom application. I have created below resources and assigned it to the cluster:
A shared storage for ...
0
votes
1answer
63 views
IBM AIX aix how to start cluster when a lv is modified and other cluster nodes are down?
I am using an AIX HACMP cluster . By mistake a logical volume in a shared vg is resized.
Now when using smitty clstart I am unable to start the cluster.
Only this node in the cluster is up.
...
1
vote
1answer
274 views
Job environment not being setup correctly on SGE
I realize this might be hard to answer without you knowing how my cluster is setup, but I' am trying to submit jobs (via SGE) to a cluster, but the environment is not setup correctly and the jobs ...
2
votes
0answers
38 views
How to extract the values of the resources specified in a PBS directive so that they can be mapped into other environment variables?
This question arises when trying to find a script in my host computing cluster that can allow more convenient management of quantum chemical calculations on Gaussian. The user manual of my host gives ...
1
vote
0answers
92 views
high performance computing cluster setup
In my lab, we have several servers used for the simulation programs, but they worked independently. Now I want to combine them to become a cluster using MPICH to make them communicate. But there ...
1
vote
1answer
230 views
Submitting list of jobs to slurm
I have a large number of scripts that can be run as separate jobs on a computing cluster, which uses slurm. I want to select some of them, based on the contents, to submit. It's easy to identify the ...
3
votes
1answer
458 views
Cluster filesystem choice for reading/writing large number of small files
I'm setting up a small Linux cluster for my laboratory. Current we have an login node for job submit and 3 computational node, and they are connected by Gigabit LAN (sadly no infiniband).
At first I ...
1
vote
1answer
88 views
Generalising Grid Engine qsub job file for multiple programs and input file names
I am using Grid Engine on a Linux cluster. I am running many jobs with different programs and different input files. I don't want to create multiple specific job scripts for each pair of program and ...
0
votes
1answer
332 views
Best way to set up fence_vmware-soap on centos7
I have two node cluster providing nfs services. using pacemaker and corosync. both nodes are using a shared lun.
I created a vsphere user and set up two fence_vmware_soap fence agents. one on each ...
0
votes
0answers
42 views
Linking a Centos 7 Cluster
Five physical server boxes that each have Centos 7 installed will be joined in a cluster and will together host a web application. What is a best practice for physically linking the boxes together? ...
