discusion related to cluster mecanism.

learn more… | top users | synonyms

1
vote
2answers
35 views

NFS high availability

I am in a situation where I would like to provide NFS servers in high availability. The setup I currently have is a VMware enviroment, with shared storage via a SAN using iSCSI. Simply, I have a ...
1
vote
0answers
11 views

qsub launch a job from node

I have a pipeline that is launched using a command. For some admin/server reasons, that tool has to be launched from a node. That tool triggers all the steps from my pipeline in a file called pipeline....
2
votes
1answer
39 views

MySQL DRBD Resource failing to start PaceMaker + Corosync

So I have gotten to the point where I had all services running when I configured the cluster, but after reboot I am getting the following : Full list of resources: virtual_ip (ocf::heartbeat:...
3
votes
1answer
45 views

SLURM: Custom standard output name

When running a SLURM job using sbatch, slurm produces a standard output file which looks like slurm-102432.out (slurm-jobid.out). I would like to customise this to (yyyymmddhhmmss-jobid-jobname.txt). ...
4
votes
0answers
52 views

Check if a remote machine is in a cluster

How can I verify if a remote machine is a cluster machine? I just created the following ssh command to verify if the remote machine is a VRTS cluster or a Linux availability Red Hat cluster ...
0
votes
0answers
11 views

Improving MPI performances on a heterogeneous cluster

I am running some parallel programs on a heterogeneous cluster: 2 CentOS virtual nodes (node 1 & node 2) on a Mac host and 2 others (node 3 & node 4) on a PC. When I run a parallel program (...
1
vote
0answers
31 views

Running web server without root access

Excuse the probably simple question, I don't know much about running web servers. I' am trying to run some software on a compute cluster I have access to on my school campus (so I don't have root ...
2
votes
3answers
89 views

Monitoring a GPU cluster

I have 10 servers running on Ubuntu 14.04 x64. Each server has a few Nvidia GPUs. I am looking for a monitoring program that would allow me to view the GPU usage on all servers at a glance.
1
vote
0answers
18 views

HA Cluster LUN switching without failure [closed]

It's very strange to see this a commonly used HA Cluster having problem, I have configured HA cluster on 2 server with 1 storage LUN, which is switching automatically without failure. I am unable to ...
2
votes
0answers
34 views

Running R scripts on a Linux cluster

I have access to an IBM IDataplex Cluster with CentOS v.6.2. If I want to run the following R script on R: library(data.table) library(mgcv) library(reshape2) library(dplyr) library(tidyr) library(...
0
votes
0answers
17 views

Any clustering / load balancing solutions for VPN servers that support external IPs?

I am looking for a clustering / high availability / load balancing solution (something like ucarp or clusterip, etc) where it allows the nodes to be external IPs. Specifically, I would like it for ...
0
votes
0answers
29 views

How to generate following output file by using PBS script language?

I need to run interacting job with such specifications by using PBS on the cluster. This job must write the output file, in which there is following information (I have not specify this in the .pbs ...
0
votes
1answer
115 views

CIB not supported: validator 'pacemaker-2.0', release '3.0.9'

I am trying to make two node clusters with pacemaker and corosync. When I want to change config with crm I get the following error: CIB not supported: validator 'pacemaker-2.0', release '3.0.9' ...
0
votes
0answers
40 views

How to bootstrap a new dependency configuration on a cluster?

I have access to a cluster running a CentOS 6, which have not been updated. For that reason, the glibc, ld-linux and other dependencies that, I think, are kernel-based are all out-of-date. I have no ...
0
votes
1answer
64 views

How to change the user password on all nodes of a (pbs) linux cluster

There are a number of cluster commands that allow performing operations on all cluster nodes at once, e.g. cexec, as in cexec mkdir /scratch/something. How can I change the password on all nodes at ...
0
votes
0answers
18 views

MySQL Cluster node crashed, how to re-add in cluster?

We have 2 data node in mysql cluster, and one of them got crashed (totally). I have re-install new OS and now i want to re-add same node back to cluster. How to do that without re-starting whole ...
2
votes
1answer
54 views

Help in building Yocto(open embedded) projects using cluster computing in Linux

I need to reduce project build time in Yocto (open embedded) in Linux platform. So I decided to cluster computers for the best performance for compilation and building. My question: Is there any MPI ...
1
vote
0answers
46 views

FreeBSD 10.2 - Is three-way HAST replication possible?

I have a pair of FreeBSD 10.2 servers using HAST to keep a volume replicated between them. I'm introducing two new storage nodes that have much newer hardware and will eventually replace the existing ...
2
votes
1answer
197 views

Validate start-dfs.sh

I am trying to setup a Hadoop cluster, where master is my laptop and slave is the virtualbox, following this guide. So, I did, from master: gsamaras@gsamaras:/home/hadoopuser/hadoop/sbin$ sudo ./...
1
vote
2answers
136 views

host can't ssh guest, but guest can

This is a follow-up question from: Make virtualbox get a different IP address than my laptop. I ended up with these /etc/hosts files on both my laptop running Ubuntu 14.04 (the host) and my virtualbox ...
0
votes
1answer
242 views

Make virtualbox get a different IP address than my laptop

I am trying to setup a 2-node Hadoop cluster (following this guide), where the master is going to be my Ubuntu laptop and the slave a virtualbox running ubuntu. I also read about networking in ...
0
votes
0answers
52 views

problem with ABAQUS job on Rocks cluster

I created ROCKS6 cluster and i installed ABAQUS on my cluster and it works well on frontend, but i can not submit job on my 2 other compute nodes. I just want to run ABAQUS on this cluster (frontend ...
0
votes
0answers
93 views

How to install ABAQUS software on Rocks cluster 6.2

First of all sorry for my english. I create a new cluster with 3 . which one of them is frontend and two of them is compute . i should notice that, i am newest in linux and linux hpc clustering. I ...
0
votes
0answers
12 views

Writing a unique number in a parallel ssh / clusterssh environment

I'm trying to set up a cluster of Kafka servers and I'm currently using clusterssh for it, which works great. As one step of the setup, I have to assign a unique id to every cluster (as in 0, 1, 2, ...
0
votes
0answers
17 views

High Performance Cluster setup

I am starting to setup a High Performance Cluster (HPC) that will have a head node, 16 sub nodes and 8 GPU nodes. I am looking into Red Hat 7.2 as they state to have HPC capability. Thoughts on ...
0
votes
0answers
193 views

How do I add a Redis Cluster to a Pacemaker CentOS 7 Cluster?

I need to set up a CentOS 7 web server cluster that is able to manage user sessions while also load balancing across the nodes in the cluster. Towards this end, I have transcribed instructions from ...
0
votes
0answers
18 views

spark job dependency on AMI version

I have run a spark job on emr cluster with AMI version 2.4.0-amzn-7 and it completes in 11 hours. but when same jobs are run on AMI 2.4.0-amzn-3, the process takes more than 18 hours to complete. ...
0
votes
1answer
29 views

Terminal to manage cluster, where the nodes are accessible from a remote PC?

I need to manage multiple cluster nodes from my PC. The catch is that the cluster nodes are accessible only from a remote PC. So first I have to ssh to the remote PC, and then ssh to a cluster node ...
0
votes
1answer
79 views

Problems with qorum device on Cluster Suite

I've built a 2 nodes ha-cluster with Cluster Suite on RH6.5; the configuration is very simple: 1 lvm shared volume, 1 fs over the shared volume and 1 vip. I've a failover domain and I'm using a scsi ...
1
vote
2answers
64 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
0
votes
0answers
111 views

HPL benchmark show very low calculation speed

I’m constructing cluster for mph parallel calculation. To check performance of my node, I used HPL linpack benchmark. However, the benchmark result is much more low than a theoretical value. The ...
1
vote
1answer
652 views

Zookeeper DNS name problems with leader elections when migrating from Windows to Debian

I am migrating a kafka/zookeeper cluster on Windows to Debian wheezy. Java version: 1.7.0_80 Debian version: 7.9 Zookeeper version: 3.3.5+dfsg1-2 0 Kafka version: 2.10-0.8.2.1 If I configure ...
1
vote
1answer
199 views

Failover NFS service with shared storage

I need to configure a cluster with shared storage that can be moved from Node A to Node B and vica versa. In case of failure of Node A, Node B should take over the IP address associated with the NFS ...
0
votes
1answer
59 views

wget from Source Forge

I know this has been asked here: How do I download from SourceForge with wget? But I can't get it to work with my specific tool. Can anyone help me download from this sourceforge link: http://...
2
votes
1answer
110 views

Running GNU parallel --sem hangs on SGE Cluster

I'm trying to run 3 commands in parallel on an SGE cluster, e.g. cmds=("prog 1 2 3" "prog 4 5 6" "prog 7 8 9") for cmd in "${cmds[@]}" do sem -j 3 $cmd done sem --wait So, my commands execute ...
0
votes
1answer
23 views

Avoid being assigned to a particular node in cluster

I am using the department's cluster which adapts the pbs queuing system to run some mpi programs. Are there any ways that I can avoid being assigned to a particular node when submitting a job via qsub ...
1
vote
0answers
568 views

qsub job in state Eqw error: can't chdir to directory: No such file or directory

I'm trying to submit a job on a cluster via qsub, but it gets stuck in state "Eqw" with error message: $ qstat -j 466 | grep error error reason 1: 09/18/2015 17:12:32 [1125:3453]: error: ...
2
votes
1answer
199 views

Run qsub on cluster via ssh

I'm setting up a system which automatically generates computing jobs on a local (Linux) machine, copies them to a cluster and submits them to the queuing system. I try to avoid the need for scripts ...
1
vote
1answer
175 views

Python script works from terminal, but fails in scheduler, to write to external drive

I am trying to use a Python script to read/write from an external disk in linux, which works fine. The problem comes when I use a job scheduler to execute the Python program. I am running all this on ...
-1
votes
1answer
102 views

32 bit master node | 64 bit slave node | Linux Server [closed]

The Basic Scenario I have a 32 bit laptop currently running Ubuntu 15.04 32 bit. Its getting a bit old and outdated now so I plan to buy a cheap second hand server. I plan to buy something like an ...
1
vote
1answer
336 views

RedHat cluster with rgmanager or pacemaker as resource manager on Oracle VirtualBox

I'm learning RedHat cluster and I have setup a 3 node cluster (Centos 6.7), corosync, cman and rgmanager on Oracle VirtualBox version 5.x. The cluster is working fine (the clustat commmand shows that ...
0
votes
1answer
31 views

How to see more information for queued Jobs in SLURM

With srun --test-only SLURM will return expected start date AND expected nodes. However, if the job is submitted, I cannot get the information about the nodes. Is there any way to find out, what ...
1
vote
1answer
118 views

Python processes appearing and disappearing in top

I concurrently launched around 12 Python scripts on a 24-core server (Ubuntu 14.04 LTS x64). Each of Python script takes around one hour to complete. I see in top that they appear quite sporadically, ...
0
votes
1answer
822 views

RHEL 6.6 Cluster - Waiting for Quorum Timed-out

I'm trying to set up RHEL Cluster. Everything is fine (well, not at all). I'm using 2 nodes, and 1 quorum (LUN). When I start both cman services at the same time, it's fine. Cluster is up, every ...
1
vote
1answer
387 views

Network Configuration for Rocks Cluster

So I'm trying to set up a Rocks cluster and seem to be failing at the network configuration part, as I can not get an internet connection in my final install. So the address of that computer that ...
0
votes
1answer
181 views

File Server on High Availability (HA) Setup for LAMP?

I'm not sure what is the most proper way (industrial standard) to setup the High Availability servers (especially for LAMP Stack). Lets say i have: 2 Load-balanced Web Servers (Apaches) Question: ...
1
vote
2answers
408 views

Trying to install a cluster, DHCP failing to start

Trying to install a linux cluster using this tutorial. I am running CentOS 6.3. When I try to start DHCP with service dhcpd start, it fails. I've used tail -f /var/log/messages and dhcpd -t, but I ...
0
votes
0answers
89 views

Getting error in nslookup

I am trying to do nslookup skhdphost1 but I am getting below error. When I try to Reverse lookup checking using command nslookup 172.16.xxx.xx again getting the same error: The error message is: [...
1
vote
1answer
187 views

Running a systemd service once a day (on a CoreOS cluster)

I currently have a CoreOS cluster on AWS. The cluster runs multiples containers, mainly for Rails applications. However, one of this container is a pure Ruby app processing a lot of data from specific ...
0
votes
0answers
352 views

rgmanager [fs] start_filesystem: Could not match “f6a58cf7-b39b-489c-add5-444ceab8af9d” with a real device

I am trying to install two node cluster for web server. We have super mico hardware HA BOX. It has 5 disk. one disk is used for node1 os installation and another disk is for node2 OS. Remaining disk ...