discusion related to cluster mecanism.

learn more… | top users | synonyms

1
vote
1answer
802 views

Zookeeper DNS name problems with leader elections when migrating from Windows to Debian

I am migrating a kafka/zookeeper cluster on Windows to Debian wheezy. Java version: 1.7.0_80 Debian version: 7.9 Zookeeper version: 3.3.5+dfsg1-2 0 Kafka version: 2.10-0.8.2.1 If I configure ...
1
vote
1answer
55 views

Will having dozens of inactive logins hurt performance

I work on a cluster shared with ~20 users, many of them operating remotely. It's quite common to open the login node, type users and see ~100 users listed, mostly the same user logged in multiple ...
1
vote
2answers
2k views

Clustering Servers to run one vm

I am looking at clustering about five machines and I wanted to get some opinions about what is the best way to go about it. I'm wanting to run one VM over the five machines, firstly I want to ask, 1: ...
1
vote
2answers
44 views

NFS high availability

I am in a situation where I would like to provide NFS servers in high availability. The setup I currently have is a VMware enviroment, with shared storage via a SAN using iSCSI. Simply, I have a ...
1
vote
2answers
65 views

How do I quickly transfer a large archive (~16GB)

How do I quickly transfer a large archive (~16GB) from one mount point to another on 80 servers? The mount points are on separate partitions. I tried ansible (with the -f 100 option) and a bash script ...
1
vote
1answer
214 views

Linux run every program on cluster

I am playing around with Open MPI and I must say I love the concept of running programs on the cluster. The problem I am facing with Open MPI is that a specific program must support this way of ...
1
vote
1answer
2k views

EMC storage + powercf command + powerpath

When I run powercf -q on my Solaris machine, what changes does this command do on the EMC storage, or on Solaris file system? From manual page: DESCRIPTION During system boot on Solaris hosts, ...
1
vote
1answer
190 views

Python script works from terminal, but fails in scheduler, to write to external drive

I am trying to use a Python script to read/write from an external disk in linux, which works fine. The problem comes when I use a job scheduler to execute the Python program. I am running all this on ...
1
vote
1answer
348 views

RedHat cluster with rgmanager or pacemaker as resource manager on Oracle VirtualBox

I'm learning RedHat cluster and I have setup a 3 node cluster (Centos 6.7), corosync, cman and rgmanager on Oracle VirtualBox version 5.x. The cluster is working fine (the clustat commmand shows that ...
1
vote
1answer
58 views

Saving power on a linux cluster

I would like to buy a cluster (30-60 nodes) for work and install linux on it. The cluster should have a queue system like PBS, for instance. It should also be capable of doing parallel computation. I ...
1
vote
1answer
116 views

Is there a way to achieve context-dependent path names (CDPN) on NFS?

In my GFS clusters I use the CDPN feature to have separate chrooted /dev/log directories on separate cluster nodes: /home/ftpuser/foo: lrwxrwxrwx 1 root root 18 Sep 26 2010 dev -> .sys/@...
1
vote
2answers
363 views

can I tell to useradd to execute a script? Maybe in /etc/default/useradd?

There are plenty of people that already answered to the question "how to execute useradd properly in a script?" My question is: "is it possible to tell to useradd to execute one script when it is ...
1
vote
1answer
69 views

Oracle 11gR2 grid silent installation: error for privateinterconnects

I am installing Oracle grid 11gR2 using silent install with response file. I am getting error after "Collecting interface information for node 1" in logs. I have a feeling that this could be due to ...
1
vote
1answer
439 views

HAProxy should not forward an incoming request to down instance

In my scenario, I have 2 servers, both are communicating with HAProxy. When a request comes in, HAProxy splits the request and sends it to both servers, following a round robin method. If in any case ...
1
vote
0answers
13 views

qsub launch a job from node

I have a pipeline that is launched using a command. For some admin/server reasons, that tool has to be launched from a node. That tool triggers all the steps from my pipeline in a file called pipeline....
1
vote
0answers
34 views

Running web server without root access

Excuse the probably simple question, I don't know much about running web servers. I' am trying to run some software on a compute cluster I have access to on my school campus (so I don't have root ...
1
vote
0answers
20 views

HA Cluster LUN switching without failure [closed]

It's very strange to see this a commonly used HA Cluster having problem, I have configured HA cluster on 2 server with 1 storage LUN, which is switching automatically without failure. I am unable to ...
1
vote
0answers
54 views

FreeBSD 10.2 - Is three-way HAST replication possible?

I have a pair of FreeBSD 10.2 servers using HAST to keep a volume replicated between them. I'm introducing two new storage nodes that have much newer hardware and will eventually replace the existing ...
1
vote
1answer
215 views

Failover NFS service with shared storage

I need to configure a cluster with shared storage that can be moved from Node A to Node B and vica versa. In case of failure of Node A, Node B should take over the IP address associated with the NFS ...
1
vote
0answers
671 views

qsub job in state Eqw error: can't chdir to directory: No such file or directory

I'm trying to submit a job on a cluster via qsub, but it gets stuck in state "Eqw" with error message: $ qstat -j 466 | grep error error reason 1: 09/18/2015 17:12:32 [1125:3453]: error: ...
1
vote
1answer
129 views

Python processes appearing and disappearing in top

I concurrently launched around 12 Python scripts on a 24-core server (Ubuntu 14.04 LTS x64). Each of Python script takes around one hour to complete. I see in top that they appear quite sporadically, ...
1
vote
1answer
418 views

Network Configuration for Rocks Cluster

So I'm trying to set up a Rocks cluster and seem to be failing at the network configuration part, as I can not get an internet connection in my final install. So the address of that computer that ...
1
vote
1answer
199 views

Running a systemd service once a day (on a CoreOS cluster)

I currently have a CoreOS cluster on AWS. The cluster runs multiples containers, mainly for Rails applications. However, one of this container is a pure Ruby app processing a lot of data from specific ...
1
vote
0answers
2k views

Error starting MySQL in a MariaDB Galera cluster in CentOS 7

I'm trying to setup a MariaDB Galera cluster following this tutorial exactly as it is, and I'm stuck in the Step 7– Initialize the first cluster node, I'm doing so with sudo /etc/init.d/mysql start --...
1
vote
0answers
686 views

clvm (cman) has problems with dlm

I am trying to create a volume group which is accessible on two servers with clvm. I read about it and it looks like it is most easily to do this with cman. But after hours of testing I cannot achieve ...
1
vote
1answer
388 views

Linux Cluster - SFTP between failed over Servers

I have a strange problem with our cluster solution on Linux. We have the following set-up in our environment. Each of these servers hosts our enterprise application. Server1 Server2 Server3 ...
1
vote
1answer
98 views

Cluster Lock Manager without TCP/IP

I have 2 linux sharing same SAN disk LUN. There are many cluster files systems to manage lock/unlock. But all of them are using a seperate TCP/IP comminication. But I need a cluster lock manager ...
1
vote
0answers
1k views

About mem and vmem

I am working with a cluster machine running under linux. I have a shell script that uses mpirun to submit my jobs to the cluster machine. In that same script, I can choose the number of nodes that ...
1
vote
0answers
123 views

Microcomputer cluster for stress testing

I'm looking to build a microcomputer cluster at work for stress testing one of our applications, and while I have a little financial leeway, I would like to keep the cost low and the computing ...
1
vote
1answer
343 views

Strategies for building distributed computing system with hybrid Mac and Linux systems

I want to build a distributed computing system to run Matlab, C and other programming languages for scientific computing. Now I've several old Mac machines with Lion Mac OS installed acted as web ...
1
vote
2answers
425 views

Trying to install a cluster, DHCP failing to start

Trying to install a linux cluster using this tutorial. I am running CentOS 6.3. When I try to start DHCP with service dhcpd start, it fails. I've used tail -f /var/log/messages and dhcpd -t, but I ...
0
votes
1answer
287 views

Make virtualbox get a different IP address than my laptop

I am trying to setup a 2-node Hadoop cluster (following this guide), where the master is going to be my Ubuntu laptop and the slave a virtualbox running ubuntu. I also read about networking in ...
0
votes
1answer
26 views

What's the correct job time limit specification for jobs to LSF

What is the correct way to specify how long a job can run on a computer cluster using LSF as the resource manager/ job scheduler? LSF is a job scheduler that computing clusters use to allocate ...
0
votes
1answer
85 views

Problems with qorum device on Cluster Suite

I've built a 2 nodes ha-cluster with Cluster Suite on RH6.5; the configuration is very simple: 1 lvm shared volume, 1 fs over the shared volume and 1 vip. I've a failover domain and I'm using a scsi ...
0
votes
1answer
66 views

wget from Source Forge

I know this has been asked here: How do I download from SourceForge with wget? But I can't get it to work with my specific tool. Can anyone help me download from this sourceforge link: http://...
0
votes
1answer
23 views

Avoid being assigned to a particular node in cluster

I am using the department's cluster which adapts the pbs queuing system to run some mpi programs. Are there any ways that I can avoid being assigned to a particular node when submitting a job via qsub ...
0
votes
1answer
187 views

File Server on High Availability (HA) Setup for LAMP?

I'm not sure what is the most proper way (industrial standard) to setup the High Availability servers (especially for LAMP Stack). Lets say i have: 2 Load-balanced Web Servers (Apaches) Question: ...
0
votes
1answer
139 views

Move Root Folders to DRBD

What folders in the root folder ( "/" ) cannot be moved to a clustered file system (using DRBD and probably GFS2)? Would like to setup a basic cluster to increase uptime for our file server, web ...
0
votes
1answer
500 views

Running shell script on cluster in parralel

I thought dsh(Distributed Shel) will be a good option but when i ran my shell script across my nodes, I didnt get expected output, dsh -aM -c bash /home/cloudera/bash_script.sh server2@x.x.x.110: ...
0
votes
1answer
1k views

Script for running sequential job

I started recently to learn using Linux. I want to write a script in bash shell to run a serial job on a cluster. I have been searching for hints and instructions on how to write such a script. I ...
0
votes
3answers
3k views

Kill nohup command on cluster

Last night I launched a command via nohup on a cluster and then closed the connection. Today I would like to kill this job (I know it's still running because output is being generated in an output ...
0
votes
1answer
225 views

Samba on a Beowulf Cluster

Is this possible? I have only been able to locate resources related to running scientific applications. Any resources would be helpful. Regards
0
votes
0answers
12 views

Running a function in parallel (in python) on clusters using different screens [migrated]

I have 2 functions which I need to run them in parallel written in python. The issue is that I'm running the code on the cluster, so first I open a screen and then I execute the python code. if ...
0
votes
0answers
10 views

CentOS or RHEL 7 - change nic used by cluster

I have a two nodes RHEL 7.1 cluster (NFS server) that currently uses 10 Gbps ethernet nics. The servers use a SAS shared storage. If I have to switch to Infiniband (IPoIB), can I stop the cluster, ...
0
votes
0answers
56 views

Spark example Pi fails to run on yarn-client mode

I tried my spark app on yarn-client mode and it's failure. And then I tried to run spark example of Pi on it and failure too. The systems I'm working on are as following: Ubuntu 14.04.4 Java(...
0
votes
0answers
13 views

Improving MPI performances on a heterogeneous cluster

I am running some parallel programs on a heterogeneous cluster: 2 CentOS virtual nodes (node 1 & node 2) on a Mac host and 2 others (node 3 & node 4) on a PC. When I run a parallel program (...
0
votes
0answers
17 views

Any clustering / load balancing solutions for VPN servers that support external IPs?

I am looking for a clustering / high availability / load balancing solution (something like ucarp or clusterip, etc) where it allows the nodes to be external IPs. Specifically, I would like it for ...
0
votes
0answers
32 views

How to generate following output file by using PBS script language?

I need to run interacting job with such specifications by using PBS on the cluster. This job must write the output file, in which there is following information (I have not specify this in the .pbs ...
0
votes
1answer
175 views

CIB not supported: validator 'pacemaker-2.0', release '3.0.9'

I am trying to make two node clusters with pacemaker and corosync. When I want to change config with crm I get the following error: CIB not supported: validator 'pacemaker-2.0', release '3.0.9' ...
0
votes
0answers
40 views

How to bootstrap a new dependency configuration on a cluster?

I have access to a cluster running a CentOS 6, which have not been updated. For that reason, the glibc, ld-linux and other dependencies that, I think, are kernel-based are all out-of-date. I have no ...