Questions tagged [distributed-filesystem]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
1answer
33 views

Adding entries to fstab results in emergency mode

This is my local system configuration. NAME="elementary OS" VERSION="5.0 Juno" I am mounting my remote server's file system on a subdirectory by this command, which is working fine. sudo sshfs -o ...
1
vote
0answers
31 views

Need a suggestion on software distribution between different PC's using the same distribution [closed]

I want to distribute the software/application between different PC which are using the same distribution [OS - Centos]. Example: Consider i have some 10 PC with similar distribution, I installed the ...
1
vote
1answer
502 views

Unable to mount gfs2 file system on Debian Stretch, probable dlm mis-config?

I am experimenting with gfs2 on Debian Stretch, and having some difficulties. I am a reasonably experienced Linux admin, but new to shared-disk and parallel file systems. My immediate project is to ...
3
votes
0answers
62 views

Is it crazy to consider keeping my home directory on OpenAFS?

I am a sysadmin by trade, and I do what I do at work at home as well for fun. I have a Gentoo Linux laptop, Raspberry Pis running Raspian, a Gentoo server, ARM devices running Debian and have various ...
2
votes
0answers
544 views

Meta Data Server (MDS) cluster for pnfs

TL;DR pNFS seems a great method for multiple concurrent access to centralised shared storage, but it has a problem: the single NFS server providing NFS metadata (meta data server, MDS) is a single ...
1
vote
2answers
943 views

ZFS read-only mount on Linux + simultaneous read-write mount on Solaris

We have to regularly copy quite huge files from Solaris to Linux (using network). It currently takes almost half a day for one file. The files in Solaris are on a ZFS filesystem. So I thought what a ...
0
votes
1answer
55 views

How to move a directory?

I have a directory in HDFS with subdirectories that contain part-xxxxx files, created by Spark. I want to move that directory (and everything inside it) into a new directory. How to? My attempt: [...
1
vote
2answers
312 views

set up NFS two way syncronization [closed]

I have two servers that I want to "share" the home folder of, such that when I make changes on Server A they appear on Server B and when I make changes on Server B they appear on Server A. Right now ...
1
vote
1answer
80 views

Where would be the best location to mount a distributed filesystem? [closed]

We are looking at mounting a distributed file system on our RHEL machines and we think that the best location to mount the share is at /var/dfs. Where would the best location be to mount this share?
1
vote
1answer
671 views

distributed file system that works well with multiple small files [closed]

Hi my use case is quite specific. I have 20 Windows 7 machines constantly creating files in my storage; around 98% of these files are 2.1 MB. On average we create 24 million files every 3 days, and ...
3
votes
2answers
120 views

“Junctioned” symbolic links [duplicate]

Does Linux have the capability to use "junctioned" symbolic links? I'm not sure if this is an actual term or not, so let me explain the concept. I have a git repository containing all my ...
2
votes
1answer
1k views

Validate start-dfs.sh

I am trying to setup a Hadoop cluster, where master is my laptop and slave is the virtualbox, following this guide. So, I did, from master: gsamaras@gsamaras:/home/hadoopuser/hadoop/sbin$ sudo ./...
4
votes
2answers
3k views

Parallel vs Distributed vs Traditional File system

I am trying to understand the differences between these three file system at a very basic level. Distributed FS: HDFS Parallel FS : Lustre Traditional FS : ext4/ext3/ NTFS/FAT etc. I want to ...
0
votes
1answer
70 views

GNU\Linux clustreing , Which level? Which application? [closed]

I need to start GNU* clustering, But I have problem, Which level: DB level? (replication) file system? (distributed) process level ? (such as intel fortran for civilization softwares) new process ? (...
1
vote
0answers
443 views

How do I choose the right distributed file system software for my Minecraft server? [closed]

I run a popular Minecraft server, and I plan to setup a hyperscale infrastructure that has the ability to scale more than what it can do right now. I currently have 3 dedicated servers with E3-1270V3,...
1
vote
0answers
2k views

clvm (cman) has problems with dlm

I am trying to create a volume group which is accessible on two servers with clvm. I read about it and it looks like it is most easily to do this with cman. But after hours of testing I cannot achieve ...
2
votes
1answer
156 views

Shared home directories with local duplication

I have a couple Linux computers which are all in the same network. Currently, I use rsync to copy my dotfiles and the like to each machine every couple of days from the master computer. Ideally, I ...
4
votes
2answers
5k views

Recommendations for replacing a GFS cluster?

I have a couple of CentOS GFS-clusters (GFS as in Global File System) using a shared disk in a Fibre Channel SAN. They are mature now, and the time has come to start planning for their replacement. ...
3
votes
2answers
254 views

Peer to peer~ish LAN storage

I have a distributed application that consists in a main CMS server where "human" users can upload videos, pictures (media content, basically) and a bunch of "players" that play those videos or ...
1
vote
3answers
421 views

Why is the Sun NFS (Network File System) the choice of filesystem for many distributed filesystems out there?

Apparently some of my peers were talking about it today, and I was wondering what was so special about this file system that makes it the choice behind a lot of distributed file systems, as opposed to ...
4
votes
2answers
840 views

raid 1/LVM at the level of directories (aka mknodding a directory)

I just experienced data loss, so I am interested in some form of data duplication. I was thinking of mdadm and companions to raid 1 through software. However, I just want a given, not too big ...
3
votes
2answers
3k views

Virtualbox, mounting guest directory on host computer

Is there a way to mount a directory residing on my VB guest (linux) on my host (linux)? I know I can do it the other way around with the shared folders feature on Virtualbox, but is there a way to do ...
13
votes
3answers
7k views

Small Distributed Computing Cluster

I'm a high school student trying to build a linux cluster for a project (I have a bunch of decent computers slated for re-image this summer, so the tech department basically says as long as I don't ...
9
votes
3answers
501 views

What are you using instead of DCE Distributed File System?

What are you using instead of DCE Distributed File System? How does it compare? Or are you still using it? Note that DCE/DFS is not Microsoft Distributed File System