Questions tagged [distributed-filesystem]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0
votes
0answers
18 views

Check if a network mount is the same across different machines

Lets say I have a machine which exports an nfs directory /mnt/sdb1. Two other machines mount it. So now three machines are able to access machine 1s /mnt/sdb1. Is there a way to check if it is the ...
-3
votes
1answer
165 views

How can I create or access a remote file shared by a distributed filesystem as if it were local?

In general, I would like to run local programs on remote files provided to me via a distributed file system (e.g. samba, NFS or whichever you recommend), and I want to access the remote files in a ...
2
votes
2answers
334 views

Does Opensolaris offer distributed ZFS filesystems

I haven't had any luck getting a confirmed yes or no to this question. I'd like to run ZFS as a distributed file system (like Gluster or CEPH). OpenZFS and ZFS on Linux does not (yet) have file ...
0
votes
1answer
229 views

Adding entries to fstab results in emergency mode

This is my local system configuration. NAME="elementary OS" VERSION="5.0 Juno" I am mounting my remote server's file system on a subdirectory by this command, which is working fine. sudo sshfs -o ...
2
votes
1answer
1k views

Unable to mount gfs2 file system on Debian Stretch, probable dlm mis-config?

I am experimenting with gfs2 on Debian Stretch, and having some difficulties. I am a reasonably experienced Linux admin, but new to shared-disk and parallel file systems. My immediate project is to ...
3
votes
0answers
150 views

Is it crazy to consider keeping my home directory on OpenAFS?

I am a sysadmin by trade, and I do what I do at work at home as well for fun. I have a Gentoo Linux laptop, Raspberry Pis running Raspian, a Gentoo server, ARM devices running Debian and have various ...
2
votes
0answers
717 views

Meta Data Server (MDS) cluster for pnfs

TL;DR pNFS seems a great method for multiple concurrent access to centralised shared storage, but it has a problem: the single NFS server providing NFS metadata (meta data server, MDS) is a single ...
1
vote
2answers
2k views

ZFS read-only mount on Linux + simultaneous read-write mount on Solaris

We have to regularly copy quite huge files from Solaris to Linux (using network). It currently takes almost half a day for one file. The files in Solaris are on a ZFS filesystem. So I thought what a ...
0
votes
1answer
2k views

How to move a directory?

I have a directory in HDFS with subdirectories that contain part-xxxxx files, created by Spark. I want to move that directory (and everything inside it) into a new directory. How to? My attempt: [...
1
vote
2answers
1k views

set up NFS two way syncronization [closed]

I have two servers that I want to "share" the home folder of, such that when I make changes on Server A they appear on Server B and when I make changes on Server B they appear on Server A. Right now ...
1
vote
1answer
100 views

Where would be the best location to mount a distributed filesystem? [closed]

We are looking at mounting a distributed file system on our RHEL machines and we think that the best location to mount the share is at /var/dfs. Where would the best location be to mount this share?
1
vote
1answer
742 views

distributed file system that works well with multiple small files [closed]

Hi my use case is quite specific. I have 20 Windows 7 machines constantly creating files in my storage; around 98% of these files are 2.1 MB. On average we create 24 million files every 3 days, and ...
3
votes
2answers
379 views

“Junctioned” symbolic links [duplicate]

Does Linux have the capability to use "junctioned" symbolic links? I'm not sure if this is an actual term or not, so let me explain the concept. I have a git repository containing all my ...
2
votes
1answer
1k views

Validate start-dfs.sh

I am trying to setup a Hadoop cluster, where master is my laptop and slave is the virtualbox, following this guide. So, I did, from master: gsamaras@gsamaras:/home/hadoopuser/hadoop/sbin$ sudo ./...
5
votes
2answers
5k views

Parallel vs Distributed vs Traditional File system

I am trying to understand the differences between these three file system at a very basic level. Distributed FS: HDFS Parallel FS : Lustre Traditional FS : ext4/ext3/ NTFS/FAT etc. I want to ...
0
votes
1answer
77 views

GNU\Linux clustreing , Which level? Which application? [closed]

I need to start GNU* clustering, But I have problem, Which level: DB level? (replication) file system? (distributed) process level ? (such as intel fortran for civilization softwares) new process ? (...
1
vote
0answers
2k views

clvm (cman) has problems with dlm

I am trying to create a volume group which is accessible on two servers with clvm. I read about it and it looks like it is most easily to do this with cman. But after hours of testing I cannot achieve ...
2
votes
1answer
175 views

Shared home directories with local duplication

I have a couple Linux computers which are all in the same network. Currently, I use rsync to copy my dotfiles and the like to each machine every couple of days from the master computer. Ideally, I ...
4
votes
2answers
6k views

Recommendations for replacing a GFS cluster?

I have a couple of CentOS GFS-clusters (GFS as in Global File System) using a shared disk in a Fibre Channel SAN. They are mature now, and the time has come to start planning for their replacement. ...
3
votes
2answers
271 views

Peer to peer~ish LAN storage

I have a distributed application that consists in a main CMS server where "human" users can upload videos, pictures (media content, basically) and a bunch of "players" that play those videos or ...
1
vote
3answers
451 views

Why is the Sun NFS (Network File System) the choice of filesystem for many distributed filesystems out there?

Apparently some of my peers were talking about it today, and I was wondering what was so special about this file system that makes it the choice behind a lot of distributed file systems, as opposed to ...
5
votes
2answers
1k views

raid 1/LVM at the level of directories (aka mknodding a directory)

I just experienced data loss, so I am interested in some form of data duplication. I was thinking of mdadm and companions to raid 1 through software. However, I just want a given, not too big ...
3
votes
2answers
3k views

Virtualbox, mounting guest directory on host computer

Is there a way to mount a directory residing on my VB guest (linux) on my host (linux)? I know I can do it the other way around with the shared folders feature on Virtualbox, but is there a way to do ...
13
votes
3answers
9k views

Small Distributed Computing Cluster

I'm a high school student trying to build a linux cluster for a project (I have a bunch of decent computers slated for re-image this summer, so the tech department basically says as long as I don't ...
10
votes
3answers
587 views

What are you using instead of DCE Distributed File System?

What are you using instead of DCE Distributed File System? How does it compare? Or are you still using it? Note that DCE/DFS is not Microsoft Distributed File System