New answers tagged

0

Found this post to be an excellent analysis of requirements for advanced distributed file system use cases. Looking for the ultimate distributed filesystem: http://roland.entierement.nu/blog/2012/01/15/looking-for-the-ultimate-distributed-filesystem.html Example Confidentiality: Tahoe wins, hands down. Neither network sniffers nor storage nodes can ...


0

As cas said, I could write my own tool, so here it is (not polished at all, but it works.): Client side (i.e., the GPU node) gpu_monitoring.sh (assumes that the IP of the server that serves the monitoring webpage is 128.52.200.39) while true; do nvidia-smi --query-gpu=utilization.gpu,utilization.memory,memory.total,memory.free,memory.used ...


1

You can use the ganglia monitoring software (free of charge, open source). It has number of user-contributed Gmond Python DSO metric modules, including a GPU Nvidia module (/ganglia/gmond_python_modules/gpu/nvidia/). Its architecture is typical for a cluster monitoring software: (source of the image) It's straightforward to install (~ 30 minutes ...


1

munin has at least one plugin for monitoring nvidia GPUs (which uses the nvidia-smi utility to gather its data). You could setup a munin server (perhaps on one of the GPU servers, or on the head node of your cluster), and then install the munin-node client and the nvidia plugin (plus whatever other plugins you might be interested in) on each of your GPU ...


2

If your goal is to just stop the resource from running on any nodes in a cluster then you'd want to disable that resource using: pcs resource disable ClusterIP-01 Your command sudo pcs cluster stop --all would be shutting down the cluster itself (and any resources controlled by that cluster). Managing Cluster Resources



Top 50 recent answers are included