Is there a way to change the subnet ("cluster network") used for a Ceph cluster without having to basically rebuild it from scratch? The Ceph cluster lives on the same machines that make up a PVE HA cluster. The PVE cluster is also the client to the Ceph cluster.
Here's the situation. My Ceph configuration, that is
/etc/pve/ceph.conf, looks roughly like this:
[global] cluster network = 192.168.1.0/24 public network = 192.168.1.0/24 ; ... some more stanzas [mon.0] host = pve1 mon addr = 192.168.1.1:6789 [mon.1] host = pve2 mon addr = 192.168.1.2:6789
Now I'd like to move the whole Ceph cluster from 192.168.1.0/24 to 192.168.2.0/24. How would I go about that?
I realize that I should stop any clients using the Ceph cluster. No big deal. That can be done. However, the configuration for Ceph lives on the
/etc/pve. So all of the Ceph cluster members share the exact same configuration. This, it seems to me, introduces a possible race condition.
Will it be sufficient to keep
pmxcfs running and stopping any Ceph-related services, then make the change to
/etc/pve/cep.conf and then start the Ceph-related services again?
NB: it's intentional that cluster and public network are identical.