Ceph on C&CZ News

CephFS retired

Miek Gieben — Mon, 15 Apr 2024 10:05:14 +0200

After the storage downtime of CephFS in our Ceph cluster, we decided together with the users of this service to stop offering CephFS shares through SMB and NFS.

All data has been copied out of CephFS.

We have ended the CephFS service. We will only use the Ceph cluster to store our backups, using the S3 API.

Ceph storage interruption

Simon Oosthoek — Mon, 24 Oct 2022 00:00:00 +0200

Just before 23:09 quite a lot of ceph storage nodes became unreachable. This seems to be due to one of the redundant links between two datacenter locations failing for about 4 seconds. This triggered a whole slew of ceph osd processes being killed off and not starting again. A generic configuration change made for all our servers generated an extra interface, which confused some of the osd processes (depending on interface ordering) when starting up. We are reasonably confident we can avoid this from happening in the future.

Ceph problem

Wed, 24 Mar 2021 19:00:00 +0100

During a routine upgrade of ceph, a bug in the latest version manifested itself and made the ceph manager unreachable. After aborting the upgrade and with help from the ceph-users mailinglist, everything became available again using a workaround.