Skip to content

Osd fix#5

Open
GMW99 wants to merge 15 commits intoDiamondLightSource:masterfrom
rosalindfranklininstitute:osd-fix
Open

Osd fix#5
GMW99 wants to merge 15 commits intoDiamondLightSource:masterfrom
rosalindfranklininstitute:osd-fix

Conversation

@GMW99
Copy link
Contributor

@GMW99 GMW99 commented Jun 26, 2022

Fixing OSD creation issues when using pvcreate.

= and others added 15 commits April 27, 2022 11:25
The warning comes as the PG's status is being checked, however is due to the recent creation of the MGR it doesn't effect the creation of the pool. Therefore the error message is passed to /dev/null
This has been removed as the pg amount is already calculated before creation.

Co-authored-by: = <=>
* Base file

This file will be for creating meta data server for cephfs

* Create MDS

For a ceph filesystem a Meta Data Server (MDS)  is required this creates a deamon and the pools required for the file system

* Mount the FS

This file creates the shared file system by mounting it the home directory under /mycephfs

* Removing MDS related services

This now removes the mds files and crash files, this is so the system is clean after running

* Unmount cephfs

This script unmounts cephfs

* Added fs option

fs option allows the user to create a file system that is mounted across all hosts

* Updated helpmsg

This now explains what -fs does

* Added removal of the filesystem

* Added wait for the MDS to be active

This has been added since the mount of the filesystem
can happen before the MDS is ready thus  a wait lock is required.

* Allow user to specifiy filesystem location

This now allows the user to mount a
filesystem at anylocation they specifiy. Which means multiple
DisTRaC instances could be mounted at one time.

* Updated helpmsg

helpmsg updated in lines with the filesystem change

* Passing filesystem agurgment

This allows the user to specifiy the filesystem mount point.
for creation or removal

* Remove enviroment varible requirement

Within HPC clusters the $HOSTNAME is not always set properly thus using
the hostname function is more appropriate.

* Removal of relative pathing and mkdir errors

Relative pathing stops DisTRaC from being placed in /bin
and mkdir errors do not need to be repeated.

* Passing distrac-config-log.sh instead of log.conf

This allows the config method to go in /bin aswell.

* Updated sudoers_file

This now allows members of the distrac group to run
distrac with nopasswd required, as required.

* Updated README

README updated inline with filesystem changes.

Co-authored-by: = <=>
* Base file

This file will be for creating meta data server for cephfs

* Create MDS

For a ceph filesystem a Meta Data Server (MDS)  is required this creates a deamon and the pools required for the file system

* Mount the FS

This file creates the shared file system by mounting it the home directory under /mycephfs

* Removing MDS related services

This now removes the mds files and crash files, this is so the system is clean after running

* Unmount cephfs

This script unmounts cephfs

* Added fs option

fs option allows the user to create a file system that is mounted across all hosts

* Updated helpmsg

This now explains what -fs does

* Added removal of the filesystem

* Added wait for the MDS to be active

This has been added since the mount of the filesystem
can happen before the MDS is ready thus  a wait lock is required.

* Allow user to specifiy filesystem location

This now allows the user to mount a
filesystem at anylocation they specifiy. Which means multiple
DisTRaC instances could be mounted at one time.

* Updated helpmsg

helpmsg updated in lines with the filesystem change

* Passing filesystem agurgment

This allows the user to specifiy the filesystem mount point.
for creation or removal

* Remove enviroment varible requirement

Within HPC clusters the $HOSTNAME is not always set properly thus using
the hostname function is more appropriate.

* Removal of relative pathing and mkdir errors

Relative pathing stops DisTRaC from being placed in /bin
and mkdir errors do not need to be repeated.

* Passing distrac-config-log.sh instead of log.conf

This allows the config method to go in /bin aswell.

* Updated sudoers_file

This now allows members of the distrac group to run
distrac with nopasswd required, as required.

* Updated README

README updated inline with filesystem changes.

* Adding escape characters to sudoers file

Co-authored-by: = <=>
In new versions of Ceph a pool is created at the start, this is not always created staight away however it has a pool size of 1, so is PGs is 0 the value is changed to 1.

Co-authored-by: = <=>
* Set PGs to 1 if 0

In new versions of Ceph a pool is created at the start, this is not always created straight away however it has a pool size of 1, so is PGs is 0 the value is changed to 1.


Co-authored-by: = <=>
When `ceph pg stat` states that all pgs are allocated, this was not the case. Therefore, the command has switched to `ceph -s` as this gives the most accurate representation of the cluster state.

Co-authored-by: = <=>
* OSD deployment speeds up

`ceph-volume lvm create` runs in the background, prepare and activate. However, activate can be used to start all OSDs once prepared, which is faster than sequentially using create. Thus the change.

* remove logging.

Co-authored-by: = <=>
When using pvcreate, it can sometimes lead to OSD's not being created as they are set to not allocatable. Removing this command make sure this doesn't happen.
This is not required as the pv are removed when the module is unloaded.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant