[Feat req] Also toggle (relative) line numbers

[EricDriussi]

Hi there!

It would be useful (for me at least) to have the option to also turn off (relative) line numbers (if enabled) when turning off vim.
In my mind, if I don't want vim mode, I don't care for line numbers either.

Would you consider adding a toggle for this? Are you open to a PR that implements something like this?

[connerohnesorge]

I would be down for adding a toggle for this. Would actually kinda want it to be the default. Nice idea!