I was able to upgrade ruby versions. These are the commands I had to run. I will spare you the error messages and detours.
These are essentially the commands I ran, roughly in that order but it got a bit confusing somewhere in the middle.
I decided not to run
rbenv init, the only mandatory thing it does is add the shims folder to the PATH. So I just did that myself.