I just want to create a bookmark for this amazing tool that did a simple task of telling what version to upgrade to reach latest version of Gitlab. I often miss those steps and cause problem:

https://gitlab-com.gitlab.io/support/toolbox/upgrade-path/

Just enter the Current Version of your gitlab, select OS and it give exact command to copy paste for upgrade.