Upgrade rabbitmq 3.9.27 (erlang 24.2.1) => Rabbitmq 4

[johaninho78]

Community Support Policy

• I have read RabbitMQ's Community Support Policy
• I run RabbitMQ 4.x, the only series currently covered by community support
• I promise to provide all relevant information (versions, logs from all nodes, rabbitmq-diagnostics output, detailed reproduction steps)

RabbitMQ version used

other (please specify)

Erlang version used

27.2.x

Operating system (distribution) used

ubuntu 22.04

How is RabbitMQ deployed?

Debian package

rabbitmq-diagnostics status output

up

Logs from node 1 (with sensitive values edited out)

No errors

Logs from node 2 (if applicable, with sensitive values edited out)

No errors

Logs from node 3 (if applicable, with sensitive values edited out)

No errors

rabbitmq.conf

ras

Steps to deploy RabbitMQ cluster

ras

Steps to reproduce the behavior in question

How do I upgrade from version 3.9 to Verison 4?

advanced.config

No response

Application code

# PASTE CODE HERE, BETWEEN BACKTICKS

Kubernetes deployment file

# Relevant parts of K8S deployment that demonstrate how RabbitMQ is deployed
# PASTE YAML HERE, BETWEEN BACKTICKS

What problem are you trying to solve?

In the documentation it is indicated to do a progressive update, i.e. to go from version 3.9 to 3.10 then to 3.11 then to 3.12 then to 3.13

[mkuratczyk]

You asked how to perform the upgrade and then quoted the documentation which answers this questions... What's not clear?

[johaninho78]

I can upgrade from 3.9 to 3.10. but when I upgrade from 3.10 to 3.11 I lose all my configuration as well as the cluster

[johaninho78]

Here is my order list :

rabbitmq-upgrade drain
sudo apt update
sudo apt install logrotate
sudo dpkg -i rabbitmq-server_3.10.0-1_all.deb
dpkg -l | grep logrotate
rabbitmq-upgrade revive
rabbitmqctl status
rabbitmqctl version
sudo systemctl start rabbitmq-server
rabbitmqctl status
rabbitmqctl enable_feature_flag all
rabbitmq-upgrade drain
sudo apt-get purge erlang*
sudo apt-get remove --purge erlang
sudo dpkg -i esl-erlang_25.1-1ubuntufocal_amd64.deb
sudo apt-get install -f
sudo dpkg -i rabbitmq-server_3.11.0-1_all.deb
sudo systemctl start rabbitmq-server
rabbitmqctl status
rabbitmq-upgrade revive

[mkuratczyk]

We don't know what "I lose all my configuration as well as the cluster" really means. The steps overall look ok, although it's highly recommended to upgrade to the latest patch release in a given minor, rather than using .0 version.
Also, if it's a development environment or just an environment where you don't care about the contents of your RabbitMQ, it's easier to simply uninstall the old version, delete the data folder and install the latest directly, as described in: https://www.rabbitmq.com/docs/upgrade#upgrading-dev-environments

We are not going to handhold you throughput multiple upgrades from one unsupported version to another. If you have a specific question/error, we might be able to answer, but just posting a bunch of commands with zero information about what is going on is not going to cut it.

[johaninho78]

If I uninstall version 9.3 and do a new installation of version 4. Will I lose data? the old messages? I'm in a clustered production environment

[mkuratczyk]

Yes, it's clearly written in the docs I linked to.

[lukebakken]

https://www.rabbitmq.com/docs/rolling-upgrade

[lukebakken]

@johaninho78 - you really should just start a new cluster using RMQ 4.0.8 and use this method to "upgrade" - https://www.rabbitmq.com/docs/blue-green-upgrade

[johaninho78]

I don't really understand what to do in the documentation. Do you need to create a cluster on new servers? Or can I do it from my two existing servers ?

[michaelklishin]

@johaninho78 you need to do a series of incremental upgrades. 3.9.27 to the latest 3.10.x, then to the latest 3.11.x, then to the latest 3.12.x, then to 3.13.7, then to 4.0.8.

Or Blue-Green migrate your cluster.

Or uninstall the version you have, wipe your node's data directory (if this is a development or test environment), install 4.0.8 and that's it.

We will not hand hold you through each individual step, you are not a paying user and you are not a contributor, and the guide are specific enough for most people.

[johaninho78]

Sorry but in the blue green documenation there are no details like for After deploying a brand new "green" cluster. How do I deploy a new instance?

[johaninho78]

If I understand correctly, for blue green mode you have to install two new servers and install a cluster in 4.0.8 ?

[mkuratczyk]

blue-green is a strategy to migrate your clients from one RabbitMQ cluster to another, completely separate one. It's not an upgrade of RabbitMQ as such, because the new cluster is completely new (a separate, fresh, deployment). Therefore, upgrade constraints don't apply in this case - you just have one cluster with version X and another cluster with version Y and you switch the applications over.

[johaninho78]

If I understood correctly, here are the steps I need to do:
create a cluster on two new servers rabbitmq v4.0.8
on the green cluster :
rabbitmq-plugins enable rabbitmq_federation rabbitmq_federation_management
rabbitmqctl set_parameter federation-upstream blue_cluster_upstream '{"uri": "amqp://user:password@hostname:5672"}'
rabbitmqctl set_policy --apply-to queues blue-green-migration ".*" \ '{"federation-upstream":"blue"}'

Can you tell me if I missed a step?

[michaelklishin]

The guide has one section per step. Please take it from here.

It's a technique that has been used and recommended since at least 2018, including recorded YouTube videos by VMware staff and so on.