[bitnami/rabbitmq] Application does not start

[saucompeng]

Name and Version

[bitnami/rabbitmq]

What architecture are you using?

None

What steps will reproduce the bug?

I am using kubernetes, Rabbitmq does not start.

Are you using any custom parameters or values?

No response

What is the expected behavior?

No response

What do you see instead?

rabbitmq 11:35:35.66 INFO  ==> 
2024-05-12T11:35:35.732718767Z rabbitmq 11:35:35.72 INFO  ==> Welcome to the Bitnami rabbitmq container
rabbitmq 11:35:35.73 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
2024-05-12T11:35:35.743641503Z rabbitmq 11:35:35.74 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
2024-05-12T11:35:35.749007506Z rabbitmq 11:35:35.74 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
2024-05-12T11:35:35.752633740Z rabbitmq 11:35:35.75 INFO  ==> 
2024-05-12T11:35:35.832908534Z rabbitmq 11:35:35.83 INFO  ==> ** Starting RabbitMQ setup **
2024-05-12T11:35:35.943513865Z rabbitmq 11:35:35.93 INFO  ==> Validating settings in RABBITMQ_* env vars..
2024-05-12T11:35:36.259695948Z rabbitmq 11:35:36.25 INFO  ==> Initializing RabbitMQ...
2024-05-12T11:35:36.434190328Z rabbitmq 11:35:36.43 DEBUG ==> Creating environment file...
rabbitmq 11:35:36.46 DEBUG ==> Creating enabled_plugins file...
2024-05-12T11:35:36.558196242Z rabbitmq 11:35:36.55 DEBUG ==> Creating Erlang cookie...
2024-05-12T11:35:36.653475063Z rabbitmq 11:35:36.64 DEBUG ==> Ensuring expected directories/files exist...
rabbitmq 11:35:36.84 INFO  ==> Starting RabbitMQ in background...
=INFO REPORT==== 12-May-2024::11:35:48.638991 ===
    alarm_handler: {set,{system_memory_high_watermark,[]}}
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error: operation wait on node rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local timed out. Timeout value used: 5000
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error: operation wait on node rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local timed out. Timeout value used: 5000
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error: operation wait on node rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local timed out. Timeout value used: 5000
2024-05-12 11:37:00.785353+00:00 [error] <0.156.0> 
2024-05-12T11:37:01.060781884Z 2024-05-12 11:37:00.785353+00:00 [error] <0.156.0> BOOT FAILED
2024-05-12T11:37:01.060793584Z 2024-05-12 11:37:00.785353+00:00 [error] <0.156.0> ===========
2024-05-12T11:37:01.060808900Z 2024-05-12 11:37:00.785353+00:00 [error] <0.156.0> ERROR: epmd error for host myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local: nxdomain (non-existing domain)
2024-05-12T11:37:01.060818969Z 2024-05-12 11:37:00.785353+00:00 [error] <0.156.0> 
2024-05-12T11:37:01.060884157Z 
2024-05-12T11:37:01.060895265Z BOOT FAILED
2024-05-12T11:37:01.060903732Z ===========
ERROR: epmd error for host myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local: nxdomain (non-existing domain)

2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>     supervisor: {local,rabbit_prelaunch_sup}
2024-05-12T11:37:02.089402349Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>     errorContext: start_error
2024-05-12T11:37:02.089420553Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>     reason: {epmd_error,"myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local",
2024-05-12T11:37:02.089434920Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                         nxdomain}
2024-05-12T11:37:02.089449207Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>     offender: [{pid,undefined},
2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                {id,prelaunch},
2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                {mfargs,{rabbit_prelaunch,run_prelaunch_first_phase,[]}},
2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                {restart_type,transient},
2024-05-12T11:37:02.089516694Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                {significant,false},
2024-05-12T11:37:02.089530824Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                {shutdown,5000},
2024-05-12T11:37:02.089544970Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0>                {child_type,worker}]
2024-05-12T11:37:02.089560332Z 2024-05-12 11:37:02.061483+00:00 [error] <0.156.0> 
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>   crasher:
2024-05-12T11:37:02.102671008Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     initial call: application_master:init/4
2024-05-12T11:37:02.102689042Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     pid: <0.154.0>
2024-05-12T11:37:02.102704380Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     registered_name: []
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     exception exit: {{shutdown,
2024-05-12T11:37:02.102733790Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>                          {failed_to_start_child,prelaunch,
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>                              {epmd_error,
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>                                  "myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local",
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>                                  nxdomain}}},
2024-05-12T11:37:02.102793796Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>                      {rabbit_prelaunch_app,start,[normal,[]]}}
2024-05-12T11:37:02.102809074Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>       in function  application_master:init/4 (application_master.erl, line 142)
2024-05-12T11:37:02.102823327Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     ancestors: [<0.153.0>]
2024-05-12T11:37:02.102838131Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     message_queue_len: 1
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     messages: [{'EXIT',<0.155.0>,normal}]
2024-05-12T11:37:02.102866657Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     links: [<0.153.0>,<0.44.0>]
2024-05-12T11:37:02.102880743Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     dictionary: []
2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     trap_exit: true
2024-05-12T11:37:02.102965969Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     status: running
2024-05-12T11:37:02.102980098Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     heap_size: 610
2024-05-12T11:37:02.102994315Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     stack_size: 28
2024-05-12T11:37:02.103008671Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>     reductions: 199
2024-05-12T11:37:02.103081028Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0>   neighbours:
2024-05-12T11:37:02.103096065Z 2024-05-12 11:37:02.062702+00:00 [error] <0.154.0> 
2024-05-12T11:37:02.103117994Z 2024-05-12 11:37:02.092303+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: {{shutdown,{failed_to_start_child,prelaunch,{epmd_error,"myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local",nxdomain}}},{rabbit_prelaunch_app,start,[normal,[]]}}
2024-05-12 11:37:02.135266+00:00 [notice] <0.86.0>     alarm_handler: {clear,system_memory_high_watermark}
Kernel pid terminated (application_controller) ("{application_start_failure,rabbitmq_prelaunch,{{shutdown,{failed_to_start_child,prelaunch,{epmd_error,\"myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local\",nxdomain}}},{rabbit_prelaunch_app,start,[normal,[]]}}}")
2024-05-12T11:37:03.738947932Z 
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Crash dump is being written to: erl_crash.dump...Error:
2024-05-12T11:37:18.727997146Z process_not_running
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error:
2024-05-12T11:37:39.557698525Z process_not_running
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error:
2024-05-12T11:38:01.378872305Z process_not_running
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error:
2024-05-12T11:38:19.374868030Z process_not_running
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error:
2024-05-12T11:38:39.031002698Z process_not_running
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error:
2024-05-12T11:38:58.856485039Z process_not_running
Waiting for erlang distribution on node 'rabbit@myrmq-rabbitmq-0.myrmq-rabbitmq-headless.rabbit.svc.cluster.local' while OS process '54' is running
Error:
2024-05-12T11:39:17.245263973Z process_not_running
rabbitmq 11:39:27.47 ERROR ==> Couldn't start RabbitMQ in background.

Additional information

No response

[javsalgar]

Hi!

Could you add more details on your Kubernetes platform? Also, are you modifying any default values? Could there also be issues with domain resolution? Maybe there's an issue with the DNS resolver

[saucompeng]

I have changed cluster.local to k8s.cluster.local at the helm file, And problem fixed.