RabbitMQ Cluster

[Schnitzel]

No description provided.

[twardnw]

http://www.rabbitmq.com/clustering.html
https://github.com/rabbitmq/rabbitmq-peer-discovery-k8s
https://github.com/jharting/openshift-rabbitmq-cluster/blob/master/rabbitmq-cluster-template.yaml#L25

[Schnitzel]

looks like that somethow doesnt work:

2019-02-28 16:25:57.916 [info] <0.229.0> Memory high watermark set to 38607 MiB (40482578432 bytes) of 96517 MiB (101206446080 bytes) total
--
  | 2019-02-28 16:25:57.939 [info] <0.231.0> Enabling free disk space monitoring
  | 2019-02-28 16:25:57.939 [info] <0.231.0> Disk free limit set to 50MB
  | 2019-02-28 16:25:57.954 [info] <0.234.0> Limiting to approx 1048476 file handles (943626 sockets)
  | 2019-02-28 16:25:57.955 [info] <0.235.0> FHC read buffering:  OFF
  | 2019-02-28 16:25:57.955 [info] <0.235.0> FHC write buffering: ON
  | 2019-02-28 16:25:57.959 [info] <0.221.0> Node database directory at /var/lib/rabbitmq/mnesia/[email protected] is empty. Assuming we need to join an existing cluster or initialise from scratch...
  | 2019-02-28 16:25:57.959 [info] <0.221.0> Configured peer discovery backend: rabbit_peer_discovery_k8s
  | 2019-02-28 16:25:57.959 [info] <0.221.0> Will try to lock with peer discovery backend rabbit_peer_discovery_k8s
  | 2019-02-28 16:25:57.959 [info] <0.221.0> Peer discovery backend does not support locking, falling back to randomized delay
  | 2019-02-28 16:25:57.959 [info] <0.221.0> Peer discovery backend rabbit_peer_discovery_k8s does not support registration, skipping randomized startup delay.
  | 2019-02-28 16:25:58.001 [error] <0.220.0> CRASH REPORT Process <0.220.0> with 0 neighbours exited with reason: {{badkey,<<"hostname">>},[{maps,get,[<<"hostname">>,#{<<"ip">> => <<"10.1.8.34">>,<<"nodeName">> => <<"node2.ch1.amazee.io">>,<<"targetRef">> => #{<<"kind">> => <<"Pod">>,<<"name">> => <<"rabbitmq-49-rp9dt">>,<<"namespace">> => <<"lagoon-master">>,<<"resourceVersion">> => <<"181443204">>,<<"uid">> => <<"2948f19b-3a1e-11e9-8ec5-fa163e70e690">>}}],[]},{rabbit_peer_discovery_k8s,get_address,1,[{file,"src/rabbit_peer_discovery_k8s.erl"},{line,172}]},{rabbit_peer_discovery_k8s,'-extract_node_list/1-lc$^1/1-1-',...},...]} in application_master:init/4 line 138
  | 2019-02-28 16:25:58.002 [info] <0.43.0> Application rabbit exited with reason: {{badkey,<<"hostname">>},[{maps,get,[<<"hostname">>,#{<<"ip">> => <<"10.1.8.34">>,<<"nodeName">> => <<"node2.ch1.amazee.io">>,<<"targetRef">> => #{<<"kind">> => <<"Pod">>,<<"name">> => <<"rabbitmq-49-rp9dt">>,<<"namespace">> => <<"lagoon-master">>,<<"resourceVersion">> => <<"181443204">>,<<"uid">> => <<"2948f19b-3a1e-11e9-8ec5-fa163e70e690">>}}],[]},{rabbit_peer_discovery_k8s,get_address,1,[{file,"src/rabbit_peer_discovery_k8s.erl"},{line,172}]},{rabbit_peer_discovery_k8s,'-extract_node_list/1-lc$^1/1-1-',...},...]}
  | {"Kernel pid terminated",application_controller,"{application_start_failure,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{{badkey,<<\"hostname\">>},[{maps,get,[<<\"hostname\">>,#{<<\"ip\">> => <<\"10.1.8.34\">>,<<\"nodeName\">> => <<\"node2.ch1.amazee.io\">>,<<\"targetRef\">> => #{<<\"kind\">> => <<\"Pod\">>,<<\"name\">> => <<\"rabbitmq-49-rp9dt\">>,<<\"namespace\">> => <<\"lagoon-master\">>,<<\"resourceVersion\">> => <<\"181443204\">>,<<\"uid\">> => <<\"2948f19b-3a1e-11e9-8ec5-fa163e70e690\">>}}],[]},{rabbit_peer_discovery_k8s,get_address,1,[{file,\"src/rabbit_peer_discovery_k8s.erl\"},{line,172}]},{rabbit_peer_discovery_k8s,'-extract_node_list/1-lc$^1/1-1-',1,[{file,\"src/rabbit_peer_discovery_k8s.erl\"},{line,152}]},{rabbit_peer_discovery_k8s,'-extract_node_list/1-lc$^0/1-0-',1,[{file,\"src/rabbit_peer_discovery_k8s.erl\"},{line,152}]},{rabbit_peer_discovery_k8s,extract_node_list,1,[{file,\"src/rabbit_peer_discovery_k8s.erl\"},{line,152}]},{rabbit_peer_discovery_k8s,list_nodes,0,[{file,\"src/rabbit_peer_discovery_k8s.erl\"},{line,57}]},{rabbit_peer_discovery,discover_cluster_nodes,0,[{file,\"src/rabbit_peer_discovery.erl\"},{line,114}]},{rabbit_mnesia,init_from_config,0,[{file,\"src/rabbit_mnesia.erl\"},{line,164}]}]}}}}}"}
  | Kernel pid terminated (application_controller) ({application_start_failure,rabbit,{bad_return,{{rabbit,start,[normal,[]]},{'EXIT',{{badkey,<<"hostname">>},[{maps,get,[<<"hostname">>,#{<<"ip">> => <<"1
  |  
  | Crash dump is being written to: /var/log/rabbitmq/erl_crash.dump...done