Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consul cluster fails to start after a restart due to /etc/consul.d/server_metadata.json: invalid config key last_seen_unix #21364

Open
elgatopanzon opened this issue Jun 25, 2024 · 0 comments

Comments

@elgatopanzon
Copy link

Overview of the Issue

After deploying a 3 node consul cluster successfully, Consul writes out to the file /etc/consul.d/server_metadata.json and then complains about the key index last_seen_unix after restarting/reloading Consul. The servers in the cluster fail to start up until this file is removed.

Contents of the file:

{"last_seen_unix":1719273473}

Reproduction Steps

Steps to reproduce this issue:

  1. Create a cluster with 3 server nodes, 0 clients
  2. Stop Consul
  3. Start Consul
  4. They will not start, each one logging the same error

Operating system and Environment details

Debian 12, Consul 1.18.2 (not running 1.19.0 due to DNS bug with Nomad)

Log Fragments

Jun 24 18:31:43 mynode systemd[1]: Started consul.service - "HashiCorp Consul - A service mesh solution".
Jun 24 18:31:43 mynode consul[3835]: ==> failed to parse /etc/consul.d/server_metadata.json: 1 error occurred:
Jun 24 18:31:43 mynode consul[3835]:         * invalid config key last_seen_unix
Jun 24 18:31:43 mynode systemd[1]: consul.service: Main process exited, code=exited, status=1/FAILURE
Jun 24 18:31:43 mynode systemd[1]: consul.service: Failed with result 'exit-code'.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant