Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Setting transit/cache-config to > 0 causes terminal election/seal cycle #12064

Closed
mikegreen opened this issue Jul 13, 2021 · 1 comment
Closed

Setting transit/cache-config to > 0 causes terminal election/seal cycle #12064

mikegreen opened this issue Jul 13, 2021 · 1 comment
Labels
bug Used to indicate a potential bug cryptosec

Comments

@mikegreen
Copy link
Contributor

mikegreen commented Jul 13, 2021 •
edited

Describe the bug
A clear and concise description of what the bug is.

To Reproduce
Steps to reproduce the behavior:

  1. Vault running with integrated storage, single node is fine. But this will also render an entire cluster unusable the same manner as it won't elect a leader.
  2. $ vault secrets enable transit
    Success! Enabled the transit secrets engine at: transit/
  3. Set cache-config per https://www.vaultproject.io/api/secret/transit#configure-cache
    $ vault write transit/cache-config size=1
    WARNING! The following warnings were returned from Vault:
    * cache configurations will be applied when this backend is restarted
  4. Restart vault service
  5. Node cannot complete full startup. See bottom of issue for full log.
2021-07-13T20:44:00.394Z [ERROR] core: failed to create mount entry: path=transit/ error="failed to create cache: Must provide a positive size"
2021-07-13T20:44:00.394Z [INFO]  core: pre-seal teardown starting
2021-07-13T20:44:00.394Z [INFO]  core: stopping raft active node
2021-07-13T20:44:00.394Z [INFO]  core: stopping replication
2021-07-13T20:44:00.394Z [INFO]  core: closed sync connection
2021-07-13T20:44:00.394Z [INFO]  core: replication stopped

Expected behavior
Regardless of cache-config setting, node and cluster are stable.

Environment:

  • Vault Server Version (retrieve with vault status): 1.7.3+ent
  • Vault CLI Version (retrieve with vault version): 1.7.3+ent
  • Server Operating System/Architecture: Ubuntu 18 LTS

Vault server configuration file(s):

# Paste your Vault config here.
# Be sure to scrub any sensitive values

Additional context

Running
$ vault read transit/cache-config
shows
No value found at transit/cache-config

More log:

Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.208Z [DEBUG] core: starting cluster listeners
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.208Z [INFO]  core.cluster-listener.tcp: starting listener: listener_address=192.168.1.215:8201
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.208Z [INFO]  core.cluster-listener: serving cluster requests: cluster_listen_address=192.168.1.215:8201
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.209Z [INFO]  storage.raft: creating Raft: config="&raft.Config{ProtocolVersion:3, HeartbeatTimeout:5000000000, ElectionTimeout:5000000000, CommitTimeout:50000000, MaxAppendEntries:64, BatchApplyCh:false, ShutdownOnRemove:true, TrailingLogs:0x2800, SnapshotInterval:120000000000, SnapshotThreshold:0x2000, LeaderLeaseTimeout:2500000000, LocalID:"raft_01", NotifyCh:(chan<- bool)(0xc000da2af0), LogOutput:io.Writer(nil), LogLevel:"DEBUG", Logger:(*hclog.interceptLogger)(0xc0011f86c0), NoSnapshotRestoreOnStart:true, skipStartup:false}"
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.223Z [INFO]  storage.raft: initial configuration: index=1 servers="[{Suffrage:Voter ID:raft_01 Address:192.168.1.215:8201}]"
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.223Z [INFO]  storage.raft: entering follower state: follower="Node at 192.168.1.215:8201 [Follower]" leader=
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.223Z [INFO]  core: vault is unsealed
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.223Z [INFO]  core: entering standby mode
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.223Z [INFO]  core: unsealed with stored key
Jul 13 20:43:48 cr3yhx1 vault[38818]: 2021-07-13T20:43:48.224Z [INFO]  core: performance standby: forwarding client is nil, waiting for new leader
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.139Z [WARN]  storage.raft: heartbeat timeout reached, starting election: last-leader=
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.139Z [INFO]  storage.raft: entering candidate state: node="Node at 192.168.1.215:8201 [Candidate]" term=6
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.194Z [DEBUG] storage.raft: votes: needed=1
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.194Z [DEBUG] storage.raft: vote granted: from=raft_01 term=6 tally=1
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.194Z [INFO]  storage.raft: election won: tally=1
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.194Z [INFO]  storage.raft: entering leader state: leader="Node at 192.168.1.215:8201 [Leader]"
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.255Z [INFO]  core: acquired lock, enabling active operation
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.256Z [DEBUG] sealwrap: unwrapping entry: key=core/master
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.512Z [DEBUG] sealwrap: unwrapping entry: key=core/master
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.730Z [DEBUG] sealwrap: unwrapping entry: key=core/keyring
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.949Z [DEBUG] core: generating cluster private key
Jul 13 20:43:56 cr3yhx1 vault[38818]: 2021-07-13T20:43:56.969Z [DEBUG] core: generating local cluster certificate: host=fw-e5ed7a26-761c-cfdc-47ac-7c918de44db2
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.231Z [INFO]  core: post-unseal setup starting
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.231Z [DEBUG] core: clearing forwarding clients
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.232Z [DEBUG] core: done clearing forwarding clients
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.232Z [DEBUG] sealwrap: checking upgrades
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.232Z [DEBUG] sealwrap: unwrapping entry: key=core/keyring
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.449Z [DEBUG] sealwrap: upgrade completed successfully
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.449Z [DEBUG] core: successfully upgraded barrier config
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.449Z [INFO]  replication.wal: wal range recovered: first_wal=1 last_wal=148
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.452Z [DEBUG] replication.index.perf: restored page: page=16 size=12988 last_commit=11
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.452Z [DEBUG] replication.index.perf: restored page: page=23 size=641 last_commit=148
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.454Z [DEBUG] replication.index.perf: restored page: page=55 size=13040 last_commit=21
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.460Z [DEBUG] replication.index.perf: restored page: page=145 size=637 last_commit=2
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.461Z [DEBUG] replication.index.perf: restored page: page=162 size=639 last_commit=11
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.462Z [DEBUG] replication.index.perf: restored page: page=169 size=13002 last_commit=11
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.462Z [DEBUG] replication.index.perf: restored page: page=179 size=12987 last_commit=11
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.465Z [DEBUG] replication.index.perf: restored page: page=242 size=12991 last_commit=22
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.466Z [DEBUG] replication.index.perf: restored page: page=253 size=13035 last_commit=23
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.466Z [DEBUG] replication.index.perf: restored page: page=254 size=629 last_commit=9
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.467Z [WARN]  replication.index.perf: unexpected number of index pages found: pages_restored=10 expect=256
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.467Z [INFO]  replication.index.perf: checkpoint recovery complete
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.467Z [DEBUG] replication.index.perf: no dirty pages, using last seen index from checkpoint: last_commit=148
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.469Z [DEBUG] replication.index.local: restored page: page=34 size=628 last_commit=10
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.470Z [DEBUG] replication.index.local: restored page: page=42 size=13037 last_commit=17
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.472Z [DEBUG] replication.index.local: restored page: page=88 size=625 last_commit=12
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.474Z [DEBUG] replication.index.local: restored page: page=136 size=12994 last_commit=12
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.476Z [DEBUG] replication.index.local: restored page: page=191 size=13057 last_commit=18
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.478Z [DEBUG] replication.index.local: restored page: page=225 size=630 last_commit=5
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.478Z [DEBUG] replication.index.local: restored page: page=228 size=12992 last_commit=17
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.479Z [WARN]  replication.index.local: unexpected number of index pages found: pages_restored=7 expect=256
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.479Z [INFO]  replication.index.local: checkpoint recovery complete
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.479Z [DEBUG] replication.index.local: no dirty pages, using last seen index from checkpoint: last_commit=148
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.479Z [DEBUG] replication.wal: no logs to replay: commit_index=148 last_index=148
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.480Z [DEBUG] core: persisting feature flags
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.509Z [DEBUG] sealwrap: unwrapping entry: key=core/wrapping/jwtkey
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.710Z [DEBUG] replication.index.perf: flushed dirty pages: num_pages=1
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.724Z [INFO]  core: loaded wrapping token key
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.724Z [INFO]  core: successfully setup plugin catalog: plugin-directory=""
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.726Z [INFO]  core: successfully mounted backend: type=system path=sys/
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [INFO]  core: successfully mounted backend: type=identity path=identity/
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [ERROR] core: failed to create mount entry: path=transit/ error="failed to create cache: Must provide a positive size"
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [INFO]  core: pre-seal teardown starting
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [INFO]  core: stopping raft active node
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [INFO]  core: stopping replication
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [INFO]  core: closed sync connection
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.727Z [INFO]  core: replication stopped
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.759Z [DEBUG] replication.index.perf: saved checkpoint: num_dirty=0
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [DEBUG] replication.index.local: saved checkpoint: num_dirty=0
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [DEBUG] sealwrap: stopping upgrades
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [DEBUG] core: set storage to read-write
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [INFO]  core: pre-seal teardown complete
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [ERROR] core: post-unseal setup failed: error="failed to setup mount table"
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [DEBUG] storage.raft: starting leadership transfer: id=<nil> address=<nil>
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [INFO]  core: performance standby: forwarding client is nil, waiting for new leader
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.777Z [DEBUG] storage.raft: cannot find peer
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.778Z [DEBUG] sealwrap: unwrapping entry: key=core/leader/973bd16c-dee3-118a-6651-d1ad6b21463c
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.995Z [DEBUG] core: parsing information for new active node: active_cluster_addr=https://192.168.1.215:8201 active_redirect_addr=https://192.168.1.215:8200
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.995Z [DEBUG] core: refreshing forwarding connection
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.995Z [DEBUG] core: clearing forwarding clients
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.995Z [DEBUG] core: done clearing forwarding clients
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.995Z [DEBUG] core: done refreshing forwarding connection
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.995Z [DEBUG] core.cluster-listener: creating rpc dialer: alpn=req_fw_sb-act_v1 host=fw-e5ed7a26-761c-cfdc-47ac-7c918de44db2
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.996Z [WARN]  core.cluster-listener: no TLS config found for ALPN: ALPN=["req_fw_sb-act_v1"]
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.996Z [DEBUG] core.cluster-listener: error handshaking cluster connection: error="unsupported protocol"
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.996Z [ERROR] core: error during forwarded RPC request: error="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing remote error: tls: internal error""
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.997Z [DEBUG] core: forwarding: error sending echo request to active node: error="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing remote error: tls: internal error""
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.997Z [ERROR] core: error during forwarded RPC request: error="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing remote error: tls: internal error""
Jul 13 20:43:57 cr3yhx1 vault[38818]: 2021-07-13T20:43:57.997Z [ERROR] core: forward request error: error="error during forwarding RPC request"
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.224Z [DEBUG] core: new leader found, triggering new leader channel
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.225Z [ERROR] core: failed to elect as performance standby: error="rpc error: code = Unavailable desc = connection error: desc = "transport: Error while dialing remote error: tls: internal error""
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.822Z [INFO]  core: acquired lock, enabling active operation
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.822Z [DEBUG] sealwrap: unwrapping entry: key=core/master
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.997Z [DEBUG] core.cluster-listener: creating rpc dialer: alpn=req_fw_sb-act_v1 host=fw-e5ed7a26-761c-cfdc-47ac-7c918de44db2
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.997Z [WARN]  core.cluster-listener: no TLS config found for ALPN: ALPN=["req_fw_sb-act_v1"]
Jul 13 20:43:58 cr3yhx1 vault[38818]: 2021-07-13T20:43:58.998Z [DEBUG] core.cluster-listener: error handshaking cluster connection: error="unsupported protocol"
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.040Z [DEBUG] sealwrap: unwrapping entry: key=core/master
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.265Z [DEBUG] sealwrap: unwrapping entry: key=core/keyring
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.483Z [DEBUG] core: generating cluster private key
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.505Z [DEBUG] core: generating local cluster certificate: host=fw-0a02084a-4ddf-b591-3f57-d718e2b15b65
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.896Z [INFO]  core: post-unseal setup starting
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.896Z [DEBUG] core: clearing forwarding clients
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.896Z [DEBUG] core: forwarding: stopping heartbeating
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.896Z [DEBUG] core: done clearing forwarding clients
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.896Z [DEBUG] sealwrap: checking upgrades
Jul 13 20:43:59 cr3yhx1 vault[38818]: 2021-07-13T20:43:59.896Z [DEBUG] sealwrap: unwrapping entry: key=core/keyring
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.114Z [DEBUG] sealwrap: upgrade completed successfully
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.114Z [DEBUG] core: successfully upgraded barrier config
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.115Z [INFO]  replication.wal: wal range recovered: first_wal=1 last_wal=149
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.116Z [DEBUG] replication.index.perf: restored page: page=16 size=12988 last_commit=11
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.117Z [DEBUG] replication.index.perf: restored page: page=23 size=641 last_commit=149
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.119Z [DEBUG] replication.index.perf: restored page: page=55 size=13040 last_commit=21
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.124Z [DEBUG] replication.index.perf: restored page: page=145 size=637 last_commit=2
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.125Z [DEBUG] replication.index.perf: restored page: page=162 size=639 last_commit=11
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.126Z [DEBUG] replication.index.perf: restored page: page=169 size=13002 last_commit=11
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.127Z [DEBUG] replication.index.perf: restored page: page=179 size=12987 last_commit=11
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.130Z [DEBUG] replication.index.perf: restored page: page=242 size=12991 last_commit=22
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.130Z [DEBUG] replication.index.perf: restored page: page=253 size=13035 last_commit=23
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.130Z [DEBUG] replication.index.perf: restored page: page=254 size=629 last_commit=9
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.131Z [WARN]  replication.index.perf: unexpected number of index pages found: pages_restored=10 expect=256
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.131Z [INFO]  replication.index.perf: checkpoint recovery complete
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.131Z [DEBUG] replication.index.perf: no dirty pages, using last seen index from checkpoint: last_commit=149
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.132Z [DEBUG] replication.index.local: restored page: page=34 size=628 last_commit=10
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.132Z [DEBUG] replication.index.local: restored page: page=42 size=13037 last_commit=17
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.133Z [DEBUG] replication.index.local: restored page: page=88 size=625 last_commit=12
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.134Z [DEBUG] replication.index.local: restored page: page=136 size=12994 last_commit=12
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.136Z [DEBUG] replication.index.local: restored page: page=191 size=13057 last_commit=18
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.137Z [DEBUG] replication.index.local: restored page: page=225 size=630 last_commit=5
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.137Z [DEBUG] replication.index.local: restored page: page=228 size=12992 last_commit=17
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.138Z [WARN]  replication.index.local: unexpected number of index pages found: pages_restored=7 expect=256
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.138Z [INFO]  replication.index.local: checkpoint recovery complete
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.138Z [DEBUG] replication.index.local: no dirty pages, using last seen index from checkpoint: last_commit=149
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.139Z [DEBUG] replication.wal: no logs to replay: commit_index=149 last_index=149
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.139Z [DEBUG] core: persisting feature flags
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.174Z [DEBUG] sealwrap: unwrapping entry: key=core/wrapping/jwtkey
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.358Z [DEBUG] replication.index.perf: flushed dirty pages: num_pages=1
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.391Z [INFO]  core: loaded wrapping token key
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.391Z [INFO]  core: successfully setup plugin catalog: plugin-directory=""
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.393Z [INFO]  core: successfully mounted backend: type=system path=sys/
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.394Z [INFO]  core: successfully mounted backend: type=identity path=identity/
Jul 13 20:44:00 cr3yhx1 vault[38818]: 2021-07-13T20:44:00.394Z [ERROR] core: failed to create mount entry: path=transit/ error="failed to create cache: Must provide a positive size"
@mikegreen mikegreen added the bug Used to indicate a potential bug label Jul 13, 2021
@ncabatoff ncabatoff mentioned this issue Aug 25, 2021
Merged
@hsimon-hashicorp
Copy link
Contributor

Fixed in #12418

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Used to indicate a potential bug cryptosec
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@mikegreen @mladlow @hsimon-hashicorp