ed14061578
* Work on raft backend * Add logstore locally * Add encryptor and unsealable interfaces * Add clustering support to raft * Remove client and handler * Bootstrap raft on init * Cleanup raft logic a bit * More raft work * Work on TLS config * More work on bootstrapping * Fix build * More work on bootstrapping * More bootstrapping work * fix build * Remove consul dep * Fix build * merged oss/master into raft-storage * Work on bootstrapping * Get bootstrapping to work * Clean up FMS and node-id * Update local node ID logic * Cleanup node-id change * Work on snapshotting * Raft: Add remove peer API (#906) * Add remove peer API * Add some comments * Fix existing snapshotting (#909) * Raft get peers API (#912) * Read raft configuration * address review feedback * Use the Leadership Transfer API to step-down the active node (#918) * Raft join and unseal using Shamir keys (#917) * Raft join using shamir * Store AEAD instead of master key * Split the raft join process to answer the challenge after a successful unseal * get the follower to standby state * Make unseal work * minor changes * Some input checks * reuse the shamir seal access instead of new default seal access * refactor joinRaftSendAnswer function * Synchronously send answer in auto-unseal case * Address review feedback * Raft snapshots (#910) * Fix existing snapshotting * implement the noop snapshotting * Add comments and switch log libraries * add some snapshot tests * add snapshot test file * add TODO * More work on raft snapshotting * progress on the ConfigStore strategy * Don't use two buckets * Update the snapshot store logic to hide the file logic * Add more backend tests * Cleanup code a bit * [WIP] Raft recovery (#938) * Add recovery functionality * remove fmt.Printfs * Fix a few fsm bugs * Add max size value for raft backend (#942) * Add max size value for raft backend * Include physical.ErrValueTooLarge in the message * Raft snapshot Take/Restore API (#926) * Inital work on raft snapshot APIs * Always redirect snapshot install/download requests * More work on the snapshot APIs * Cleanup code a bit * On restore handle special cases * Use the seal to encrypt the sha sum file * Add sealer mechanism and fix some bugs * Call restore while state lock is held * Send restore cb trigger through raft log * Make error messages nicer * Add test helpers * Add snapshot test * Add shamir unseal test * Add more raft snapshot API tests * Fix locking * Change working to initalize * Add underlying raw object to test cluster core * Move leaderUUID to core * Add raft TLS rotation logic (#950) * Add TLS rotation logic * Cleanup logic a bit * Add/Remove from follower state on add/remove peer * add comments * Update more comments * Update request_forwarding_service.proto * Make sure we populate all nodes in the followerstate obj * Update times * Apply review feedback * Add more raft config setting (#947) * Add performance config setting * Add more config options and fix tests * Test Raft Recovery (#944) * Test raft recovery * Leave out a node during recovery * remove unused struct * Update physical/raft/snapshot_test.go * Update physical/raft/snapshot_test.go * fix vendoring * Switch to new raft interface * Remove unused files * Switch a gogo -> proto instance * Remove unneeded vault dep in go.sum * Update helper/testhelpers/testhelpers.go Co-Authored-By: Calvin Leung Huang <cleung2010@gmail.com> * Update vault/cluster/cluster.go * track active key within the keyring itself (#6915) * track active key within the keyring itself * lookup and store using the active key ID * update docstring * minor refactor * Small text fixes (#6912) * Update physical/raft/raft.go Co-Authored-By: Calvin Leung Huang <cleung2010@gmail.com> * review feedback * Move raft logical system into separate file * Update help text a bit * Enforce cluster addr is set and use it for raft bootstrapping * Fix tests * fix http test panic * Pull in latest raft-snapshot library * Add comment
178 lines
4.2 KiB
Go
178 lines
4.2 KiB
Go
package raft
|
|
|
|
// RPCHeader is a common sub-structure used to pass along protocol version and
|
|
// other information about the cluster. For older Raft implementations before
|
|
// versioning was added this will default to a zero-valued structure when read
|
|
// by newer Raft versions.
|
|
type RPCHeader struct {
|
|
// ProtocolVersion is the version of the protocol the sender is
|
|
// speaking.
|
|
ProtocolVersion ProtocolVersion
|
|
}
|
|
|
|
// WithRPCHeader is an interface that exposes the RPC header.
|
|
type WithRPCHeader interface {
|
|
GetRPCHeader() RPCHeader
|
|
}
|
|
|
|
// AppendEntriesRequest is the command used to append entries to the
|
|
// replicated log.
|
|
type AppendEntriesRequest struct {
|
|
RPCHeader
|
|
|
|
// Provide the current term and leader
|
|
Term uint64
|
|
Leader []byte
|
|
|
|
// Provide the previous entries for integrity checking
|
|
PrevLogEntry uint64
|
|
PrevLogTerm uint64
|
|
|
|
// New entries to commit
|
|
Entries []*Log
|
|
|
|
// Commit index on the leader
|
|
LeaderCommitIndex uint64
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *AppendEntriesRequest) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// AppendEntriesResponse is the response returned from an
|
|
// AppendEntriesRequest.
|
|
type AppendEntriesResponse struct {
|
|
RPCHeader
|
|
|
|
// Newer term if leader is out of date
|
|
Term uint64
|
|
|
|
// Last Log is a hint to help accelerate rebuilding slow nodes
|
|
LastLog uint64
|
|
|
|
// We may not succeed if we have a conflicting entry
|
|
Success bool
|
|
|
|
// There are scenarios where this request didn't succeed
|
|
// but there's no need to wait/back-off the next attempt.
|
|
NoRetryBackoff bool
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *AppendEntriesResponse) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// RequestVoteRequest is the command used by a candidate to ask a Raft peer
|
|
// for a vote in an election.
|
|
type RequestVoteRequest struct {
|
|
RPCHeader
|
|
|
|
// Provide the term and our id
|
|
Term uint64
|
|
Candidate []byte
|
|
|
|
// Used to ensure safety
|
|
LastLogIndex uint64
|
|
LastLogTerm uint64
|
|
|
|
// Used to indicate to peers if this vote was triggered by a leadership
|
|
// transfer. It is required for leadership transfer to work, because servers
|
|
// wouldn't vote otherwise if they are aware of an existing leader.
|
|
LeadershipTransfer bool
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *RequestVoteRequest) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// RequestVoteResponse is the response returned from a RequestVoteRequest.
|
|
type RequestVoteResponse struct {
|
|
RPCHeader
|
|
|
|
// Newer term if leader is out of date.
|
|
Term uint64
|
|
|
|
// Peers is deprecated, but required by servers that only understand
|
|
// protocol version 0. This is not populated in protocol version 2
|
|
// and later.
|
|
Peers []byte
|
|
|
|
// Is the vote granted.
|
|
Granted bool
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *RequestVoteResponse) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// InstallSnapshotRequest is the command sent to a Raft peer to bootstrap its
|
|
// log (and state machine) from a snapshot on another peer.
|
|
type InstallSnapshotRequest struct {
|
|
RPCHeader
|
|
SnapshotVersion SnapshotVersion
|
|
|
|
Term uint64
|
|
Leader []byte
|
|
|
|
// These are the last index/term included in the snapshot
|
|
LastLogIndex uint64
|
|
LastLogTerm uint64
|
|
|
|
// Peer Set in the snapshot. This is deprecated in favor of Configuration
|
|
// but remains here in case we receive an InstallSnapshot from a leader
|
|
// that's running old code.
|
|
Peers []byte
|
|
|
|
// Cluster membership.
|
|
Configuration []byte
|
|
// Log index where 'Configuration' entry was originally written.
|
|
ConfigurationIndex uint64
|
|
|
|
// Size of the snapshot
|
|
Size int64
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *InstallSnapshotRequest) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// InstallSnapshotResponse is the response returned from an
|
|
// InstallSnapshotRequest.
|
|
type InstallSnapshotResponse struct {
|
|
RPCHeader
|
|
|
|
Term uint64
|
|
Success bool
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *InstallSnapshotResponse) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// TimeoutNowRequest is the command used by a leader to signal another server to
|
|
// start an election.
|
|
type TimeoutNowRequest struct {
|
|
RPCHeader
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *TimeoutNowRequest) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|
|
|
|
// TimeoutNowResponse is the response to TimeoutNowRequest.
|
|
type TimeoutNowResponse struct {
|
|
RPCHeader
|
|
}
|
|
|
|
// See WithRPCHeader.
|
|
func (r *TimeoutNowResponse) GetRPCHeader() RPCHeader {
|
|
return r.RPCHeader
|
|
}
|