Commit Graph

96 Commits

Author SHA1 Message Date
James Phillips bc29610124 Adds support for snapshots and restores. (#2396)
* Updates Raft library to get new snapshot/restore API.

* Basic backup and restore working, but need some cleanup.

* Breaks out a snapshot module and adds a SHA256 integrity check.

* Adds snapshot ACL and fills in some missing comments.

* Require a consistent read for snapshots.

* Make sure snapshot works if ACLs aren't enabled.

* Adds a bit of package documentation.

* Returns an empty response from restore to avoid EOF errors.

* Adds API client support for snapshots.

* Makes internal file names match on-disk file snapshots.

* Adds DC and token coverage for snapshot API test.

* Adds missing documentation.

* Adds a unit test for the snapshot client endpoint.

* Moves the connection pool out of the client for easier testing.

* Fixes an incidental issue in the prepared query unit test.

I realized I had two servers in bootstrap mode so this wasn't a good setup.

* Adds a half close to the TCP stream and fixes panic on error.

* Adds client and endpoint tests for snapshots.

* Moves the pool back into the snapshot RPC client.

* Adds a TLS test and fixes half-closes for TLS connections.

* Tweaks some comments.

* Adds a low-level snapshot test.

This is independent of Consul so we can pull this out into a library
later if we want to.

* Cleans up snapshot and archive and completes archive tests.

* Sends a clear error for snapshot operations in dev mode.

Snapshots require the Raft snapshots to be readable, which isn't supported
in dev mode. Send a clear error instead of a deep-down Raft one.

* Adds docs for the snapshot endpoint.

* Adds a stale mode and index feedback for snapshot saves.

This gives folks a way to extract data even if the cluster has no
leader.

* Changes the internal format of a snapshot from zip to tgz.

* Pulls in Raft fix to cancel inflight before a restore.

* Pulls in new Raft restore interface.

* Adds metadata to snapshot saves and a verify function.

* Adds basic save and restore snapshot CLI commands.

* Gets rid of tarball extensions and adds restore message.

* Fixes an incidental bad link in the KV docs.

* Adds documentation for the snapshot CLI commands.

* Scuttle any request body when a snapshot is saved.

* Fixes archive unit test error message check.

* Allows for nil output writers in snapshot RPC handlers.

* Renames hash list Decode to DecodeAndVerify.

* Closes the client connection for snapshot ops.

* Lowers timeout for restore ops.

* Updates Raft vendor to get new Restore signature and integrates with Consul.

* Bounces the leader's internal state when we do a restore.
2016-10-25 19:20:24 -07:00
Seth Vargo ce5c820c4a
Add kv delete command 2016-09-26 16:06:53 -07:00
Seth Vargo d5dd8ef7a1
Add kv put command 2016-09-26 16:06:53 -07:00
Seth Vargo a8dc0f86b6
Add kv get 2016-09-26 16:06:53 -07:00
James Phillips 1b7a16b7d3
Adds new consul operator endpoint, CLI, and ACL and some basic Raft commands. 2016-08-30 00:02:50 -07:00
James Phillips 757cbce708
Sorts the guides (redux). 2016-08-25 16:47:54 -07:00
James Phillips ff4dd5e590 Sorts the guides. 2016-08-25 16:44:52 -07:00
James Phillips b339b0d2fc
Adds performance tuning capability for Raft, detuned defaults, and supplemental docs. 2016-08-24 21:58:37 -07:00
James Phillips 6daf26ada4 Adds documentation for the transaction endpoint. 2016-05-11 14:18:47 -07:00
James Phillips 9e29bb4238 Adds and updates docs for prepared queries. 2015-11-15 17:06:00 -08:00
James Phillips b3b1c6940b Updates docs for network coordinates. 2015-10-23 15:23:01 -07:00
Ryan Uber b082d2f529 website: link and formatting adjustments for configtest command 2015-05-11 09:42:06 -07:00
Ryan Uber 7f40698666 website: first pass at anti-entropy docs 2015-03-03 14:13:59 -08:00
Armon Dadgar ab18b0fc32 website: Upgrading 0.5 docs 2015-02-19 11:03:02 -08:00
Armon Dadgar 52bdbdade9 website: Adding Atlas docs 2015-02-18 15:15:01 -08:00
Ryan Uber 61322641ea website: document maint command 2015-01-21 14:07:54 -08:00
Ryan Uber 4c83c6917d fix space/tab mixing in docs.erb 2015-01-20 22:50:33 -08:00
Ryan Uber 65b41b9236 website: beginning http docs update 2015-01-20 22:49:41 -08:00
Armon Dadgar b92b09cd19 website: Document the lock command 2015-01-19 16:43:38 -10:00
Armon Dadgar 8698d9bdb3 website: Document a distributed semaphore 2015-01-19 16:43:24 -10:00
Ryan Uber 8dc53447a3 command: renamed keys to keyring to disambiguate usage 2014-11-19 16:31:06 -08:00
Ryan Uber c0f1b5f8c8 website: document keys command 2014-11-19 16:30:22 -08:00
Armon Dadgar 6755044e02 website: Adding FAQ page. Fixes #363. 2014-10-13 17:46:41 -07:00
Armon Dadgar ea20cabc0f website: Updating docs 2014-09-01 15:03:37 -07:00
Armon Dadgar 2f8948fe89 website: Adding docs 2014-08-28 17:22:56 -07:00
Armon Dadgar 60a50301db website: Document watches 2014-08-21 17:25:42 -07:00
Armon Dadgar ea0a1dca2e website: ACL internals 2014-08-18 15:46:59 -07:00
Armon Dadgar 5378542b1c website: Document the new reload command 2014-06-11 11:01:36 -07:00
Armon Dadgar 3af3f40434 website: Documenting DNS settings 2014-06-08 17:26:41 -07:00
Armon Dadgar 1e861114c7 website: Adding guide on leader election 2014-05-20 16:25:30 -07:00
Armon Dadgar 2748dcd4c6 website: Starting to document sessions 2014-05-20 16:25:30 -07:00
Armon Dadgar f104336fd2 website: Adding page on Jepsen testing 2014-04-16 17:03:48 -07:00
Armon Dadgar 37bd90f09d website: Adding guide on outage recovery 2014-04-11 12:55:02 -07:00
Armon Dadgar 668255784c website: Guide for adding/removing servers 2014-04-11 12:32:34 -07:00
Armon Dadgar d6bccb8905 website: Adding multiple datacenter guide 2014-04-11 12:03:12 -07:00
Armon Dadgar e2d45b5eb0 website: Doc cleanup 2014-04-09 11:40:52 -07:00
Armon Dadgar 37a7a4400e website: Remove roadmap 2014-04-07 15:11:58 -07:00
Armon Dadgar 65df8cedf2 website: document registering of external services 2014-02-25 12:22:25 -08:00
Armon Dadgar 38317d4890 website: Documenting the info command 2014-02-23 17:09:59 -08:00
Armon Dadgar 5b5b3f1189 website: adding guide on bootstrapping a DC. Fixes #5. 2014-02-22 21:08:36 -08:00
Armon Dadgar 5101cf88df website: document the high level architecture 2014-02-19 16:58:15 -08:00
Armon Dadgar 4b490b3a83 website: working on documenting http api 2014-02-19 12:05:18 -08:00
Armon Dadgar 1924f73449 website: document the DNS interface 2014-02-19 11:05:42 -08:00
Armon Dadgar 1eb51ee663 website: document checks and services 2014-02-18 18:05:18 -08:00
Armon Dadgar c200b63204 website: updating documentation on commands 2014-02-18 17:32:13 -08:00
Armon Dadgar 0611db496a website: bulk copy from serf 2014-02-07 16:41:03 -08:00