[docs] New Glossary Page (#5999)

* Moved the glossary to a new page and removed the advanced warnings from all internals docs.

* Update website/source/layouts/docs.erb

Co-Authored-By: Judith Malnick <judith@hashicorp.com>

* Updates based on PR feedback

* Update website/source/docs/internals/index.html.md

* Update website/source/docs/internals/index.html.md

* Update website/source/docs/internals/index.html.md

* Update website/source/docs/internals/index.html.md

* Update website/source/docs/internals/index.html.md
This commit is contained in:
kaitlincarter-hc 2019-06-24 16:19:12 -05:00 committed by GitHub
parent 698a1e2e3e
commit ddb1955bda
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
10 changed files with 106 additions and 88 deletions

View File

@ -0,0 +1,85 @@
---
layout: "docs"
page_title: "Consul Glossary"
sidebar_current: "docs-glossary"
description: |-
This page collects brief definitions of some of the technical terms used in the documentation.
---
# Consul Glossary
This page collects brief definitions of some of the technical terms used in the documentation for Consul and Consul Enterprise, as well as some terms that come up frequently in conversations throughout the Consul community.
* [Agent](#agent)
* [Client](#client)
* [Server](#server)
* [Datacenter](#datacenter)
* [Consensus](#consensus)
* [Gossip](#gossip)
* [LAN Gossip](#lan-gossip)
* [WAN Gossip](#wan-gossip)
* [RPC](#rpc)
## Agent
An agent is the long running daemon on every member of the Consul cluster.
It is started by running `consul agent`. The agent is able to run in either *client*
or *server* mode. Since all nodes must be running an agent, it is simpler to refer to
the node as being either a client or server, but there are other instances of the agent. All
agents can run the DNS or HTTP interfaces, and are responsible for running checks and
keeping services in sync.
## Client
A client is an agent that forwards all RPCs to a server. The client is relatively
stateless. The only background activity a client performs is taking part in the LAN gossip
pool. This has a minimal resource overhead and consumes only a small amount of network
bandwidth.
## Server
A server is an agent with an expanded set of responsibilities including
participating in the Raft quorum, maintaining cluster state, responding to RPC queries,
exchanging WAN gossip with other datacenters, and forwarding queries to leaders or
remote datacenters.
## Datacenter
We define a datacenter to be a networking environment that is
private, low latency, and high bandwidth. This excludes communication that would traverse
the public internet, but for our purposes multiple availability zones within a single EC2
region would be considered part of a single datacenter.
## Consensus
When used in our documentation we use consensus to mean agreement upon
the elected leader as well as agreement on the ordering of transactions. Since these
transactions are applied to a
[finite-state machine](https://en.wikipedia.org/wiki/Finite-state_machine), our definition
of consensus implies the consistency of a replicated state machine. Consensus is described
in more detail on [Wikipedia](https://en.wikipedia.org/wiki/Consensus_(computer_science)),
and our implementation is described [here](/docs/internals/consensus.html).
## Gossip
Consul is built on top of [Serf](https://www.serf.io/) which provides a full
[gossip protocol](https://en.wikipedia.org/wiki/Gossip_protocol) that is used for multiple purposes.
Serf provides membership, failure detection, and event broadcast. Our use of these
is described more in the [gossip documentation](/docs/internals/gossip.html). It is enough to know
that gossip involves random node-to-node communication, primarily over UDP.
## LAN Gossip
Refers to the LAN gossip pool which contains nodes that are all
located on the same local area network or datacenter.
## WAN Gossip
Refers to the WAN gossip pool which contains only servers. These
servers are primarily located in different datacenters and typically communicate
over the internet or wide area network.
## RPC
Remote Procedure Call. This is a request / response mechanism allowing a
client to make a request of a server.

View File

@ -12,11 +12,6 @@ Consul uses an advanced method of maintaining service and health information.
This page details how services and checks are registered, how the catalog is This page details how services and checks are registered, how the catalog is
populated, and how health status information is updated as it changes. populated, and how health status information is updated as it changes.
~> **Advanced Topic!** This page covers technical details of
the internals of Consul. You don't need to know these details to effectively
operate and use Consul. These details are documented here for those who wish
to learn about them without having to go spelunking through the source code.
### Components ### Components
It is important to first understand the moving pieces involved in services and It is important to first understand the moving pieces involved in services and

View File

@ -12,61 +12,10 @@ Consul is a complex system that has many different moving parts. To help
users and developers of Consul form a mental model of how it works, this users and developers of Consul form a mental model of how it works, this
page documents the system architecture. page documents the system architecture.
~> **Advanced Topic!** This page covers technical details of -> Before describing the architecture, we recommend reading the
the internals of Consul. You don't need to know these details to effectively [glossary](/docs/glossary) of terms to help
operate and use Consul. These details are documented here for those who wish clarify what is being discussed.
to learn about them without having to go spelunking through the source code.
## Glossary
Before describing the architecture, we provide a glossary of terms to help
clarify what is being discussed:
* Agent - An agent is the long running daemon on every node of the Consul cluster.
It is started by running `consul agent`. The agent is able to run in either *client*
or *server* mode. Since all nodes must be running an agent, it is simpler to refer to
them as being either a client or server. All
agents can run the DNS or HTTP interfaces, and are responsible for running checks and
keeping services in sync.
* Client - A client is an agent that forwards all RPCs to a server. The client is relatively
stateless. The only background activity a client performs is taking part in the LAN gossip
pool. This has a minimal resource overhead and consumes only a small amount of network
bandwidth.
* Server - A server is an agent with an expanded set of responsibilities including
participating in the Raft quorum, maintaining cluster state, responding to RPC queries,
exchanging WAN gossip with other datacenters, and forwarding queries to leaders or
remote datacenters.
* Datacenter - We define a datacenter to be a networking environment that is
private, low latency, and high bandwidth. This excludes communication that would traverse
the public internet, but for our purposes multiple availability zones within a single EC2
region would be considered part of a single datacenter.
* Consensus - When used in our documentation we use consensus to mean agreement upon
the elected leader as well as agreement on the ordering of transactions. Since these
transactions are applied to a
[finite-state machine](https://en.wikipedia.org/wiki/Finite-state_machine), our definition
of consensus implies the consistency of a replicated state machine. Consensus is described
in more detail on [Wikipedia](https://en.wikipedia.org/wiki/Consensus_(computer_science)),
and our implementation is described [here](/docs/internals/consensus.html).
* Gossip - Consul is built on top of [Serf](https://www.serf.io/) which provides a full
[gossip protocol](https://en.wikipedia.org/wiki/Gossip_protocol) that is used for multiple purposes.
Serf provides membership, failure detection, and event broadcast. Our use of these
is described more in the [gossip documentation](/docs/internals/gossip.html). It is enough to know
that gossip involves random agent-to-agent communication, primarily over UDP.
* LAN Gossip - Refers to the LAN gossip pool which contains agents that are all
located on the same local area network or datacenter.
* WAN Gossip - Refers to the WAN gossip pool which contains only servers. These
servers are primarily located in different datacenters and typically communicate
over the internet or wide area network.
* RPC - Remote Procedure Call. This is a request / response mechanism allowing a
client to make a request of a server.
## 10,000 foot view ## 10,000 foot view

View File

@ -14,11 +14,6 @@ The consensus protocol is based on
["Raft: In search of an Understandable Consensus Algorithm"](https://ramcloud.stanford.edu/wiki/download/attachments/11370504/raft.pdf). ["Raft: In search of an Understandable Consensus Algorithm"](https://ramcloud.stanford.edu/wiki/download/attachments/11370504/raft.pdf).
For a visual explanation of Raft, see [The Secret Lives of Data](http://thesecretlivesofdata.com/raft). For a visual explanation of Raft, see [The Secret Lives of Data](http://thesecretlivesofdata.com/raft).
~> **Advanced Topic!** This page covers technical details of
the internals of Consul. You don't need to know these details to effectively
operate and use Consul. These details are documented here for those who wish
to learn about them without having to go spelunking through the source code.
## Raft Protocol Overview ## Raft Protocol Overview
Raft is a consensus algorithm that is based on Raft is a consensus algorithm that is based on

View File

@ -20,11 +20,6 @@ Serf's network tomography is based on ["Vivaldi: A Decentralized Network Coordin
with some enhancements based on other research. There are more details about with some enhancements based on other research. There are more details about
[Serf's network coordinates here](https://www.serf.io/docs/internals/coordinates.html). [Serf's network coordinates here](https://www.serf.io/docs/internals/coordinates.html).
~> **Advanced Topic!** This page covers the technical details of
the internals of Consul. You don't need to know these details to effectively
operate and use Consul. These details are documented here for those who wish
to learn about them without having to go spelunking through the source code.
## Network Coordinates in Consul ## Network Coordinates in Consul
Network coordinates manifest in several ways inside Consul: Network coordinates manifest in several ways inside Consul:

View File

@ -15,11 +15,6 @@ used by Serf is based on
["SWIM: Scalable Weakly-consistent Infection-style Process Group Membership Protocol"](http://www.cs.cornell.edu/info/projects/spinglass/public_pdfs/swim.pdf), ["SWIM: Scalable Weakly-consistent Infection-style Process Group Membership Protocol"](http://www.cs.cornell.edu/info/projects/spinglass/public_pdfs/swim.pdf),
with a few minor adaptations. There are more details about [Serf's protocol here](https://www.serf.io/docs/internals/gossip.html). with a few minor adaptations. There are more details about [Serf's protocol here](https://www.serf.io/docs/internals/gossip.html).
~> **Advanced Topic!** This page covers technical details of
the internals of Consul. You don't need to know these details to effectively
operate and use Consul. These details are documented here for those who wish
to learn about them without having to go spelunking through the source code.
## Gossip in Consul ## Gossip in Consul
Consul makes use of two different gossip pools. We refer to each pool as the Consul makes use of two different gossip pools. We refer to each pool as the

View File

@ -8,8 +8,18 @@ description: |-
# Consul Internals # Consul Internals
This section covers some of the internals of Consul, such as the architecture, This section covers some of the internals of Consul. Understanding the internals of Consul is necessary to successfully
consensus and gossip protocols, and security model. use it in production.
-> **Note:** Knowing about the internals of Consul is not necessary to successfully Please review the following documentation to understand how Consul works.
use it. We document it here to be completely transparent about how Consul works.
* [Architecture](/docs/internals/architecture.html)
* [Consensus Protocol](/docs/internals/consensus.html)
* [Gossip Protocol](/docs/internals/gossip.html)
* [Network Coordinates](/docs/internals/coordinates.html)
* [Sessions](/docs/internals/sessions.html)
* [Anti-Entropy](/docs/internals/anti-entropy.html)
* [Security Model](/docs/internals/security.html)
You should also be familiar with [Jepsen testing](/docs/internals/jepsen.html), before deploying
a production datacenter.

View File

@ -28,11 +28,6 @@ This means Consul communication is protected against eavesdropping, tampering,
and spoofing. This makes it possible to run Consul over untrusted networks such and spoofing. This makes it possible to run Consul over untrusted networks such
as EC2 and other shared hosting providers. as EC2 and other shared hosting providers.
~> **Advanced Topic!** This page covers the technical details of
the security model of Consul. You don't need to know these details to
operate and use Consul. These details are documented here for those who wish
to learn about them without having to go spelunking through the source code.
## Secure Configuration ## Secure Configuration
The Consul threat model is only applicable if Consul is running in a secure The Consul threat model is only applicable if Consul is running in a secure

View File

@ -13,11 +13,6 @@ Sessions act as a binding layer between nodes, health checks, and key/value data
They are designed to provide granular locking and are heavily inspired by They are designed to provide granular locking and are heavily inspired by
[The Chubby Lock Service for Loosely-Coupled Distributed Systems](http://research.google.com/archive/chubby.html). [The Chubby Lock Service for Loosely-Coupled Distributed Systems](http://research.google.com/archive/chubby.html).
~> **Advanced Topic!** This page covers technical details of
the internals of Consul. You don't need to know these details to effectively
operate and use Consul. These details are documented here for those who wish
to learn about them without having to go spelunking through the source code.
## Session Design ## Session Design
A session in Consul represents a contract that has very specific semantics. A session in Consul represents a contract that has very specific semantics.

View File

@ -31,6 +31,10 @@
</ul> </ul>
</li> </li>
<li<%= sidebar_current("docs-glossary") %>>
<a href="/docs/glossary.html">Glossary</a>
</li>
<li<%= sidebar_current("docs-internals") %>> <li<%= sidebar_current("docs-internals") %>>
<a href="/docs/internals/index.html">Internals</a> <a href="/docs/internals/index.html">Internals</a>
<ul class="nav"> <ul class="nav">