open-consul/agent
Dan Upton 9fe6c33c0d
xDS Load Balancing (#14397)
Prior to #13244, connect proxies and gateways could only be configured by an
xDS session served by the local client agent.

In an upcoming release, it will be possible to deploy a Consul service mesh
without client agents. In this model, xDS sessions will be handled by the
servers themselves, which necessitates load-balancing to prevent a single
server from receiving a disproportionate amount of load and becoming
overwhelmed.

This introduces a simple form of load-balancing where Consul will attempt to
achieve an even spread of load (xDS sessions) between all healthy servers.
It does so by implementing a concurrent session limiter (limiter.SessionLimiter)
and adjusting the limit according to autopilot state and proxy service
registrations in the catalog.

If a server is already over capacity (i.e. the session limit is lowered),
Consul will begin draining sessions to rebalance the load. This will result
in the client receiving a `RESOURCE_EXHAUSTED` status code. It is the client's
responsibility to observe this response and reconnect to a different server.

Users of the gRPC client connection brokered by the
consul-server-connection-manager library will get this for free.

The rate at which Consul will drain sessions to rebalance load is scaled
dynamically based on the number of proxies in the catalog.
2022-09-09 15:02:01 +01:00
..
ae
auto-config
cache
cache-types
checks
config
configentry
connect
consul
debug
dns
exec
grpc-external
grpc-internal
grpc-middleware
local
metadata
mock
pool
proxycfg
proxycfg-glue
proxycfg-sources
router
routine-leak-checker
rpc
rpcclient/health
structs
submatview
systemd
token
uiserver
xds
acl.go
acl_endpoint.go
acl_endpoint_legacy.go
acl_endpoint_legacy_test.go
acl_endpoint_test.go
acl_oss.go
acl_test.go
agent.go
agent_endpoint.go
agent_endpoint_oss.go
agent_endpoint_oss_test.go
agent_endpoint_test.go
agent_oss.go
agent_test.go
apiserver.go
apiserver_test.go
catalog_endpoint.go
catalog_endpoint_oss.go
catalog_endpoint_test.go
check.go
config_endpoint.go
config_endpoint_test.go
connect_auth.go
connect_ca_endpoint.go
connect_ca_endpoint_test.go
coordinate_endpoint.go
coordinate_endpoint_test.go
delegate_mock_test.go
denylist.go
denylist_test.go
discovery_chain_endpoint.go
discovery_chain_endpoint_test.go
dns.go
dns_oss.go
dns_test.go
enterprise_delegate_oss.go
event_endpoint.go
event_endpoint_test.go
federation_state_endpoint.go
health_endpoint.go
health_endpoint_test.go
http.go
http_decode_test.go
http_oss.go
http_oss_test.go
http_register.go
http_test.go
intentions_endpoint.go
intentions_endpoint_oss_test.go
intentions_endpoint_test.go
keyring.go
keyring_test.go
kvs_endpoint.go
kvs_endpoint_test.go
metrics.go
metrics_test.go
nodeid.go
nodeid_test.go
notify.go
notify_test.go
operator_endpoint.go
operator_endpoint_oss.go
operator_endpoint_test.go
peering_endpoint.go
peering_endpoint_oss_test.go
peering_endpoint_test.go
prepared_query_endpoint.go
prepared_query_endpoint_test.go
reload.go
remote_exec.go
remote_exec_test.go
retry_join.go
retry_join_test.go
service_checks_test.go
service_manager.go
service_manager_test.go
session_endpoint.go
session_endpoint_test.go
setup.go
setup_oss.go
sidecar_service.go
sidecar_service_test.go
signal_unix.go
signal_windows.go
snapshot_endpoint.go
snapshot_endpoint_test.go
status_endpoint.go
status_endpoint_test.go
streaming_test.go
testagent.go
testagent_test.go
translate_addr.go
txn_endpoint.go
txn_endpoint_test.go
ui_endpoint.go
ui_endpoint_oss_test.go
ui_endpoint_test.go
user_event.go
user_event_test.go
util.go
util_test.go
watch_handler.go
watch_handler_test.go