--- layout: docs page_title: Installing Consul on Kubernetes - Kubernetes sidebar_title: Overview description: >- Consul can run directly on Kubernetes, both in server or client mode. For pure-Kubernetes workloads, this enables Consul to also exist purely within Kubernetes. For heterogeneous workloads, Consul agents can join a server running inside or outside of Kubernetes. --- # Installing Consul on Kubernetes Consul can run directly on Kubernetes, both in server or client mode. For pure-Kubernetes workloads, this enables Consul to also exist purely within Kubernetes. For heterogeneous workloads, Consul agents can join a server running inside or outside of Kubernetes. This page starts with a large how-to section for various specific tasks. To learn more about the general architecture of Consul on Kubernetes, scroll down to the [architecture](/docs/k8s/installation/overview.html#architecture) section. If you would like to get hands-on experience testing Consul as a service mesh for Kubernetes, check the guides in the [Getting Started with Consul service mesh](https://learn.hashicorp.com/consul/gs-consul-service-mesh/understand-consul-service-mesh?utm_source=WEBSITE&utm_medium=WEB_IO&utm_offer=ARTICLE_PAGE&utm_content=DOCS) track. ## Helm Chart Installation The recommended way to run Consul on Kubernetes is via the [Helm chart](/docs/k8s/helm). This will install and configure all the necessary components to run Consul. The configuration enables you to run just a server cluster, just a client cluster, or both. Using the Helm chart, you can have a full Consul deployment up and running in minutes. A step-by-step beginner tutorial and accompanying video can be found at the [Minikube with Consul guide](https://learn.hashicorp.com/consul/getting-started-k8s/minikube?utm_source=consul.io&utm_medium=docs). While the Helm chart exposes dozens of useful configurations and automatically sets up complex resources, it **does not automatically operate Consul.** You are still responsible for learning how to monitor, backup, upgrade, etc. the Consul cluster. The Helm chart has no required configuration and will install a Consul cluster with sane defaults out of the box. Prior to going to production, it is highly recommended that you [learn about the configuration options](/docs/k8s/helm#configuration-values). ~> **Security Warning:** By default, the chart will install an insecure configuration of Consul. This provides a less complicated out-of-box experience for new users, but is not appropriate for a production setup. It is highly recommended to use a properly secured Kubernetes cluster or make sure that you understand and enable the [recommended security features](/docs/internals/security). Currently, some of these features are not supported in the Helm chart and require additional manual configuration. ### Prerequisites The Consul Helm chart works with Helm 2 and Helm 3. If using Helm 2, you will need to install Tiller by following the [Helm 2 Installation Guide](https://v2.helm.sh/docs/using_helm/#quickstart-guide). ### Installing Consul Add the HashiCorp Helm Repository: ```shell-session $ helm repo add hashicorp https://helm.releases.hashicorp.com "hashicorp" has been added to your repositories ``` Ensure you have access to the consul chart: ```shell-session $ helm search repo hashicorp/consul NAME CHART VERSION APP VERSION DESCRIPTION hashicorp/consul 0.20.1 1.7.2 Official HashiCorp Consul Chart ``` Now you're ready to install Consul! To install Consul with the default configuration using Helm 3 run: ```shell-session $ helm install consul hashicorp/consul --set global.name=consul NAME: consul ... ``` -> If using Helm 2, run: `helm install --name consul hashicorp/consul --set global.name=consul` _That's it._ The Helm chart does everything to set up a recommended Consul-on-Kubernetes deployment. In a couple minutes, a Consul cluster will be formed and a leader elected and every node will have a running Consul agent. ### Customizing Your Installation If you want to customize your installation, create a `config.yaml` file to override the default settings. You can learn what settings are available by running `helm inspect values hashicorp/consul` or by reading the [Helm Chart Reference](/docs/k8s/helm). For example, if you want to enable the [Consul Connect](/docs/k8s/connect/overview) feature, use the following config file: ```yaml # config.yaml global: name: consul connectInject: enabled: true ``` Once you've created your `config.yaml` file, run `helm install` with the `-f` flag: ```shell-session $ helm install consul hashicorp/consul -f config.yaml NAME: consul ... ``` If you've already installed Consul and want to make changes, you'll need to run `helm upgrade`. See [Upgrading](/docs/k8s/operations/upgrading) for more details. ## Viewing the Consul UI The Consul UI is enabled by default when using the Helm chart. For security reasons, it isn't exposed via a `LoadBalancer` Service by default so you must use `kubectl port-forward` to visit the UI. #### TLS Disabled If running with TLS disabled, the Consul UI will be accessible via http on port 8500: ```shell-session $ kubectl port-forward service/consul-server 8500:8500 ... ``` Once the port is forwarded navigate to [http://localhost:8500](http://localhost:8500). #### TLS Enabled If running with TLS enabled, the Consul UI will be accessible via https on port 8501: ```shell-session $ kubectl port-forward service/consul-server 8501:8501 ... ``` Once the port is forwarded navigate to [https://localhost:8501](https://localhost:8501). ~> You'll need to click through an SSL warning from your browser because the Consul certificate authority is self-signed and not in the browser's trust store. #### ACLs Enabled If ACLs are enabled, you will need to input an ACL token into the UI in order to see all resources and make modifications. To retrieve the bootstrap token that has full permissions, run: ```shell-session $ kubectl get secrets/consul-bootstrap-acl-token --template={{.data.token}} | base64 -D e7924dd1-dc3f-f644-da54-81a73ba0a178% ``` Then paste the token into the UI under the ACLs tab (without the `%`). ~> NOTE: If using multi-cluster federation, your kubectl context must be in the primary datacenter to retrieve the bootstrap token since secondary datacenters use a separate token with less permissions. ### Exposing the UI via a service If you want to expose the UI via a Kubernetes Service, configure the [`ui.service` chart values](/docs/k8s/helm#v-ui-service). This service will allow requests to the Consul servers so it should not be open to the world. ## Accessing the Consul HTTP API The Consul HTTP API should be accessed by communicating to the local agent running on the same node. While technically any listening agent (client or server) can respond to the HTTP API, communicating with the local agent has important caching behavior, and allows you to use the simpler [`/agent` endpoints for services and checks](/api/agent). For Consul installed via the Helm chart, a client agent is installed on each Kubernetes node. This is explained in the [architecture](/docs/k8s/installation/overview#client-agents) section. To access the agent, you may use the [downward API](https://kubernetes.io/docs/tasks/inject-data-application/downward-api-volume-expose-pod-information/). An example pod specification is shown below. In addition to pods, anything with a pod template can also access the downward API and can therefore also access Consul: StatefulSets, Deployments, Jobs, etc. ```yaml apiVersion: v1 kind: Pod metadata: name: consul-example spec: containers: - name: example image: 'consul:latest' env: - name: HOST_IP valueFrom: fieldRef: fieldPath: status.hostIP command: - '/bin/sh' - '-ec' - | export CONSUL_HTTP_ADDR="${HOST_IP}:8500" consul kv put hello world restartPolicy: Never ``` An example `Deployment` is also shown below to show how the host IP can be accessed from nested pod specifications: ```yaml apiVersion: apps/v1 kind: Deployment metadata: name: consul-example-deployment spec: replicas: 1 selector: matchLabels: app: consul-example template: metadata: labels: app: consul-example spec: containers: - name: example image: 'consul:latest' env: - name: HOST_IP valueFrom: fieldRef: fieldPath: status.hostIP command: - '/bin/sh' - '-ec' - | export CONSUL_HTTP_ADDR="${HOST_IP}:8500" consul kv put hello world ``` ## Architecture We recommend running Consul on Kubernetes with the same [general architecture](/docs/internals/architecture) as running it anywhere else. There are some benefits Kubernetes can provide that eases operating a Consul cluster and we document those below. The standard [production deployment guide](https://learn.hashicorp.com/consul/datacenter-deploy/deployment-guide) is still an important read even if running Consul within Kubernetes. Each section below will outline the different components of running Consul on Kubernetes and an overview of the resources that are used within the Kubernetes cluster. ### Server Agents The server agents are run as a **StatefulSet**, using persistent volume claims to store the server state. This also ensures that the [node ID](/docs/agent/options#_node_id) is persisted so that servers can be rescheduled onto new IP addresses without causing issues. The server agents are configured with [anti-affinity](https://kubernetes.io/docs/concepts/configuration/assign-pod-node/#affinity-and-anti-affinity) rules so that they are placed on different nodes. A readiness probe is configured that marks the pod as ready only when it has established a leader. A **Service** is registered to represent the servers and expose the various ports. The DNS address of this service is used to join the servers to each other without requiring any other access to the Kubernetes cluster. The service is configured to publish non-ready endpoints so that it can be used for joining during bootstrap and upgrades. Additionally, a **PodDisruptionBudget** is configured so the Consul server cluster maintains quorum during voluntary operational events. The maximum unavailable is `(n/2)-1` where `n` is the number of server agents. -> **Note:** Kubernetes and Helm do not delete Persistent Volumes or Persistent Volume Claims when a [StatefulSet is deleted](https://kubernetes.io/docs/concepts/workloads/controllers/statefulset/#stable-storage), so this must done manually when removing servers. ### Client Agents The client agents are run as a **DaemonSet**. This places one agent (within its own pod) on each Kubernetes node. The clients expose the Consul HTTP API via a static port (default 8500) bound to the host port. This enables all other pods on the node to connect to the node-local agent using the host IP that can be retrieved via the Kubernetes downward API. See [accessing the Consul HTTP API](/docs/k8s/installation/overview#accessing-the-consul-http-api) for an example. There is a major limitation to this: there is no way to bind to a local-only host port. Therefore, any other node can connect to the agent. This should be considered for security. For a properly production-secured agent with TLS and ACLs, this is safe. Some people prefer to run **Consul agent per pod** architectures, since this makes it easy to register the pod as a service. However, this turns a pod into a "node" in Consul and also causes an explosion of resource usage since every pod needs a Consul agent. We recommend instead running an agent (in a dedicated pod) per node, via the DaemonSet. This maintains the node equivalence in Consul. Service registration should be handled via the catalog syncing feature with Services rather than pods. -> **Note:** Due to a limitation of anti-affinity rules with DaemonSets, a client-mode agent runs alongside server-mode agents in Kubernetes. This duplication wastes some resources, but otherwise functions perfectly fine.