open-nomad/e2e/terraform/shared
Tim Gross 2edbdfc8be
e2e: update framework to allow deploying Nomad (#6969)
The e2e framework instantiates clients for Nomad/Consul but the
provisioning of the actual Nomad cluster is left to Terraform. The
Terraform provisioning process uses `remote-exec` to deploy specific
versions of Nomad so that we don't have to bake an AMI every time we
want to test a new version. But Terraform treats the resulting
instances as immutable, so we can't use the same tooling to update the
version of Nomad in-place. This is a prerequisite for upgrade testing.

This changeset extends the e2e framework to provide the option of
deploying Nomad (and, in the future, Consul/Vault) with specific
versions to running infrastructure. This initial implementation is
focused on deploying to a single cluster via `ssh` (because that's our
current need), but provides interfaces to hook the test run at the
start of the run, the start of each suite, or the start of a given
test case.

Terraform work includes:
* provides Terraform output that written to JSON used by the framework
  to configure provisioning via `terraform output provisioning`.
* provides Terraform output that can be used by test operators to
  configure their shell via `$(terraform output environment)`
* drops `remote-exec` provisioning steps from Terraform
* makes changes to the deployment scripts to ensure they can be run
  multiple times w/ different versions against the same host.
2020-01-22 08:48:52 -05:00
..
config e2e: update framework to allow deploying Nomad (#6969) 2020-01-22 08:48:52 -05:00
consul e2e: refactor Consul configurations (#6559) 2019-10-28 09:27:40 -04:00
nomad e2e: add a Windows client to test runner (#6735) 2019-11-25 13:31:00 -05:00
vault e2e: refactor Vault configuration (#6561) 2019-10-25 15:29:01 -04:00
README.md e2e: split Packer build scripts from TF provisioning (#6542) 2019-10-25 08:08:24 -04:00

README.md

Terraform Provisioning

These scripts are copied up to instances via Terraform provisioning and executed after launch. This allows us to update the Nomad configurations for features that land on master without having to re-bake AMIs.

What goes here?

  • steps that are specific to a given Nomad build: ex. all Nomad configuration files.
  • steps that are specific to a given EC2 instance: configuring IP addresses.

These scripts should be idempotent: copy configurations from /ops/shared to their destinations where the services expect them to be, rather than moving them.