Commit graph

16199 commits

Author SHA1 Message Date
Mahmood Ali 6cefd8f97e tests: attempt to fix TestAutopilot_CleanupStaleRaftServer
Also add a utility function for waiting for stable leadership
2019-09-04 08:49:33 -04:00
Mahmood Ali 035a7a94d9 tests: update time sensitive tests
Fix tests whose messages seem timing dependent.
2019-09-04 08:45:25 -04:00
Mahmood Ali 0beb757b6f tests: disable server auto join by default
Tests typically call join cluster directly rather than rely on consul
discovery.  Worse, consul discovery seems to cause additional leadership
transitions when a server is shutdown in tests than tests expect.
2019-09-04 07:54:54 -04:00
Mahmood Ali 3e2ab6e2a3 address review feedback 2019-09-03 21:44:39 -04:00
Mahmood Ali 0a6d73020c use current nomad version in testing 2019-09-03 21:42:41 -04:00
Mahmood Ali 4da27c24ee
Merge pull request #6253 from hashicorp/docs-task-driver-security
docs: task driver resource isolation & security
2019-09-03 20:39:21 -04:00
Mahmood Ali 277e358489
keep security-related together 2019-09-03 20:38:32 -04:00
Jamie Finnigan d4c9e1028f docs: task driver resource isolation & security 2019-09-03 15:19:46 -07:00
Tim Gross 0f29dcc935
support script checks for task group services (#6197)
In Nomad prior to Consul Connect, all Consul checks work the same
except for Script checks. Because the Task being checked is running in
its own container namespaces, the check is executed by Nomad in the
Task's context. If the Script check passes, Nomad uses the TTL check
feature of Consul to update the check status. This means in order to
run a Script check, we need to know what Task to execute it in.

To support Consul Connect, we need Group Services, and these need to
be registered in Consul along with their checks. We could push the
Service down into the Task, but this doesn't work if someone wants to
associate a service with a task's ports, but do script checks in
another task in the allocation.

Because Nomad is handling the Script check and not Consul anyways,
this moves the script check handling into the task runner so that the
task runner can own the script check's configuration and
lifecycle. This will allow us to pass the group service check
configuration down into a task without associating the service itself
with the task.

When tasks are checked for script checks, we walk back through their
task group to see if there are script checks associated with the
task. If so, we'll spin off script check tasklets for them. The
group-level service and any restart behaviors it needs are entirely
encapsulated within the group service hook.
2019-09-03 15:09:04 -04:00
Mahmood Ali 9bd56587cd Fix raft tests
Wait until leadership stabalizes and all non-voters get promoted before
killing leader
2019-09-03 14:53:29 -04:00
Michael Schurter 8fe42fccb0
Merge pull request #6000 from Iqoqo/docker-convert-host-paths-to-host-native
driver/docker: convert host bind path to os native
2019-09-03 09:34:56 -07:00
Pete Woods 49b7d23cea Add node "status" and "scheduling eligibility" tags to client metrics (#6130)
When summing up the capability of your Nomad fleet for scaling purposes, it's important to exclude draining nodes, as they won't accept new jobs.
2019-09-03 12:11:11 -04:00
Michael Schurter 5957030d18
connect: add unix socket to proxy grpc for envoy (#6232)
* connect: add unix socket to proxy grpc for envoy

Fixes #6124

Implement a L4 proxy from a unix socket inside a network namespace to
Consul's gRPC endpoint on the host. This allows Envoy to connect to
Consul's xDS configuration API.

* connect: pointer receiver on structs with mutexes

* connect: warn on all proxy errors
2019-09-03 08:43:38 -07:00
Mahmood Ali 41102260ed ignore nested pkgs in GOTEST_PKGS_EXCLUDE
This fixes a bug where some packages tests run twice in CI, because they
are subpackages of ones with dedicated jobs.  For example, notice
`client/allocrunner` tests ran in `test-client`[1] and `test-other`[2] despite
them being in the same workflow[3].

[1] https://circleci.com/gh/hashicorp/nomad/5262
[2] https://circleci.com/gh/hashicorp/nomad/5261
[3] https://circleci.com/workflow-run/ee7a9167-8fc7-49a5-897c-6c967e966014
2019-09-03 11:04:27 -04:00
Mahmood Ali 0f401e6b8b lint: ignore generated windows syscall wrappers 2019-09-03 10:59:58 -04:00
Mahmood Ali dfa432eb06 lint: ignore protobuf generated code 2019-09-03 10:59:11 -04:00
Danielle 0849102f11
Merge pull request #6246 from hashicorp/dani/fix-docker-driver
docker: Fix driver spec
2019-09-03 14:19:12 +02:00
Danielle Lancashire 724586ba1d
docker: Fix driver spec
hclspec.NewLiteral does not quote its values, which caused `3m` to be
parsed as a nonsensical literal which broke the plugin loader during
initialization. By quoting the value here, it starts correctly.
2019-09-03 08:53:37 +02:00
Jasmine Dahilig 4edebe389a
add default update stanza and max_parallel=0 disables deployments (#6191) 2019-09-02 10:30:09 -07:00
Danielle 9fbf436e65
Merge pull request #6078 from zhiguangwang/fix-docker-image-delay-default-value
Add default value "3m" to image_delay, making it consistent with docs.
2019-09-02 15:39:51 +02:00
Danielle 41d86750c2
Merge pull request #6240 from EvanErcolano/remove-unused-param-consul-client
Remove unused canary param from MakeTaskServiceID
2019-09-02 12:38:08 +02:00
Zhiguang Wang 832df1091b Add default value "3m" to image_delay, making it consistent with docs. 2019-09-02 16:40:00 +08:00
Danielle fe027f3fd5
Merge pull request #6210 from hashicorp/f-update-node-response
docs: Update /v1/node/{node-id} example response
2019-09-01 19:17:30 +02:00
Danielle dfe1fc5c7d
Merge pull request #6119 from rlewkowicz/master
bumped hadoop version
2019-09-01 08:41:51 +02:00
Danielle 857c85b25b
Merge pull request #6208 from pcgeek86/patch-1
Update AWS logo to current version
2019-09-01 08:41:23 +02:00
Evan Ercolano fcf66918d0 Remove unused canary param from MakeTaskServiceID 2019-08-31 16:53:23 -04:00
Danielle Lancashire d970d5ee00
ci: Support non amd64 architectures 2019-08-31 18:34:22 +02:00
Danielle Lancashire 4fcb7394e9
client: Fix memory fingerprinting on 32bit
Also introduce regression ci for 32 bit fingerprinting
2019-08-31 18:33:59 +02:00
Danielle 4da16eb44a
Merge pull request #6238 from hashicorp/e2e-ami-filters
e2e: filter default AMI by OS
2019-08-31 13:34:36 +02:00
Danielle b14436cd14
Merge pull request #6233 from hashicorp/chore/more-circle
ci: Migrate remaining jobs to CircleCI
2019-08-31 13:28:51 +02:00
Preetha eba025f35d
Merge pull request #6237 from hashicorp/f-rkt-deprecated
rkt deprecation notice
2019-08-30 16:45:40 -05:00
Tim Gross 7ee3333a2d e2e: filter default AMI by OS
Add an OS tag to Packer builds of our e2e test AMIs and then filters
by this in Terraform.
2019-08-30 16:51:13 -04:00
Preetha Appan 4ebe5e3daf
fix casing 2019-08-30 15:31:28 -05:00
Lang Martin ed51d37095 CHANGELOG go-getter upgrade 2019-08-30 16:22:34 -04:00
Michael Schurter 4bd53deba9
Merge pull request #6236 from hashicorp/b-ignore-connect-services
consul: ignore connect services when syncing
2019-08-30 13:11:09 -07:00
Preetha Appan 284ec935ea
Wording changes 2019-08-30 14:36:08 -05:00
Michael Schurter 67b7bc1e90 consul: ignore connect services when syncing
Consul registers Connect services automatically, however Nomad thinks it
owns them due to the _nomad prefix. Since the services are managed by
Consul, Nomad needs to explicitly ignore them or otherwies they will be
removed.
2019-08-30 11:53:41 -07:00
Tim Gross 3ac3ceb2cc test: add NOMAD_TEST_LOG_LEVEL env var to tune log levels 2019-08-30 13:25:36 -04:00
Charlie Voiselle bbeb18ddbb Added vault PKI example with separate cert files 2019-08-30 11:24:34 -04:00
Tim Gross b79021adfd cli: split -dev and -dev-connect flags 2019-08-30 09:33:30 -04:00
Danielle Lancashire bc198d9328
chore: Remove unused travis scripts 2019-08-30 13:51:05 +02:00
Danielle Lancashire 67488e2b19
ci: Migrate remaining jobs to CircleCI 2019-08-30 13:44:23 +02:00
Danielle Lancashire f7b55bd965
chore: Update changelog 2019-08-30 13:31:01 +02:00
Danielle 7d3cc532d9
Merge pull request #6228 from hashicorp/chore/remove-go-travis
chore: Remove Go Tests from Travis
2019-08-30 09:09:20 +02:00
Mahmood Ali 11b9212673
Merge pull request #6226 from hashicorp/b-defensive-rawexec
raw_exec: be defensive when disabled
2019-08-29 21:19:05 -04:00
Mahmood Ali f98d4ee3f1 tests: enable raw_exec driver 2019-08-29 20:26:50 -04:00
Buck Doyle c1310a48c6 Update recent entries with consistent tenses 2019-08-29 17:36:21 -05:00
Preetha Appan c8f5130978
Deprecation notice for rkt 2019-08-29 13:38:12 -05:00
Tim Gross 2df7bac630 ci: require Consul 1.6.0 2019-08-29 14:15:56 -04:00
Tim Gross aa12b87ac2 dev: bump vagrant consul version to match CI 2019-08-29 14:15:56 -04:00