Commit graph

15080 commits

Author SHA1 Message Date
Yishan Lin 3e42c4067c Fixed link for Installing Nomad for Production 2019-04-30 13:39:32 -07:00
Lang Martin 9cf1c5a74d
Merge pull request #5581 from hashicorp/dev-make-boostrap-git-hooks
Dev make boostrap git hooks
2019-04-30 16:36:10 -04:00
Yishan Lin 9dcbeebbe1 Added Gitter to Resources + revised Overview for consistency. 2019-04-30 12:01:53 -07:00
Mahmood Ali c5150f81dd
Merge pull request #5621 from hashicorp/r-release-preflight
Update release/dist script with preflight
2019-04-30 14:52:03 -04:00
Mahmood Ali f47d3d5f8a add nomad streaming exec core data structures and interfaces
In this commit, we add two driver interfaces for supporting `nomad exec`
invocation:

* A high level `ExecTaskStreamingDriver`, that operates on io reader/writers.
  Drivers should prefer using this interface
* A low level `ExecTaskStreamingRawDriver` that operates on the raw stream of
  input structs; useful when a driver delegates handling to driver backend (e.g.
  across RPC/grpc).

The interfaces are optional for a driver, as `nomad exec` support is opt-in.
Existing drivers continue to compile without exec support, until their
maintainer add such support.

Furthermore, we create protobuf structures to represent exec stream entities:
`ExecTaskStreamingRequest` and `ExecTaskStreamingResponse`.  We aim to reuse the
protobuf generated code as much as possible, without translation to avoid
conversion overhead.

`ExecTaskStream` abstract fetching and sending stream entities.  It's influenced
by the grpc bi-directional stream interface, to avoid needing any adapter.  I
considered using channels, but the asynchronisity and concurrency makes buffer
reuse too complicated, which would put more pressure on GC and slows exec operation.
2019-04-30 14:02:29 -04:00
Mahmood Ali 40e62a6f17 Add ACL capabilities for nomad exec
This adds `alloc-exec` capability to allow operator to execute command into a
running task.  Furthermore, it adds `alloc-node-exec` capability, required when
the alloc task is raw_exec or a driver with no FSIsolation.
2019-04-30 14:02:16 -04:00
Mahmood Ali 7131ac3eef drivers/mock: extract command related operations
Extract command parsing and execution mocking into a separate struct.  Also,
allow mocking of different fs_isolation for testing.
2019-04-30 14:02:16 -04:00
Chris Baker a40477a7b8
test case for 5540 (#5590)
* client/metrics: modified metrics to use (updated) client copy of allocation instead of (unupdated) server copy

* updated armon/go-metrics to address race condition in DisplayMetrics
2019-04-30 10:31:35 -04:00
Lang Martin 2e643d26a2 config_parse leave the *HCL strings in place after converting times 2019-04-30 10:30:53 -04:00
Lang Martin 3ba6095fe3 config_parse_test additional config confirmation w/ sample json 2019-04-30 10:30:53 -04:00
Lang Martin fe9b31dcf9 config comment for future changes 2019-04-30 10:30:53 -04:00
Lang Martin 7e0e9b1ec1 govendor fetch github.com/hashicorp/hcl@99e2f22 2019-04-30 10:30:12 -04:00
Lang Martin 598112a1cc tag HCL bookkeeping keys with json:"-" to keep them out of the api 2019-04-30 10:29:14 -04:00
Lang Martin 43407cffe3 config_parse_test remove redundant parse direct test 2019-04-30 10:29:14 -04:00
Lang Martin b8e9c35cd0 config_parse remove unused multi-stage parsing via mapstructure 2019-04-30 10:29:14 -04:00
Lang Martin 1f86770456 config_parse_test test direct hcl parsing 2019-04-30 10:29:14 -04:00
Lang Martin 5ebae65d1a agent/config, config/* mapstructure tags -> hcl tags 2019-04-30 10:29:14 -04:00
Lang Martin 92fd988c9f config_parse add new ParseConfigFileDirectHCL
- parse by using hcl.Decode directly
- handle time.Duration strings in a second pass
- report unexpected keys in a third pass
2019-04-30 10:29:14 -04:00
Mahmood Ali fc72fff0ed test helper for registering jobs with acl
Test helper that allows registration of jobs when ACL is activated.
2019-04-30 10:23:56 -04:00
Mahmood Ali 446f06721d aux: helper method that returns token as well as ACL policy
This helper returns the token as well as the ACL policy, to be used in a later
commit for logging the token info associated with nomad exec invocation.
2019-04-30 10:23:56 -04:00
Charlie Voiselle 4c2dd47ddb
Merge pull request #5630 from jweissig/patch-5
Fixed typo
2019-04-30 08:59:16 -04:00
Mahmood Ali b18c748c41 update 0.9.1 changelog 2019-04-30 07:48:00 -04:00
Danielle 03762458ed
Merge pull request #5614 from hashicorp/dani/we-released-a-hotfix
Update CHANGELOG and version.go to reflect 0.9.1/0.9.2 split
2019-04-30 10:35:22 +02:00
Danielle Lancashire ee97edc065 Update master to reflect 0.9.1/0.9.2 split 2019-04-30 10:33:41 +02:00
Justin Weissig 4e017f5ed1
Fixed typo
Fixed typo: "dots wil be"/"dots will be".
2019-04-30 00:04:17 -07:00
Preetha Appan 6615d5c868
Add config to disable preemption for batch/service jobs 2019-04-29 18:48:07 -05:00
Yishan Lin d00da5b827
Merge pull request #5618 from hashicorp/yishan/revised-readme
yishan/revised readme
2019-04-29 15:46:20 -07:00
Yishan Lin f96866f7ee Addressed Dani's comments. 2019-04-29 10:22:27 -07:00
Preetha Appan 78c3e55198
Update 0.9.1 links in website 2019-04-29 11:46:50 -05:00
Danielle 6249f2864f
Merge pull request #5623 from jweissig/patch-4
Fixed Typo
2019-04-29 10:25:45 +02:00
Justin Weissig 1c71ffa9dc
Fixed Typo
Fixed typo: scheduilng/scheduling.
2019-04-29 00:41:53 -07:00
Mahmood Ali c80de35bbe Update release/dist script with preflight
Add a preflight check to ensure that AWS credentials is configured
before creating tag.
2019-04-28 16:31:07 -04:00
Mahmood Ali 23474c5568
Merge pull request #5622 from hashicorp/b-divest-api-20190427
divest /api from rest of nomad internal packages
2019-04-28 16:24:08 -04:00
Mahmood Ali f920efb962 divest /api from nomad/structs
The API package needs to be independent from rest of nomad packages, to
avoid leaking internal packages and dependencies (e.g. raft, ugorji,
etc)
2019-04-28 13:32:26 -04:00
Mahmood Ali 64a45e0e1e check that /api doesn't import internal nomad pkgs 2019-04-28 13:32:26 -04:00
Lang Martin da91b14c90 CHANGELOG.md add fix line for #2619 2019-04-26 16:33:17 -04:00
Yishan Lin 3476b45f42 Update README.md 2019-04-26 11:48:45 -07:00
Yishan Lin a9fb32fa35 Update README.md 2019-04-26 11:48:13 -07:00
Yishan Lin d8d18b1b29 Update README.md 2019-04-26 11:46:30 -07:00
Yishan Lin 752b78558e Reordered guide lists + formatting with users/content. 2019-04-26 11:45:43 -07:00
Yishan Lin 102f3e84cd updated hyperlinks. 2019-04-26 11:43:16 -07:00
Yishan Lin 77a7565218 Update README.md 2019-04-26 11:28:09 -07:00
Lang Martin 371014b781
Merge pull request #5553 from hashicorp/b-fingerprinter-manual-config
client fingerprinter doesn't overwrite manual configuration
2019-04-26 12:55:34 -04:00
Mahmood Ali b3fac6ef74
Merge pull request #5370 from hashicorp/f-windows-volume-binds
drivers/docker: Support volumes field in Windows
2019-04-26 10:12:42 -04:00
Danielle 6ff474cf90
Merge pull request #5612 from hashicorp/dani/alloc-signal-docs
Docs for `nomad alloc signal`
2019-04-26 14:21:23 +02:00
Danielle 79515496cb
Merge pull request #5515 from hashicorp/dani/f-alloc-signal
allocs: Add nomad alloc signal command
2019-04-26 14:21:05 +02:00
Danielle Lancashire a8880f9643 alloc_signal: Add autcompletion and cmd tests 2019-04-26 12:47:53 +02:00
Mahmood Ali 530d03c510
Merge pull request #5616 from hashicorp/b-retry-logmon-start-errs-2
logmon: recover from shutting down call locally
2019-04-25 21:42:09 -04:00
Mahmood Ali bf0a09e270 retry grpc unavailable errors even if not shutting down 2019-04-25 18:39:17 -04:00
Mahmood Ali 81841e8528 try checking process status 2019-04-25 18:16:13 -04:00