d04877d23c
initial impl
2017-07-07 12:03:11 -07:00
33318501b6
Backoff on Consul lookup failures
2017-04-19 12:42:47 -07:00
e204a287ed
Refactor Consul Syncer into new ServiceClient
...
Fixes #2478 #2474 #1995 #2294
The new client only handles agent and task service advertisement. Server
discovery is mostly unchanged.
The Nomad client agent now handles all Consul operations instead of the
executor handling task related operations. When upgrading from an
earlier version of Nomad existing executors will be told to deregister
from Consul so that the Nomad agent can re-register the task's services
and checks.
Drivers - other than qemu - now support an Exec method for executing
abritrary commands in a task's environment. This is used to implement
script checks.
Interfaces are used extensively to avoid interacting with Consul in
tests that don't assert any Consul related behavior.
2017-04-19 12:42:47 -07:00
a9c8b09da8
Push to configs
2017-04-14 15:24:55 -07:00
5be806a3df
Fix vet script and fix vet problems
...
This PR fixes our vet script and fixes all the missed vet changes.
It also fixes pointers being printed in `nomad stop <job>` and `nomad
node-status <node>`.
2017-02-27 16:00:19 -08:00
8bfc4255eb
Add server metrics
2017-02-14 16:02:18 -08:00
b1cd81e997
Remove todos
2017-02-10 15:41:23 -08:00
2d4d9b79d8
Operator command/endpoint/documentation
2017-02-09 18:04:46 -08:00
ae31f4c84e
Respond to comments
2017-02-08 14:50:19 -08:00
ee368762ae
It builds
2017-02-02 16:07:15 -08:00
26db1bd12c
Join + Leave peer
2017-02-02 15:49:06 -08:00
ac10aed731
Update setupRaft
2017-02-02 15:31:36 -08:00
78cfcd2724
Bump protocol version and update numOtherPeers
2017-02-02 13:52:31 -08:00
15ffdff497
Vault Client on Server handles SIGHUP
...
This PR allows the Vault client on the server to handle a SIGHUP. This
allows updating the Vault token and any other configuration without
downtime.
2017-02-01 14:24:10 -08:00
e927de02d2
Moved functions to helper from structs
2017-01-18 15:55:14 -08:00
1a8fa8c8d5
Making Nomad TLS configs region aware
2016-11-01 11:55:29 -07:00
7c61e115bd
Moved tlsutil into helpers
2016-10-25 16:05:37 -07:00
cf35aeac84
Moving the TLSConfig to structs
2016-10-25 15:57:38 -07:00
e03927bb5c
Changed the way TLS config is parsed
2016-10-24 13:56:19 -07:00
2e3118e69c
Implemented TLS support for http and rpc
2016-10-23 22:22:00 -07:00
0f6e0d10b6
Enable serf encryption ( #1791 )
...
* Added the keygen command
* Added support for gossip encryption
* Changed the URL for keyring management
* Fixed the cli
* Added some tests
* Added tests for keyring operations
* Added a test for removal of keys
* Added some docs
* Fixed some docs
* Added general options
2016-10-17 10:48:04 -07:00
48696ba0cc
Use tomb to shutdown
...
Token revocation
Remove from the statestore
Revoke tokens
Don't error when Vault is disabled as this could cause issue if the operator ever goes from enabled to disabled
update server interface to allow enable/disable and config loading
test the new functions
Leader revoke
Use active
2016-08-28 14:06:25 -07:00
713e310670
Renew loop
2016-08-17 16:25:38 -07:00
750a44b2c0
Create a Vault interface for the server
2016-08-17 16:25:38 -07:00
6e2f0a2776
Server has Vault API client
2016-08-17 16:25:38 -07:00
8bdb38d016
Code golf
...
Pointed out by: @dadgar
2016-06-21 14:26:01 -07:00
df4fe2e502
Fix the shuffling of remote datacenters.
...
Pointed out by: @ryanuber
2016-06-21 13:37:22 -07:00
46e2d54acf
Provide `nomad.Config` with a default `LogOutput` of `os.StdErr`
2016-06-17 06:44:10 -07:00
9a60999100
Pass a logger arg to `NewClient` and `NewServer`
2016-06-16 23:29:23 -07:00
7c24487850
Fix up various error handling
2016-06-16 14:40:09 -07:00
71cd9984ae
Immediately query Consul upon initialization if we have no peers.
...
Also don't attempt to join the Server with itself.
2016-06-16 14:27:10 -07:00
65319252b9
Rework `server_auto_join` to use a timer instead of the peer count.
...
It is perfectly viable for an admin to downsize a Nomad Server cluster
down to 1, 2, or `num % 2 == 0` (however ill-advised such activities
may be). And instead of using `bootstrap_expect`, use a timeout-based
strategy. If the `bootstrapFn` hasn't observed a leader in 15s it will
fall back to Consul and will poll every ~60s until it sees a leader.
2016-06-16 12:14:03 -07:00
b0fecbefc1
Define `BootstrapExepct` as an `int32` so it can be manipulated atomically.
2016-06-16 12:00:15 -07:00
5b0def194a
Namespace the log messages
2016-06-15 12:40:51 -07:00
bffc82d668
Do not consider the number of Serf members when considering falling back to Consul.
2016-06-15 12:40:51 -07:00
324af8d7f1
Guard the auto-join functionality behind its `consul.server_auto_join` tunable
2016-06-15 12:40:51 -07:00
5e0ced2ae7
Shuffle all datacenters vs only the nearest N datacenters.
...
Per discussion, we want to be aggressive about fanning out vs possibly
fixating on only local DCs. With RPC forwarding in place, a random walk
may be less optimal from a network latency perspective, but it is guaranteed
to eventually result in a converged state because all DCs are candidates
during the bootstrapping process.
2016-06-15 12:40:51 -07:00
2123460cf0
Bump various Consul search limits
...
Client: Search limit increased from 4 random DCs to 8 random DCs, plus nearest.
Server: Search factor increased from 3 to 5 times the bootstrap_expect.
This should allow for faster convergence in large environments (e.g.
sub-5min for 10K Consul DCs).
2016-06-15 12:40:51 -07:00
e8d1264dbc
Short-circuit the bootstrapFn if we have a leader
2016-06-15 12:40:51 -07:00
f05514335b
Teach Nomad servers how to fall back to Consul.
2016-06-15 12:40:51 -07:00
3d64daafd9
Fold RaftPeers() into its only call site now
2016-06-10 15:54:39 -04:00
bff57a0dce
Reconcile, clean up, and centralize API version numbers (major and minor).
...
Reduce future confusion by introducing a minor version that is gossiped out
via the `mvn` Serf tag (Minor Version Number, `vsn` is already being used for
to communicate `Major Version Number`).
Background: hashicorp/consul/issues/1346#issuecomment-151663152
2016-06-10 15:50:11 -04:00
d76c042a13
Invert error handling logic
2016-06-10 15:50:11 -04:00
89168b0c51
Invert check definition so the error is first
2016-06-10 15:50:11 -04:00
17116fc5a7
Rebalance Nomad client RPCs among different Nomad servers.
...
Implement client/rpc_proxy.RpcProxy.
2016-06-10 15:50:11 -04:00
49deaae2ae
Seed random once in main
2016-06-10 15:48:36 -04:00
dc28ab0cb5
Speling police
2016-05-15 09:41:34 -07:00
26d1b60369
Adding raft peers in agent info
2016-04-05 10:30:46 -07:00
d472dc2988
Adding the raft leader addr to server stats
2016-04-03 16:38:39 -07:00
bf74e2f790
display server leaders per region
2016-03-17 16:04:09 -07:00
7fc7cd9453
nomad: batch client updates for 50msec
2016-02-21 18:51:34 -08:00
143972b6d9
Job GC endpoint
2016-02-20 15:50:41 -08:00
25c5e543f4
Use crypto random seed
2016-02-17 11:47:02 -08:00
01cadf7cb0
Seed the servers random number generator
2016-02-16 19:40:02 -08:00
c55eb0816c
Address comments
2016-01-31 18:46:45 -08:00
74135f02a4
Blocked Eval tracker
2016-01-31 18:04:45 -08:00
80dd30b03d
Add force spawn endpoint
2016-01-13 10:19:53 -08:00
b3e87b6719
Remove the periodicRunner interface and pass the server as an interface to the periodicDispatcher
2015-12-23 18:26:39 -08:00
670cc50a02
merge
2015-12-23 18:26:39 -08:00
a892d61ae7
FSM integration
2015-12-23 18:26:39 -08:00
d983f266b0
nomad: sort regions before returning
2015-11-24 13:15:01 -08:00
39b2c3a07b
nomad: use a read-only lock
2015-11-23 22:27:07 -08:00
ad6b55a37a
nomad: support listing regions
2015-11-23 22:27:03 -08:00
b68c8404b1
nomad: remove noisy logs
2015-09-21 14:14:19 -07:00
da93d4a30f
Change error to err to be consistent with other usage
2015-09-11 10:26:33 -07:00
39feffd67f
Change debug to info
2015-09-11 10:24:52 -07:00
6ea318cacb
Change to use the logger instance defined earlier
2015-09-11 10:23:53 -07:00
3000ef07c1
Added logging to server startup so we can see where it fails
2015-09-11 10:20:36 -07:00
7d69aa78c1
nomad: using Raft StartAsLeader to make tests faster
2015-09-07 10:46:41 -07:00
0702f17989
Rename client endpoint to node endpoint
2015-09-06 20:31:32 -07:00
46cbe8285d
nomad: adding Alloc endpoint
2015-09-06 15:34:28 -07:00
4d6238ebb8
client: test updating alloc status
2015-08-29 14:22:24 -07:00
2ea99f211a
nomad: updating for new alloc representation
2015-08-25 17:36:52 -07:00
d4e2faf216
nomad: track the workers in the pool
2015-08-23 10:53:53 -07:00
3d48ff4c6f
nomad: no heartbeat for nodes in terminal status
2015-08-22 17:17:13 -07:00
40def1a187
nomad: expose RuntimeStats
2015-08-20 15:29:30 -07:00
c1d8ab0983
nomad: rename client endpoint struct
2015-08-16 17:40:35 -07:00
79a1471b85
nomad: add delivery limit to eval broker
2015-08-16 10:55:55 -07:00
aadecdd805
nomad: adding version API endpoint
2015-08-15 12:59:10 -07:00
8c2f8cddd0
nomad: create system scheduler as needed
2015-08-06 17:08:40 -07:00
5f1ebb9274
nomad: adding special 'system' scheduler
2015-08-06 17:04:35 -07:00
7cdcc45c64
nomad: cleanup stats goroutines
2015-08-05 16:45:50 -07:00
3c2a16038b
nomad: first pass adding scheduling workers
2015-07-28 15:12:08 -07:00
4be2c1b9db
nomad: adding plan endpoint
2015-07-27 15:31:49 -07:00
743c7f32ef
nomad: integrate plan queue
2015-07-27 15:11:42 -07:00
487acdd3c7
nomad: threading eval broker through fsm and state store
2015-07-23 22:30:08 -07:00
93b832cf59
nomad: emit metrics from the eval broker
2015-07-23 22:17:37 -07:00
fc11808fe9
nomad: add eval broker, configurable nack timeout
2015-07-23 21:44:17 -07:00
eff7170c77
nomad: adding RPC endpoints for fetching Eval
2015-07-23 16:00:19 -07:00
501a57f9d8
nomad: Adding the CRUD endpoints for jobs
2015-07-23 14:41:18 -07:00
5fdf3c5d33
nomad: adding Client endpoint
2015-06-07 12:14:41 -07:00
4f78d6a7e9
nomad: adding connection pool
2015-06-07 11:50:29 -07:00
ac6ed01a1c
nomad: track local peers
2015-06-07 11:32:01 -07:00
25aad83ea4
nomad: testing leader bridging of serf
2015-06-05 23:54:45 +02:00
c18c068bf2
nomad: testing remove peer
2015-06-04 13:02:39 +02:00
b456588d1c
nomad: adding reconcile channel
2015-06-04 12:42:56 +02:00
490fa1b7db
nomad: testing serf join
2015-06-04 12:33:12 +02:00
4f6ecce727
nomad: working on serf member parsing
2015-06-03 13:35:48 +02:00
a088a302e5
nomad: expose serf methods, add leave support
2015-06-03 13:25:50 +02:00
6ebfa2bed4
nomad: expose serf stats
2015-06-03 13:08:04 +02:00
e219bc1e71
nomad: adding Serf integration
2015-06-03 12:58:00 +02:00
d52122f041
nomad: more skeleton
2015-06-03 12:26:50 +02:00
bad4bfadc4
nomad: embed the state store to reduce duplication
2015-06-03 11:26:49 +02:00
4c554f14bb
nomad: support DevMode configuration
2015-06-01 21:11:40 +02:00
1e7f84f3e6
nomad: adding basic structure for raft
2015-06-01 17:49:10 +02:00
Alex Dadgar