f0ced87b95
fixed all spelling mistakes for goreport
2017-08-07 17:13:05 -04:00
5e98c3ce95
Expose FSM errors into deployment watcher and API
...
This PR exposes errors returned by the FSM to the deployment watcher and
thus the API. It also adds an error to handle the case of promoting a
deployment that has no eligible canaries.
2017-07-25 16:23:22 -07:00
311084c724
Allow the deployment to not exist and just no-op
2017-07-17 14:09:59 -07:00
3a29b38108
Status description shows requiring promotion
2017-07-07 12:12:48 -07:00
08bf34f9a3
Fix JobModifyIndex changing when job is marked stable
2017-07-07 12:12:48 -07:00
de54ffd1f6
Deployment from inplace updates tracks placed properly.
2017-07-07 12:10:04 -07:00
a7fdc74bd4
feedback
2017-07-07 12:10:04 -07:00
5457bb7962
Job stability
2017-07-07 12:10:04 -07:00
d07a5a2008
Complete deployments mark jobs as stable
...
This PR allows jobs to be marked as stable automatically by a successful
deployment.
2017-07-07 12:10:04 -07:00
454083ba1b
Remove canary
2017-07-07 12:10:04 -07:00
c10d7ab871
Remove promoted bit from allocation
2017-07-07 12:10:04 -07:00
09dfa2fc10
Rename CreateDeployments and remove cancelling behavior in state_store
2017-07-07 12:10:04 -07:00
2e2fd26bed
Update index
2017-07-07 12:07:08 -07:00
ecee5e370e
initial watcher
2017-07-07 12:07:08 -07:00
e7034691ea
deployment status
2017-07-07 12:07:07 -07:00
b64185a3f1
Deployment GC
...
This PR implements the garbage collector for deployments. Deployments
will by default be garbage collected after 1 hour.
2017-07-07 12:05:57 -07:00
73325f888f
deployment api
2017-07-07 12:03:11 -07:00
dad9e69822
more comment fixes
2017-07-07 12:03:11 -07:00
c189948ad2
comments on watcher
2017-07-07 12:03:11 -07:00
87d187d777
Tests
2017-07-07 12:03:11 -07:00
6f821beec4
fix integration slightly
2017-07-07 12:03:11 -07:00
b4c8f56570
Deployment watcher tests
2017-07-07 12:03:11 -07:00
80dc4d66d8
Deployments list
2017-07-07 12:03:11 -07:00
eec3cefee4
state store tests
2017-07-07 12:03:11 -07:00
d04877d23c
initial impl
2017-07-07 12:03:11 -07:00
0d42b5d421
initial reconciler
2017-07-07 12:01:17 -07:00
8d3e13ab8a
System jobs without evals are running too
2017-07-03 13:48:51 -07:00
f7d2a74ddf
System jobs should be running until stopped
...
Prior to this commit they would be marked as dead if they had no
currently running allocations -- even though they would spring back to
life (running) if the cluster state changed such that a new eval+alloc
was created.
2017-06-28 11:39:24 -07:00
83f5e65aae
Plan allows updating the status of deployments
2017-05-11 12:49:04 -07:00
9a576bafd1
Use a detected struct to hold deployment status for an allocation
2017-05-11 11:09:29 -07:00
71788faacd
Easy feedback fixes
2017-05-10 15:26:00 -07:00
7078d563cb
Create Deployments through plan application
2017-05-05 15:33:19 -07:00
343ff03f02
Deployment struct, state store, fsm persist/restore
2017-05-04 13:37:18 -07:00
aed852782f
Merge pull request #2592 from hashicorp/b-gc-race
...
Protect against nil job in new allocation
2017-05-01 13:54:43 -07:00
efa91c3d89
Protect against nil job in new allocation
2017-04-26 18:27:27 -07:00
367f4b592f
docs
2017-04-20 11:14:06 -07:00
1b97c9abdd
Revert server endpoint
2017-04-20 11:14:06 -07:00
5a2449d236
Respond to review comments
2017-04-19 10:54:03 -07:00
1769fe468a
Fix some tests
2017-04-17 19:39:20 -07:00
34332af70e
GC and some fixes
2017-04-15 17:08:05 -07:00
3145086a42
non-purge deregisters
2017-04-15 17:08:05 -07:00
fda44689b7
Histories -> Versions
2017-04-15 17:08:05 -07:00
f97664512b
Upsert Job Histories
2017-04-15 17:08:05 -07:00
d489ed3c7d
Job History schema
2017-04-15 17:08:05 -07:00
787be30f13
Fix periodic job state
...
This PR fixes an issue in which a periodic job would incorrectly
transistion to status dead.
Fixes https://github.com/hashicorp/nomad/issues/2268
2017-03-27 10:35:36 -07:00
5be806a3df
Fix vet script and fix vet problems
...
This PR fixes our vet script and fixes all the missed vet changes.
It also fixes pointers being printed in `nomad stop <job>` and `nomad
node-status <node>`.
2017-02-27 16:00:19 -08:00
21ef1ce685
Add guard
2017-02-10 16:29:28 -08:00
5d293c0f1e
Add abandon tests and use snapshot for blocking queries
2017-02-08 11:18:03 -08:00
36d018514b
Fix test
2017-02-07 11:35:38 -08:00
bc2e6b0cc2
Fix state store tests
2017-02-06 16:46:23 -08:00
c026a97ce7
Use watchset on getter methods
2017-02-05 12:45:57 -08:00
570efcaebd
Update state store and blocking query helper
2017-02-05 12:03:11 -08:00
7f9c6466d4
Disallow GC of parameterized jobs
...
This PR makes it so parameterized jobs do not get garbage collected and
adds a test.
2017-01-26 11:57:32 -08:00
1f7b5b4b47
Rename Constructor -> Parameterized Job
2017-01-20 12:43:10 -08:00
a616e9d970
Merge pull request #2163 from hashicorp/b-summary
...
Job Summary: Fix queued accounting and remove in-place state store updates
2017-01-11 13:36:36 -08:00
efbb2894c7
Review fixes
2017-01-11 13:18:36 -08:00
0f046b179a
Merge pull request #2155 from hashicorp/f-cancel
...
Cancel blocked evals upon successful one for job
2017-01-11 13:10:35 -08:00
d0f918495b
Store pointer of JobSummary in state store and remove in-place modifications of the object and replace with Copy-Update-Insert operations
2017-01-08 13:55:03 -08:00
8d5f0fea69
Merge pull request #2128 from hashicorp/f-dispatch
...
Nomad Constructor Jobs and Dispatch
2017-01-06 05:22:49 +08:00
86980e08f0
Cancel blocked evals upon successful one for job
...
This PR causes blocked evaluations to be cancelled if there is a
subsequent successful evaluation for the job. This fixes UX problems
showing failed placements when there are not any in reality and makes GC
possible for these jobs in certain cases.
Fixes https://github.com/hashicorp/nomad/issues/2124
2017-01-04 16:16:04 -08:00
9786708526
Added comments
2016-12-19 18:10:02 -08:00
2761e1d8ea
fix tests
2016-12-16 10:21:56 -08:00
bf1e157bd8
Children fixes + nomad status outputs summaries
...
Children object is always initialized instead of lazily.
`nomad status` outputs children summaries and has specialized view for
constructor jobs.
2016-12-14 16:58:54 -08:00
4a5c3c8db0
Rename structs
2016-12-14 14:28:43 -08:00
1235fc6581
summary tests
2016-12-13 16:15:40 -08:00
af2865ea48
Don't modify jobs status inplace
2016-12-12 11:42:47 -08:00
8885ab70a6
Handle the delete case
2016-12-06 20:15:10 -08:00
ef79e77e52
Children summary
2016-12-06 17:06:57 -08:00
c005fcb973
Add structs
2016-12-05 17:24:37 -08:00
5191b4d33a
Making the status command return the allocs of currently registered job
2016-11-24 16:31:30 +01:00
56ed1d3cd8
Fixing the upgrade path for ephemeral disk
2016-11-08 15:24:51 -08:00
df4398beac
Implement blocking queries for /v1/job/evaluations
2016-10-29 17:30:34 -07:00
1b3c5e98c8
Renaming LocalDisk to EphemeralDisk ( #1710 )
...
Renaming LocalDisk to EphemeralDisk
2016-09-14 15:43:42 -07:00
6028682ad2
Adding LocalDisk to alloc.Job
2016-09-01 17:41:50 -07:00
3c9936ae4a
Merge pull request #1659 from hashicorp/f-revoke-accessors
...
Token revocation and keeping only a single Vault client active among servers
2016-08-31 14:10:46 -07:00
bfee7b30a3
Introducing shared resources in alloc
2016-08-29 13:49:25 -07:00
48696ba0cc
Use tomb to shutdown
...
Token revocation
Remove from the statestore
Revoke tokens
Don't error when Vault is disabled as this could cause issue if the operator ever goes from enabled to disabled
update server interface to allow enable/disable and config loading
test the new functions
Leader revoke
Use active
2016-08-28 14:06:25 -07:00
13497913f9
Ensuring resources are re-calculated properly in fsm
2016-08-26 20:13:11 -07:00
2f681b6415
Added copy method to LocalDisk
2016-08-26 14:24:47 -05:00
3447658bba
Added scheduler tests to ensure disk constraints are honored
2016-08-25 15:31:56 -05:00
ffaf6c6299
Fixed some tests
2016-08-25 13:56:39 -05:00
8105613c25
Added an upgrade path for existing jobs with no local disk
2016-08-25 13:00:20 -05:00
901000f789
Raft message, fsm and state store table
2016-08-19 16:40:37 -07:00
6dc5b1972c
Setting job's create index as summary create index during reconciliation
2016-08-04 15:14:01 -07:00
2fb67fefb5
Merge pull request #1516 from hashicorp/f-lost-state-sched
...
Make scheduler mark allocations as lost
2016-08-04 11:36:02 -07:00
88d383c47f
Updated tests and comments
2016-08-04 11:29:36 -07:00
c24e8ba7d8
Not updating summary if job is de-registered
2016-08-03 17:00:08 -07:00
74caed0c7a
Added an endpoint for users to reconcile job summaries
2016-08-03 16:12:47 -07:00
ac3328e812
Make scheduler mark allocations as lost
2016-08-03 15:57:46 -07:00
1b60e0823a
Added a test for restoring the summaries in fsm
2016-08-03 11:58:36 -07:00
4197e62e78
Remove old way of marking lost
2016-08-03 11:20:56 -07:00
b95cf91ee3
using the job associated with the alloc to determine if job is present
2016-08-02 19:14:05 -07:00
6f8c40fca7
Not updating summary if create index of summary not same as job's create index
2016-08-02 18:59:45 -07:00
b2d388bcba
Merge pull request #1508 from hashicorp/b-dont-update-job
...
Do not update the job of allocations that are being stopped
2016-08-02 18:58:39 -07:00
2332a58944
Do not update the job of allocations that are being stopped
2016-08-02 17:53:31 -07:00
87fdeb5393
Updated the logic to update job summary
2016-08-02 16:08:20 -07:00
3966a46996
Updating the summary after we have updated the current allocation when client updates the alloc
2016-08-02 15:06:39 -07:00
92e32e46f1
Updating the summary after we have updated the current allocation
2016-08-02 14:59:41 -07:00
3aa4f39094
Checking if a job is nil before updating the allocation
2016-08-01 17:05:48 -07:00
b69b7129a6
Using the parnet transaction to query the allocation while updating summary
2016-08-01 16:46:05 -07:00
b0e1f02e26
Not updating job summaries if jobs are not present
2016-07-28 15:24:27 -07:00
0dd8a84de0
Marking the desired state of an allocation as stop if the node on which it runs disconnects
2016-07-27 17:07:08 -07:00
b857d7c6c1
Copying job summary before mutating it
2016-07-27 14:46:46 -07:00
1bab053490
Updated some tests
2016-07-26 15:11:48 -07:00
5bded8d54d
Setting the right indexes while creating Job Summary
2016-07-25 17:51:20 -07:00
3089833397
Reconciling the queued allocations during restore
2016-07-25 17:31:40 -07:00
6193529040
Fixed more tests
2016-07-25 17:31:40 -07:00
f1c9427c37
Added code to create missing job summaries
2016-07-25 17:26:38 -07:00
dabb83063b
Review comments
2016-07-25 17:26:38 -07:00
50842b88c7
Fixed some bugs
2016-07-25 17:26:38 -07:00
1405687a88
Fixed some error messages and conditions
2016-07-25 17:26:38 -07:00
7bafb7c675
Updating the job summary while mutating jobs and allocation objects
2016-07-25 17:26:38 -07:00
109b05cb29
Applying changes to job updates via FSM
2016-07-25 17:26:38 -07:00
affbf5b6e4
Updating the job summary table only if an evaluation has any Queued Allocations
2016-07-25 17:26:38 -07:00
2ff2acbfc0
Added the job summary related endpoints
2016-07-25 17:26:38 -07:00
1cc0bc392b
Setting the number of queued allocations per task group
2016-07-25 17:26:38 -07:00
e0114fee05
InitFields to Canonicalize
2016-07-20 16:08:52 -07:00
e35369ec83
Fixed typos in comments
2016-07-13 13:25:07 -06:00
487c66b84d
Removing the queued state of Job Summary and alloc desired status false
2016-07-13 13:20:46 -06:00
daa83a4f3e
Renamed jobsummary to job_summary
2016-07-12 16:00:35 -06:00
5d782abd50
Refactored the test
2016-07-12 14:37:51 -06:00
00b9b4c6e8
Accounting lost state of allocations
2016-07-12 14:27:45 -06:00
e8d1aee3f4
Added a method for listing jobs whose id matches a prefix
2016-07-12 11:41:13 -06:00
313d7aa7f5
Added a test to ensure client alloc updates are happening properly
2016-07-12 11:41:13 -06:00
91b828d299
Updated logic to handle change in desired status of allocation when client status is still pending
2016-07-12 11:41:13 -06:00
6937c0f7f3
Added test for job summary restore
2016-07-12 11:41:13 -06:00
5e6f9ef69e
Added methods to save and restore job summary snapshots
2016-07-12 11:41:13 -06:00
ba71757dfb
handled the logic of task group count going up
2016-07-12 11:41:13 -06:00
67953b1583
Added a test to ensure correctness of job summary when client updates alloc
2016-07-12 11:41:13 -06:00
837b70f285
Added test to make sure summary gets deleted when job gets deleted
2016-07-12 11:41:13 -06:00
0606840080
Implemented logic to update the job summary when allocs are inserted
2016-07-12 11:41:13 -06:00
083f81d17f
Implemented job state accounting logic for upsert job
2016-07-12 11:41:13 -06:00
ebf9fbf1d6
Added a schema for summarizing status of jobs
2016-07-12 11:41:13 -06:00
4ea9ceee38
Handling allocations with client state pending
2016-07-12 11:29:23 -06:00
2cf2ed6758
Changing the state of an allocation to lost if the node on which it was running was marked as down
2016-07-11 18:24:04 -06:00
ec77a1869e
Test for errors
2016-06-16 14:43:46 -07:00
15936822a4
Worker annotates evals with their snapshot index
2016-05-24 20:10:56 -07:00
47390c5186
remove the GC field on the job and use the job type
2016-03-23 18:02:01 -07:00
ad92e50a24
Avoid serializes Allocation.Resources
2016-03-01 14:09:25 -08:00
4c4581a07e
nomad/state: Allow UpdateAllocFromClient to take multiple allocs
2016-02-21 17:49:46 -08:00
abf7e52689
nomad: adding compound index on alloc terminal status
2016-02-20 11:24:06 -08:00
2d98c0eadd
Fix double pull with introduction of AllocModifyIndex
2016-02-01 15:43:59 -08:00
91a9f2c4ce
Shorten CLI identifiers
...
* Truncate all UUID identifiers to eight characters by default
* Refactor the node identifier to an auto-generated UUID
* Created and updated tests and mocks
2016-01-14 21:57:43 +01:00
41efdcb1c3
Add JobModifyIndex
2016-01-12 09:50:33 -08:00
62a820196f
Address comments
2016-01-11 17:48:32 -08:00
9f4ec35f43
Set job status in state store
2016-01-11 17:48:32 -08:00
596938014e
Fix test (due to merge)
2015-12-24 21:23:05 +01:00
fd177f4c6f
Bring up-to-date with master
2015-12-24 21:16:32 +01:00
68506c7163
Remove parent index
2015-12-23 18:26:39 -08:00
d073285982
use conditional index
2015-12-23 18:26:39 -08:00
49dd0dc461
fixes from review
2015-12-23 18:26:39 -08:00
0a8c49f36b
Remove incorrect comment
2015-12-23 18:26:39 -08:00
37c1f56921
Snapshot and restore
2015-12-23 18:26:39 -08:00
ea799b88cb
merge
2015-12-23 18:26:39 -08:00
9a7b363b94
Add periodic index to job table
2015-12-23 18:26:39 -08:00
670cc50a02
merge
2015-12-23 18:26:39 -08:00
7838b2a57c
Refactoring
...
* Reverted changes to get methods
* Added prefix query parameter
* Updated node status to use prefix based searching
* Fixed tests
* Removed truncation logic
2015-12-22 23:44:33 +01:00
33f73a1e8e
Short identifiers functionality
...
* Use go-memdb prefix indexer for lookups
* Add Job lookups
* Update state store with new ByIDPrefix get methods
* Call new methods when exact lookup fails or is not applicable
2015-12-19 21:55:28 +01:00
1d294df9ec
Bring up-to-date with master
2015-12-19 21:55:10 +01:00
e2193c5c81
Merge pull request #586 from hashicorp/f-job-gc
...
Add garbage collection to jobs
2015-12-18 11:21:50 -08:00
fa71d95a8f
Copy the task states from the client update
2015-12-17 15:33:57 -08:00
f1d88bdf86
Remove user-specifiable gc threshold
2015-12-16 15:00:45 -08:00
2218a79815
Add garbage collection to jobs
2015-12-16 15:00:45 -08:00
acbbaf3e78
Allow lookups based on short identifiers
...
This change introduces the ability to specify identifiers for jobs,
allocs, evals and nodes on the command line with as little as one
character, provided that it uniquely identifies the resource. An error
with the possible results will be provided when the short identifier
has multiple results.
2015-12-12 18:28:20 +01:00
b54309282f
nomad/state: subscribe/unsubscribe all watch items while holding the lock
2015-10-30 08:46:03 -07:00
d21c49dedd
nomad: cleanup and more tests
2015-10-30 08:27:47 -07:00
1322b844ca
nomad/state: add watch trigger tests
2015-10-29 21:42:41 -07:00
55cb559eae
nomad: support blocking queries on eval-specific allocations
2015-10-29 16:20:57 -07:00
a0e54d6f62
nomad: support blocking queries on job allocations
2015-10-29 15:32:05 -07:00
6b7ca19a76
nomad: export watcher to share between rpc and state store
2015-10-29 14:47:39 -07:00
f5f01e6cd2
nomad: add triggering for more types of events
2015-10-29 13:52:15 -07:00
526c1c959b
nomad: move state watcher into its own file, add tests
2015-10-29 13:21:25 -07:00
eaeec03e1e
nomad: deduplicate watch items with a helper
2015-10-29 12:09:09 -07:00
a4ee8929e3
nomad: unify watcher inputs for reusability
2015-10-29 11:59:15 -07:00
692e4e371a
nomad: support full table watches for allocations
2015-10-28 19:25:39 -07:00
4e70d52e29
nomad: support blocking queries on eval list
2015-10-28 18:34:56 -07:00
07b6597353
nomad/state: move methods so we can sanely find them
2015-10-28 18:11:55 -07:00
2c4735fbcf
nomad: support blocking queries on nodes
2015-10-28 11:25:35 -07:00
04dcd3f440
nomad: use a generic full-table watcher
2015-10-28 11:15:54 -07:00
ee44b43f33
nomad: initial pass at blocking queries for jobs
2015-10-27 17:58:04 -07:00
25c2c83d6f
Revert "dont hard code scheduler type name"
...
This reverts commit fb0e0dfc2be596ad435a00a2e131a2000146b1f1.
2015-10-23 16:32:45 -07:00
5b0a9b2469
dont hard code scheduler type name
2015-10-23 16:31:45 -07:00
2314bd7c2c
Add scheduler type index to jobs table; create evals for system jobs on node init to ready transition
2015-10-20 10:57:53 -07:00
5b02014e14
state: cleanup Get*By
2015-09-06 20:51:01 -07:00
8e3a98af58
state: remove unused indexes
2015-09-06 20:49:07 -07:00
b42742bf8f
state: unify the terminology for code clarity
2015-09-06 20:39:06 -07:00
82cba83eb6
state: Adding UpdateNodeDrain
2015-09-06 19:51:50 -07:00
b1a406f234
state: Adding eval lookup by job
2015-09-06 12:10:24 -07:00
922eb37484
nomad: adding UpdateAllocFromClient for client based updates
2015-08-25 17:54:45 -07:00
28069dd973
nomad: updating state for split
2015-08-25 16:26:34 -07:00
c362ca0ffd
nomad/state: adding watching mechanisms
2015-08-22 18:57:15 -07:00
f04e2b81ba
nomad: adding evicted state for allocs
2015-08-22 18:30:49 -07:00
a80249204f
nomad: DeleteEval request can take a list of evals and allocations
2015-08-15 15:39:29 -07:00
da90c453ce
nomad: adding index on EvalID and Status to alloc
2015-08-15 13:27:42 -07:00
3f16a21658
nomad: remove NodesByDatacenterStatus
2015-08-15 13:11:42 -07:00
a077605114
nomad: adding NodesByDatacenterStatus
2015-08-13 13:17:03 -07:00
343b1b9c89
nomad: move state and mocks into shared packages
2015-08-11 14:27:14 -07:00
Luke Farnell