luxolus
/
open-nomad
2
0
Fork 0
Code Issues 1 Pull Requests Packages Releases Wiki Activity

core: bump rejected plans from debug -> info 

As we have continued to see reports of #9506 we need to elevate this log
line as it is the only way to detect when plans are being *erroneously*
rejected.

Users who see this log line repeatedly should drain and restart the node
in the log line. This seems to workaorund the issue.

Please post any details on #9506!
This commit is contained in:
Michael Schurter 2021-10-31 12:18:02 -07:00
parent e151d93c9c
commit efe5714840
2 changed files with 10 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
.changelog/11416.txt Normal file
View File

@ -0,0 +1,3 @@
```release-note:improvement
core: Elevated rejected node plan log lines to help diagnose #9506
```

8
nomad/plan_apply.go
View File

@ -477,7 +477,13 @@ func evaluatePlanPlacements(pool *EvaluatePool, snap *state.StateSnapshot, plan
if !fit { if !fit {
// Log the reason why the node's allocations could not be made // Log the reason why the node's allocations could not be made
if reason != "" { if reason != "" {
logger.Debug("plan for node rejected", "node_id", nodeID, "reason", reason, "eval_id", plan.EvalID) //TODO This was debug level and should return
//to debug level in the future. However until
//https://github.com/hashicorp/nomad/issues/9506
//is resolved this log line is the only way to
//monitor the disagreement between workers and
//the plan applier.
logger.Info("plan for node rejected", "node_id", nodeID, "reason", reason, "eval_id", plan.EvalID)
} }
// Set that this is a partial commit // Set that this is a partial commit
partialCommit = true partialCommit = true