luxolus/open-nomad
2
0
Fork 0
Code Issues 1 Pull requests Packages Releases Wiki Activity
open-nomad/api
History
Mahmood Ali 050ad6b6f4
tests: deflake test-api job (#9742) 
Deflake test-api job, currently failing at around 7.6% (44 out of 578
workflows), by ensuring that test nomad agent use a small dedicated port
range that doesn't conflict with the kernel ephemeral range.

The failures are disproportionatly related to port allocation, where a
nomad agent fails to start when the http port is already bound to
another process. The failures are intermitent and aren't specific to any
test in particular. The following is a representative failure:
https://app.circleci.com/pipelines/github/hashicorp/nomad/13995/workflows/6cf6eb38-f93c-46f8-8aa0-f61e62fe7694/jobs/128169
.

Upon investigation, the issue seems to be that the api freeport library
picks a port block within 10,000-14,500, but that overlaps with the
kernel ephemeral range 32,769-60,999! So, freeport may allocate a free
port to the nomad agent, just to be used by another process before the
nomad agent starts!

This happened for example in
https://app.circleci.com/pipelines/github/hashicorp/nomad/14111/workflows/e1fcd7ff-f0e0-4796-8719-f57f510b1ffa/jobs/129684
.  `freeport` allocated port 41662 to serf, but `google_accounts`
raced to use it to connect to the CirleCI vm metadata service.

We avoid such races by using a dedicated port range that's disjoint from
the kernel ephemeral port range.
2021-01-06 16:18:28 -05:00
..
contexts auto-complete for recommendations CLI, plus OSS components of recommendations prefix search 2020-11-11 11:13:43 +00:00
internal/testutil tests: deflake test-api job (#9742) 2021-01-06 16:18:28 -05:00
acl.go Self token lookup 2017-10-13 13:12:20 -07:00
acl_test.go Self token lookup 2017-10-13 13:12:20 -07:00
agent.go api: nomad debug new /agent/host (#8325) 2020-07-02 09:51:25 -04:00
agent_test.go fix tests, update changelog 2020-01-29 13:55:39 -05:00
allocations.go api: add field filters to /v1/{allocations,nodes} 2020-10-14 10:35:22 -07:00
allocations_test.go api: add field filters to /v1/{allocations,nodes} 2020-10-14 10:35:22 -07:00
api.go Add API support for cancelation contexts passed via QueryOptions and WriteOptions (#8836) 2020-09-09 16:22:07 -04:00
api_test.go Add API support for cancelation contexts passed via QueryOptions and WriteOptions (#8836) 2020-09-09 16:22:07 -04:00
compose_test.go test: fix up testing around host networks 2020-06-19 13:53:31 -04:00
constraint.go Tag Job spec with HCLv2 tags 2020-10-21 14:05:46 -04:00
constraint_test.go Parallel 2017-07-21 16:33:04 -07:00
csi.go csi/api: populate ReadAllocs/WriteAllocs fields (#9377) 2020-11-25 16:44:06 -05:00
csi_test.go csi: add -force flag to volume deregister (#8295) 2020-07-01 12:17:51 -04:00
deployments.go multiregion CLI: nomad deployment unblock 2020-06-17 11:03:44 -04:00
evaluations.go add create and modify timestamps to evaluations (#5881) 2019-08-07 09:50:35 -07:00
evaluations_test.go non-Existent -> nonexistent 2018-03-12 11:59:33 -07:00
event_stream.go API: Event stream use full name instead of Eval/Alloc (#9509) 2020-12-03 11:48:18 -05:00
event_stream_test.go API: Event stream use full name instead of Eval/Alloc (#9509) 2020-12-03 11:48:18 -05:00
fs.go cli: recover from client ACL lookup failures 2019-10-04 11:23:59 -04:00
fs_test.go Divest api/ package of deps elsewhere in the nomad repo. (#5488) 2019-03-29 14:47:40 -04:00
go.mod Api/event stream payload values (#9277) 2020-11-05 13:04:18 -05:00
go.sum command: remove use of flag impls from consul 2020-12-11 07:58:20 -06:00
ioutil.go Add api/ package function to save snapshot 2020-05-21 20:04:38 -04:00
ioutil_test.go Add api/ package function to save snapshot 2020-05-21 20:04:38 -04:00
jobs.go Don't parse the server-set fields of the job struct 2020-10-22 08:18:57 -04:00
jobs_test.go updated api tests wrt backwards compat on null chars in IDs 2020-10-05 18:01:50 +00:00
namespace.go sync 2017-10-13 14:36:02 -07:00
namespace_test.go Fix pro tags 2020-07-17 11:02:00 -04:00
nodes.go api: add field filters to /v1/{allocations,nodes} 2020-10-14 10:35:22 -07:00
nodes_test.go api: add field filters to /v1/{allocations,nodes} 2020-10-14 10:35:22 -07:00
operator.go Metrics gotemplate support, debug bundle features (#9067) 2020-10-14 15:16:10 -04:00
operator_autopilot.go implement MinQuorum 2020-02-16 16:04:59 -06:00
operator_metrics.go Metrics gotemplate support, debug bundle features (#9067) 2020-10-14 15:16:10 -04:00
operator_metrics_test.go Metrics gotemplate support, debug bundle features (#9067) 2020-10-14 15:16:10 -04:00
operator_test.go Divest api/ package of deps elsewhere in the nomad repo. (#5488) 2019-03-29 14:47:40 -04:00
quota.go sync 2017-10-13 14:36:02 -07:00
quota_test.go sync 2017-10-13 14:36:02 -07:00
raw.go Making the client use tls if the node from which migration has to be made has enabled tls 2016-10-31 10:20:04 -07:00
recommendations.go added new policy capabilities for recommendations API 2020-10-28 14:32:16 +00:00
regions.go fix a copy/paste error on api.Regions() comment 2017-01-17 22:48:01 -08:00
regions_test.go Divest api/ package of deps elsewhere in the nomad repo. (#5488) 2019-03-29 14:47:40 -04:00
resources.go api: safely access legacy MBits field 2020-11-23 10:36:10 -06:00
scaling.go added new policy capabilities for recommendations API 2020-10-28 14:32:16 +00:00
scaling_test.go add scaling policy type 2020-09-29 17:57:46 -04:00
search.go Search respects QueryOptions and returns QueryMeta 2017-08-27 22:17:51 -07:00
search_test.go Add new reschedule options to API layer and unit tests 2018-03-14 16:10:32 -05:00
sentinel.go sync 2017-09-19 10:08:23 -05:00
sentinel_test.go Fix pro tags 2020-07-17 11:02:00 -04:00
services.go consul/connect: enable setting datacenter in connect upstream 2020-11-30 10:38:30 -06:00
services_test.go consul/connect: enable setting datacenter in connect upstream 2020-11-30 10:38:30 -06:00
status.go display server leaders per region 2016-03-17 16:04:09 -07:00
status_test.go Parallel 2017-07-21 16:33:04 -07:00
system.go Add missing ReconcileSummaries API method 2017-08-24 11:55:10 +02:00
system_test.go Parallel 2017-07-21 16:33:04 -07:00
tasks.go Merge pull request #9352 from hashicorp/f-artifact-headers 2020-11-13 14:04:27 -06:00
tasks_test.go jobspec: add support for headers in artifact stanza 2020-11-13 12:03:54 -06:00
util_test.go added new policy capabilities for recommendations API 2020-10-28 14:32:16 +00:00
utils.go more testing for ScalingPolicy, mainly around parsing and canonicalization for Min/Max 2020-03-24 19:43:50 +00:00
utils_test.go api: move formatFloat function 2019-01-18 15:31:31 -05:00