1fe979a5e4
Remove types.ShutdownChannel and replace with `chan struct{}`
2016-06-10 15:50:11 -04:00
2395aa481c
Fix unit tests
2016-06-10 15:50:11 -04:00
438becb28b
Pass the datacenter name in the heartbeat
...
Servers that are part of a different datacenter are added as backup
servers instead of primary servers.
2016-06-10 15:50:11 -04:00
d914f262f9
Consolidate all consul sync periodic go routines to handlers.
...
Only one pump and periodic loop now.
2016-06-10 15:50:11 -04:00
9fb0104def
Teach Client to reuse an Agent's consulSyncer.
...
"There can be only one."
2016-06-10 15:50:11 -04:00
47891fb559
Register two services each for clients and servers, http and rpc.
...
In order to give clients a fighting chance to talk to the right port,
differentiate RPC services from HTTP services by registering two
services with different tags. This yields
`rpc.nomad-server.service.consul` and
`http.nomad-server.service.consul` which is immensely more useful to
clients attempting to bootstrap their world.
2016-06-10 15:50:11 -04:00
d2f9848348
Bump the cluster test minimums to 10min.
...
These ranges aren't too useful with the default 600s rebalance, but
will be useful if that default ever changes in the future.
2016-06-10 15:50:11 -04:00
861f900225
s/RpcVersion/RPCVersion/g
2016-06-10 15:50:11 -04:00
bd0588ffa8
Bump shuffle interval per suggestion from Alex
2016-06-10 15:50:11 -04:00
9f8d6c9f67
Move struct member to reduce diff context
2016-06-10 15:50:11 -04:00
5570aa98e9
Fix package name in comments
2016-06-10 15:50:11 -04:00
410d85cc78
Rename the package from `client/rpc_proxy` to `client/rpcproxy`
...
Also rename `NewRpcProxy()` to just `New()` to avoid package stutter.
2016-06-10 15:50:11 -04:00
be679c161c
Rename manager_test.go to rpc_proxy_test.go
2016-06-10 15:50:11 -04:00
677f149b16
Rename RpcProxy's internal filename to match
2016-06-10 15:50:11 -04:00
11d53fda00
Remove unused code
2016-06-10 15:50:11 -04:00
10d1b6ba9b
Reduce all forms of ConsulConfig down to a single struct
...
nomad/structs/config/consul.go's ConsulConfig is the canonical definition
for all things Consul now.
2016-06-10 15:50:11 -04:00
0dbd16aa5d
Rebalance Nomad client RPCs among different Nomad servers.
...
Implement client/rpc_proxy.RpcProxy.
2016-06-10 15:50:11 -04:00
a13cbe73c3
Rename ConsulConfig to ConsulAgentConfig
2016-06-10 15:50:11 -04:00
e727fd8c3c
Centralize the creation of a consul/api.Config struct.
...
While documented, the consul.timeout parameter wasn't ever set
except one-off in the Consul fingerprinter.
2016-06-10 15:50:11 -04:00
af96cb23a5
Rename `mergedNomadMap` to `mergedPrimaryMap`. Gratuitous, but more correct.
2016-06-10 15:50:11 -04:00
9d5cdf4e68
Correct a mismerge
...
Somewhere along the lines when rebasing I mis-merged a patch.
2016-06-10 15:50:11 -04:00
d58632e93f
Rename RpcProxy's internal filename to match
2016-06-10 15:50:11 -04:00
108d2ca981
index on f-dyn-server-list: bd38cb4 Remove unused code
2016-06-10 15:50:11 -04:00
cbe77754df
Remove unused code
2016-06-10 15:50:11 -04:00
ec7c78f533
Only poll Consul for servers when Nomad heartbeats begin to fail
...
When a deadline timer of 2x Server's last requested TTL expires,
begin polling Consul for Nomad Servers.
2016-06-10 15:50:11 -04:00
a4b32c62e2
s/availble/runChecks/g
2016-06-10 15:50:11 -04:00
d1442dc317
Reduce all forms of ConsulConfig down to a single struct
...
nomad/structs/config/consul.go's ConsulConfig is the canonical definition
for all things Consul now.
2016-06-10 15:50:11 -04:00
e60580b279
Define a type for the PeriodicCallback handlers and ShutdownChannel
2016-06-10 15:50:11 -04:00
17116fc5a7
Rebalance Nomad client RPCs among different Nomad servers.
...
Implement client/rpc_proxy.RpcProxy.
2016-06-10 15:50:11 -04:00
88f3422d7c
Rename NewConsulService to NewSyncer
2016-06-10 15:49:37 -04:00
b9789e0cf7
Rename client/consul/sync.PeriodicSync to Run
2016-06-10 15:49:37 -04:00
768aab015d
Rename client/consul/sync.ConsulService to client/consul/sync.Syncer
...
Syncer describes the responsibility and actions of the type.
2016-06-10 15:49:37 -04:00
bfa4711df5
Rename ConsulConfig to ConsulAgentConfig
2016-06-10 15:48:36 -04:00
73e173673e
Rename client/config/config's ConsulConfig to ConsulAgentConfig
...
A follow up commit to the previous rename. More to come.
2016-06-10 15:48:36 -04:00
e97652bbfb
Rename consul.ConsulConfig to consul.AgentConfig
...
There were two `ConsulConfig` structs running around, one of them
needed to go away. Rely on the package's path to provide context
for the type of AgentConfig.
2016-06-10 15:48:36 -04:00
e36686a17d
Use consul/lib's RandomStagger
...
Removes four redundant copies of the method in the process.
2016-06-10 15:48:36 -04:00
26c9110e82
fix types
2016-06-10 11:52:15 -07:00
a3d41f2312
use time.Second instead of our own const
2016-06-10 11:38:59 -07:00
3cf74e7fd8
Alloc-status only shows measured statistics and fixes to CPU calculations
2016-06-10 10:38:29 -07:00
287e0eff22
Fixed merge conflicts
2016-06-10 04:47:34 +01:00
a69307cff2
Using named variables
2016-06-10 04:45:16 +01:00
9056be6d86
Fixed calculation of cpu usage percent in user and sys mode for pids
2016-06-10 04:06:32 +01:00
98d7547014
Annotate what is measured
2016-06-09 19:45:41 -07:00
b7e3a45fef
fix channel being nil on restore
2016-06-07 15:03:08 -07:00
6bf38bb213
Fixed the svc id generation scheme while pruning services
2016-06-07 08:14:11 -07:00
4027ff56f0
Returning an error if stats collection hasn't started yet for a new docker container
2016-06-06 18:52:54 -07:00
c21d606ebb
Getting inodes used percent back
2016-06-06 16:10:34 -07:00
d928d02d85
Removing inode percent since it doesn't work in some cases
2016-06-06 16:10:34 -07:00
ba1a92eb8c
Handle errors during stats collection
2016-06-03 14:23:18 -07:00
667b478f3f
Merge pull request #1226 from hashicorp/f-push-stats
...
Push Resource Usage stats to remote sinks
2016-06-02 23:14:59 +02:00
35e31c1b81
Enqueing metrics only if they are not nil
2016-06-02 17:14:15 -04:00
7efde782fa
Sending metrics for tasks as well
2016-06-01 16:42:16 +02:00
4e15611339
fix wait result being nil and some panics in the cli
2016-05-31 23:09:05 +00:00
7f172f314f
Pushing host stats
2016-05-31 04:05:47 +02:00
f95b1d00c3
Renamed error message in alloc endpoint
2016-05-28 20:03:52 -07:00
ae87177eed
Added a test to make sure task runner is collecting stats
2016-05-28 19:59:20 -07:00
11d1dd113b
Added a test for docker
2016-05-28 19:59:20 -07:00
c0dc6cfbf2
Changing the api of the stats endpoints
2016-05-28 19:59:20 -07:00
fa9b0dd7e8
Implemented the resource usage ts since a time
2016-05-28 19:59:20 -07:00
02ceb6c697
Initializing the ring buffer with no cells
2016-05-28 19:59:20 -07:00
77ac2dd624
Initializing the ring buffer with no cells
2016-05-28 19:59:20 -07:00
a0c279f3b2
comments
2016-05-28 19:59:20 -07:00
4c85f02072
Stopping the metrics collector timers using defer and starting to collect host stats right away
2016-05-28 19:59:20 -07:00
40e60ce920
Making the call to Stats on a go-routine
2016-05-28 19:59:20 -07:00
c8f5527158
Added a test to validate we are collecting stats
2016-05-28 19:59:20 -07:00
b2e8495971
Fixing the alloc runner tests
2016-05-28 19:59:20 -07:00
a64062d6a6
Fixed the compilation on linux
2016-05-28 19:59:20 -07:00
2b37f08d49
creating the host cpu percent calculator lazily
2016-05-28 19:59:20 -07:00
2ff43788a0
simplified the stats method in basic executor
2016-05-28 19:59:20 -07:00
097bab52a9
Fixed the logic of scanpids
2016-05-28 19:59:20 -07:00
f93820f40c
Added comments
2016-05-28 19:59:20 -07:00
c2da19bf11
Refactored the api for NewHostStatsCollector
2016-05-28 19:59:20 -07:00
0b0d0764e4
Changed signature of Allocation Stats Reporter
2016-05-28 19:59:20 -07:00
75c7f84490
Simplified the docker stats collection
2016-05-28 19:59:20 -07:00
98016ec066
Incorporated review comments for executor
2016-05-28 19:59:20 -07:00
c46400597e
Making the stats collection interval and number of data points to keep in memory configurable
2016-05-28 19:59:20 -07:00
b6e5227e7a
Renamed monitorUsage method
2016-05-28 19:59:20 -07:00
d2021e2953
Changed the signature of ResourceUsageTS
2016-05-28 19:59:20 -07:00
666b419dba
Acquiring locks before iterating allocations and tasks
2016-05-28 19:59:20 -07:00
05c221186b
Added disk usage to node status
2016-05-28 19:59:20 -07:00
cf247c1309
Added uptime to node stats
2016-05-28 19:59:20 -07:00
73fa700a88
Showing host resource usage stats
2016-05-28 19:59:20 -07:00
313c61b9db
Added pidstats in task resource usage struct
2016-05-28 19:59:20 -07:00
cfd3016747
Renamed CpuUsage to CpuStats
2016-05-28 19:59:20 -07:00
77357ccf80
Added a test for calculating cpu stats
2016-05-28 19:59:20 -07:00
84cd943c48
Stopping stats collection of tasks which has been destroyed
2016-05-28 19:59:20 -07:00
193bbc10f8
Fixed the percentage calculation for cgroups
2016-05-28 19:59:20 -07:00
7744a41358
Added some docs
2016-05-28 19:59:03 -07:00
b884253d39
Added locks to RingBuf
2016-05-28 19:59:03 -07:00
22c3f6fee0
Implemented nomad cpu percentage calculator
2016-05-28 19:59:03 -07:00
e37a108b4c
Implemented cpu stats
2016-05-28 19:51:22 -07:00
1789dbd1ff
Fixed implementation of the docker stats
2016-05-28 19:51:22 -07:00
9790516a22
Added the PidStats method on the executor
2016-05-28 19:42:34 -07:00
63166d0e46
Adding a query param to return time series of stats
2016-05-28 19:42:34 -07:00
c347b27e6a
Implemented stats for raw_exec
2016-05-28 19:42:34 -07:00
9a96dddc07
Added some docs to resource stats endpoint
2016-05-28 19:42:34 -07:00
b9feae89ce
Making the conversion to Stats simpler
2016-05-28 19:42:34 -07:00
f84f93c817
Returning nil if peek is called before any value is enqueued
2016-05-28 19:42:34 -07:00
91d2cf319e
Added some documentation
2016-05-28 19:42:34 -07:00
7569b1af2e
Collecting host stats
2016-05-28 19:42:34 -07:00
15d867d5f1
Updated gopsutil
2016-05-28 19:42:34 -07:00
f3d0aecafe
Reporting time series of stats
2016-05-28 19:42:34 -07:00
8abc594da1
Added a ringbuff datastructure
2016-05-28 19:42:34 -07:00
13825f434e
Added the nomad stats command
2016-05-28 19:42:34 -07:00
2b86bb3396
Added cpu stats
2016-05-28 19:42:34 -07:00
0fb0e0237f
Added a client API to display resource usage of an allocation
2016-05-28 19:42:34 -07:00
6c1b60ff07
Add the Stats api to driverhandle
2016-05-28 19:42:34 -07:00
df7f5175a8
Add support for shm_size to docker driver. Required update of go-dockerclient
...
to more recent version (ba4298ecf4cfa216f1cce2befbf653359f62c722).
2016-05-27 12:30:04 +02:00
76509eb230
Fixed docker test
2016-05-22 02:49:33 -07:00
dc28ab0cb5
Speling police
2016-05-15 09:41:34 -07:00
2e2e2e500e
Using a helper method to create service identifiers
2016-05-14 00:43:25 -07:00
ecd995b283
Added some docs
2016-05-14 00:36:26 -07:00
2a99a2cfb6
Removing addition of the client service while reconciling services
2016-05-13 10:34:21 -07:00
df9d256132
Making Nomad register services with consul in dev mode
2016-05-13 10:19:49 -07:00
439d7bf326
Fixed an agent test
2016-05-11 17:26:53 -07:00
5dc507dbe0
Fixing the client test
2016-05-11 16:58:14 -07:00
347cb890d2
Removed allocID and task name from consul service
2016-05-11 16:26:41 -07:00
7287376eca
Using consul config from client config instead of reading from client options
2016-05-11 16:10:57 -07:00
83fed62a0a
Implemented registering client and server services
2016-05-11 16:07:02 -07:00
cec6c03b79
Fixed the consul tests
2016-05-11 15:22:58 -07:00
2f8a3532ad
Refactored the signature of NewConsulService
2016-05-11 15:22:58 -07:00
514f22c4a8
Merge pull request #1160 from hashicorp/f-freebsd
...
Stubbed out raw_exec support for *NIX platforms
OOB LGTM: @diptanu
2016-05-11 12:54:27 -07:00
2f15842f3e
Merge pull request #1164 from hashicorp/fix-unmount
...
Removing directories only if we could successfully unmount them
2016-05-11 12:51:34 -07:00
5b12aebd31
Removing directories only if we could successfully unmount them
2016-05-10 14:57:16 -07:00
9fd4b82390
Establish a floor of one core for the number of cores.
...
In most cases the upstream library [shirou/gopsutil](https://github.com/shirou/gopsutil )
needs to be fixed.
2016-05-09 12:22:40 -07:00
53d4681b61
Emit various debugging information with the results of the fingerprinter
2016-05-09 12:21:51 -07:00
a2b71983c0
cgroups are a decidedly Linux-only feature. Build and test as such.
2016-05-09 11:56:35 -07:00
8e88b11596
Decrease the log-level from WARN to DEBUG when fingerprinting GCE
...
This brings the logging here inline with the remaining fingerprinting code
2016-05-09 11:56:35 -07:00
2ff8b10e05
Rename cgroup_universal.go to cgroup_default.go
...
Universal implies it is applicable to Linux, whereas default implies
the fallthrough for the non-Linux build targets.
2016-05-09 11:56:35 -07:00
f8e9a759d3
Move network detection code to Linux-specific build
...
Non-Linux build targets get the current default of 0. This will allow
platform specific fingerprinting for network capabilities.
2016-05-09 11:56:35 -07:00
f2e01f0eab
Stub out FreeBSD support for Nomad
...
Compiles, but is not functional (yet).
2016-05-09 11:56:35 -07:00
cb9b4eca83
Merge pull request #1156 from hashicorp/f-x-sys-unix
...
Use x/sys/unix vs syscall package where appropriate
2016-05-09 11:56:00 -07:00
d86a6a029a
Rename the windows exec driver file to be the default exec driver.
...
No functional difference in practice, but results in a more clean build.
2016-05-09 11:32:05 -07:00
cc246b30d9
Added java
2016-05-09 17:27:01 +03:00
503f552477
Reverted blank line
2016-05-09 17:23:38 +03:00
99e7581742
Fixed CR defect
2016-05-09 17:22:01 +03:00
875df91e0b
Added consul script check support for raw_exec driver
2016-05-09 13:35:19 +03:00
d9ba6d8bff
Re-sort functions back to the same ordering as `master`
2016-05-08 11:46:20 -07:00
b249aaf8bb
Remove stray debugging fmt.Printf
2016-05-08 11:43:43 -07:00
93bcc30a9c
Revert making UniversalExecutor.wait() platform specific
2016-05-08 11:21:34 -07:00
2cba09843c
Revert making UniversalExecutor.wait() platform specific
2016-05-08 11:17:27 -07:00
e8fbfc7976
Revert making UniversalExecutor.wait() platform specific
2016-05-08 00:13:28 -07:00
f2b6303d49
Catch up with error message drift in docker
2016-05-07 15:46:44 -07:00
d1268cfb76
Break out the windows vs UNIX Fingerprinter
...
cgroup's are applicable to Windows and will require a more specific abstraction. Stub out the difference. The *NIX exec drivers will likely be broken out over time (e.g. *BSD and Solaris).
2016-05-07 12:37:15 -07:00
19c64fb94c
Fix executor builds on Windows
2016-05-07 12:07:27 -07:00
d10623aaea
Implement a Windows-specific UniversalExecutor `wait()`
2016-05-07 12:00:44 -07:00
f79b872ed2
Windows needs a stub chroot command
2016-05-07 11:59:55 -07:00
a78a9b3531
Build checks per-platform
2016-05-07 11:18:13 -07:00
09f7d5e595
Prefer `golang.org/x/sys/unix` where appropriate
...
Favor the `unix` package on *NIX platforms vs the now frozen `syscall` package.
2016-05-07 11:01:45 -07:00
1314227863
Explicitly enumaret the build targets in _unix
...
`!windows` was being used as the synonym for `darwin dragonfly freebsd linux netbsd openbsd solaris`. While I don't imagine `android` will be a prime target for Nomad in the near term, favor explicit build targets.
List of build targets generated by Go 1.7's dist command: `go tool dist list | sort | cut -d '/' -f 1 | sort | uniq`
2016-05-07 10:42:01 -07:00
Sean Chittenden