a73422b4ff
Fix docker driver lockup during nomad boot
...
Unit mismatch caused docker driver to wait almost indefinitely during boot
(when one or more containers were a bit uncooperative during StopContainer())
This should fix problems described in #1202
2016-06-28 14:26:47 +02:00
0a10873aa6
Merge pull request #1335 from hashicorp/f-set-docker-timeout
...
Setting a timeout in the docker client
2016-06-21 17:00:14 -07:00
2837d3395d
Setting a timeout in the docker client
2016-06-21 16:58:21 -07:00
1d5c5b18f3
Making SSL default
2016-06-21 16:41:14 -07:00
661dc200f3
Make line copy to avoid being overriden by subsequent scans
2016-06-20 13:14:43 -07:00
67a04bb1cc
Volume binds for windows containers
2016-06-20 21:46:33 +02:00
c9f7467ccb
Driver tests use client default config
2016-06-17 14:24:49 -07:00
7b9961f09b
Initialize the stats helpers before accessing them for the first time
2016-06-17 13:23:30 -07:00
27c6398639
debug message when stopping container
2016-06-17 11:52:44 -07:00
266c417ac8
Changed the client options for docker volume selinux labels
2016-06-16 21:41:02 +01:00
fa216199ce
Added documentation
2016-06-15 02:42:15 +02:00
e08083acfe
Added a client options for setting selinux options
2016-06-15 02:33:09 +02:00
4b04e503f3
address comments
2016-06-13 17:32:18 -07:00
8bbf4a55e5
Fix IDs and domain scoping
2016-06-13 16:30:58 -07:00
d019d8ef8e
implemented reconciliation of unwanted services
2016-06-13 14:52:26 +02:00
232654cdee
register checks
2016-06-12 21:28:56 -07:00
a82c2bb058
Do not reconcile in client and cleanup executor a bit
2016-06-12 18:22:07 -07:00
8e231fa382
Rename ConsulService back to Service
2016-06-12 16:36:49 -07:00
e931b42473
unify cli output
2016-06-12 13:16:07 -07:00
6ef4bfd6bf
skip docker test if no docker found
2016-06-12 11:28:43 -07:00
2628827b7c
Merge pull request #1262 from hashicorp/remove-artifact-check
...
Removing artifact check for java and qemu drivers
2016-06-12 11:21:18 -07:00
c4a819528a
Merge pull request #1260 from hashicorp/f-alloc-stats-struct
...
Allocation resources returned in a struct
2016-06-12 11:18:57 -07:00
34f85baab0
Fix the calculation of total ticks for docker and exec
2016-06-12 18:08:35 +02:00
beb362e202
Setting a flag to indicate whether fs isolation is indeed happening
2016-06-12 15:43:24 +02:00
641cf50682
Not converting the abs path relative to task dir for drivers which enforce FS isolation only in linux
2016-06-12 13:54:30 +02:00
e952540f6f
Allocation resources returned in a struct
2016-06-11 21:04:10 -07:00
2f036231e5
Merge pull request #1201 from hashicorp/f-dyn-server-list
...
Dynamic Server Lists/Client Bootstrapping via consul.
2016-06-11 18:58:25 -04:00
445783889b
Remove default values and use nil for the executor. Much better.
2016-06-11 17:52:09 -04:00
19f4adbcf1
Using a different client for collecting stats and waiting on containers
2016-06-11 20:37:29 +02:00
7fb507e810
Moving the clkspeed code to helper
2016-06-11 17:31:49 +02:00
f891fa0ec8
Perform a nil-check for Executor's consulServices.
...
Executors can `Shutdown()` before calling `SyncServices()`.
2016-06-10 23:43:54 -04:00
59540c3e93
Extracted a method for getting clock speed
2016-06-11 02:07:28 +02:00
f94f89b6d7
Pruning out pids which are no longer present
2016-06-11 01:40:52 +02:00
0a9a3918d6
Not reset-ing the list of pids if they don't change
2016-06-11 01:19:50 +02:00
c38a6fb3c5
Implementing the total ticks per task for the docker driver
2016-06-10 23:33:25 +02:00
2d3798b076
Calculating the cpu ticks in nomad client
2016-06-10 22:22:32 +02:00
d99467ef5e
Always create a consul.Syncer. Use a default Consul Config if necessary.
2016-06-10 15:55:27 -04:00
f6a0459ae5
Always create a consul.Syncer. Use a default Consul Config if necessary.
2016-06-10 15:55:27 -04:00
cc6e8792e0
Create a consulContext using a client's consul config.
...
This is wrong and should be the Agent's Consul Config. This is a
step in the right direction, so committing to mark the necessary
future change.
2016-06-10 15:54:39 -04:00
9a223936bb
Generate and sync Consul ServiceIDs consistently
2016-06-10 15:54:39 -04:00
3892a0433e
Move the start of the UniversalExecutor's consulSyncer to initialize once
...
This should be handled via a sync.Once primative, but I don't want to
unpack that atm.
2016-06-10 15:54:39 -04:00
7956eb0c80
Rename structs.Task's `Service` attribute to `ConsulService`
2016-06-10 15:54:39 -04:00
8c813630e6
Move package client/consul/sync to command/agent/consul.
...
This has been done to allow the Server and Client to reuse the same
Syncer because the Agent may be running Client, Server, or both
simultaneously and we only want one Syncer object alive in the agent.
2016-06-10 15:54:39 -04:00
d6ef97911b
Rename Syncer.SetServiceIdentifier to SetServiceRegPrefix()
...
This attribute isn't actually an identifier because it can represent
a collection of services. Rename `serviceIdentifier` to
`serviceRegPrefix which more accurately conveys the intention of this
Syncer attribute.
While here, also rename `SetServiceIdentifier()` to `SetServiceRegPrefix()`
and `GenerateServiceIdentifier()` to `GenerateServicePrefix()`.
2016-06-10 15:54:39 -04:00
6b126ce488
Change the API signature of Syncer.SyncServices().
...
SyncServices() immediately attempts to sync whatever information
the process has with Consul. Previously this method would take an
argument of the exclusive list of services that should exist,
however this is not condusive to having a Nomad Client and Nomad
Server share the same consul.Syncer.
2016-06-10 15:54:39 -04:00
555f4fe135
Change client/consul.NewSyncer() to accept a shutdown channel
...
In addition to the API changing, consul.Syncer can now be signaled
to shutdown via the Shutdown() method, which will call the Run()'ing
sync task to exit gracefully.
2016-06-10 15:54:39 -04:00
82d537fbd9
Update the `nomad_server_service` default from `nomad-server` to just `nomad`.
2016-06-10 15:50:11 -04:00
10d1b6ba9b
Reduce all forms of ConsulConfig down to a single struct
...
nomad/structs/config/consul.go's ConsulConfig is the canonical definition
for all things Consul now.
2016-06-10 15:50:11 -04:00
0dbd16aa5d
Rebalance Nomad client RPCs among different Nomad servers.
...
Implement client/rpc_proxy.RpcProxy.
2016-06-10 15:50:11 -04:00
a13cbe73c3
Rename ConsulConfig to ConsulAgentConfig
2016-06-10 15:50:11 -04:00
d1442dc317
Reduce all forms of ConsulConfig down to a single struct
...
nomad/structs/config/consul.go's ConsulConfig is the canonical definition
for all things Consul now.
2016-06-10 15:50:11 -04:00
17116fc5a7
Rebalance Nomad client RPCs among different Nomad servers.
...
Implement client/rpc_proxy.RpcProxy.
2016-06-10 15:50:11 -04:00
88f3422d7c
Rename NewConsulService to NewSyncer
2016-06-10 15:49:37 -04:00
b9789e0cf7
Rename client/consul/sync.PeriodicSync to Run
2016-06-10 15:49:37 -04:00
768aab015d
Rename client/consul/sync.ConsulService to client/consul/sync.Syncer
...
Syncer describes the responsibility and actions of the type.
2016-06-10 15:49:37 -04:00
bfa4711df5
Rename ConsulConfig to ConsulAgentConfig
2016-06-10 15:48:36 -04:00
e97652bbfb
Rename consul.ConsulConfig to consul.AgentConfig
...
There were two `ConsulConfig` structs running around, one of them
needed to go away. Rely on the package's path to provide context
for the type of AgentConfig.
2016-06-10 15:48:36 -04:00
26c9110e82
fix types
2016-06-10 11:52:15 -07:00
a3d41f2312
use time.Second instead of our own const
2016-06-10 11:38:59 -07:00
3cf74e7fd8
Alloc-status only shows measured statistics and fixes to CPU calculations
2016-06-10 10:38:29 -07:00
287e0eff22
Fixed merge conflicts
2016-06-10 04:47:34 +01:00
a69307cff2
Using named variables
2016-06-10 04:45:16 +01:00
9056be6d86
Fixed calculation of cpu usage percent in user and sys mode for pids
2016-06-10 04:06:32 +01:00
98d7547014
Annotate what is measured
2016-06-09 19:45:41 -07:00
4027ff56f0
Returning an error if stats collection hasn't started yet for a new docker container
2016-06-06 18:52:54 -07:00
4e15611339
fix wait result being nil and some panics in the cli
2016-05-31 23:09:05 +00:00
f95b1d00c3
Renamed error message in alloc endpoint
2016-05-28 20:03:52 -07:00
11d1dd113b
Added a test for docker
2016-05-28 19:59:20 -07:00
c0dc6cfbf2
Changing the api of the stats endpoints
2016-05-28 19:59:20 -07:00
a0c279f3b2
comments
2016-05-28 19:59:20 -07:00
4c85f02072
Stopping the metrics collector timers using defer and starting to collect host stats right away
2016-05-28 19:59:20 -07:00
40e60ce920
Making the call to Stats on a go-routine
2016-05-28 19:59:20 -07:00
c8f5527158
Added a test to validate we are collecting stats
2016-05-28 19:59:20 -07:00
a64062d6a6
Fixed the compilation on linux
2016-05-28 19:59:20 -07:00
2ff43788a0
simplified the stats method in basic executor
2016-05-28 19:59:20 -07:00
097bab52a9
Fixed the logic of scanpids
2016-05-28 19:59:20 -07:00
75c7f84490
Simplified the docker stats collection
2016-05-28 19:59:20 -07:00
98016ec066
Incorporated review comments for executor
2016-05-28 19:59:20 -07:00
313c61b9db
Added pidstats in task resource usage struct
2016-05-28 19:59:20 -07:00
cfd3016747
Renamed CpuUsage to CpuStats
2016-05-28 19:59:20 -07:00
77357ccf80
Added a test for calculating cpu stats
2016-05-28 19:59:20 -07:00
84cd943c48
Stopping stats collection of tasks which has been destroyed
2016-05-28 19:59:20 -07:00
193bbc10f8
Fixed the percentage calculation for cgroups
2016-05-28 19:59:20 -07:00
7744a41358
Added some docs
2016-05-28 19:59:03 -07:00
b884253d39
Added locks to RingBuf
2016-05-28 19:59:03 -07:00
22c3f6fee0
Implemented nomad cpu percentage calculator
2016-05-28 19:59:03 -07:00
e37a108b4c
Implemented cpu stats
2016-05-28 19:51:22 -07:00
1789dbd1ff
Fixed implementation of the docker stats
2016-05-28 19:51:22 -07:00
9790516a22
Added the PidStats method on the executor
2016-05-28 19:42:34 -07:00
63166d0e46
Adding a query param to return time series of stats
2016-05-28 19:42:34 -07:00
c347b27e6a
Implemented stats for raw_exec
2016-05-28 19:42:34 -07:00
91d2cf319e
Added some documentation
2016-05-28 19:42:34 -07:00
f3d0aecafe
Reporting time series of stats
2016-05-28 19:42:34 -07:00
13825f434e
Added the nomad stats command
2016-05-28 19:42:34 -07:00
2b86bb3396
Added cpu stats
2016-05-28 19:42:34 -07:00
0fb0e0237f
Added a client API to display resource usage of an allocation
2016-05-28 19:42:34 -07:00
6c1b60ff07
Add the Stats api to driverhandle
2016-05-28 19:42:34 -07:00
df7f5175a8
Add support for shm_size to docker driver. Required update of go-dockerclient
...
to more recent version (ba4298ecf4cfa216f1cce2befbf653359f62c722).
2016-05-27 12:30:04 +02:00
76509eb230
Fixed docker test
2016-05-22 02:49:33 -07:00
dc28ab0cb5
Speling police
2016-05-15 09:41:34 -07:00
2e2e2e500e
Using a helper method to create service identifiers
2016-05-14 00:43:25 -07:00
347cb890d2
Removed allocID and task name from consul service
2016-05-11 16:26:41 -07:00
2f8a3532ad
Refactored the signature of NewConsulService
2016-05-11 15:22:58 -07:00
cb9b4eca83
Merge pull request #1156 from hashicorp/f-x-sys-unix
...
Use x/sys/unix vs syscall package where appropriate
2016-05-09 11:56:00 -07:00
d86a6a029a
Rename the windows exec driver file to be the default exec driver.
...
No functional difference in practice, but results in a more clean build.
2016-05-09 11:32:05 -07:00
cc246b30d9
Added java
2016-05-09 17:27:01 +03:00
503f552477
Reverted blank line
2016-05-09 17:23:38 +03:00
99e7581742
Fixed CR defect
2016-05-09 17:22:01 +03:00
875df91e0b
Added consul script check support for raw_exec driver
2016-05-09 13:35:19 +03:00
d9ba6d8bff
Re-sort functions back to the same ordering as `master`
2016-05-08 11:46:20 -07:00
b249aaf8bb
Remove stray debugging fmt.Printf
2016-05-08 11:43:43 -07:00
93bcc30a9c
Revert making UniversalExecutor.wait() platform specific
2016-05-08 11:21:34 -07:00
2cba09843c
Revert making UniversalExecutor.wait() platform specific
2016-05-08 11:17:27 -07:00
e8fbfc7976
Revert making UniversalExecutor.wait() platform specific
2016-05-08 00:13:28 -07:00
f2b6303d49
Catch up with error message drift in docker
2016-05-07 15:46:44 -07:00
d1268cfb76
Break out the windows vs UNIX Fingerprinter
...
cgroup's are applicable to Windows and will require a more specific abstraction. Stub out the difference. The *NIX exec drivers will likely be broken out over time (e.g. *BSD and Solaris).
2016-05-07 12:37:15 -07:00
19c64fb94c
Fix executor builds on Windows
2016-05-07 12:07:27 -07:00
d10623aaea
Implement a Windows-specific UniversalExecutor `wait()`
2016-05-07 12:00:44 -07:00
f79b872ed2
Windows needs a stub chroot command
2016-05-07 11:59:55 -07:00
a78a9b3531
Build checks per-platform
2016-05-07 11:18:13 -07:00
09f7d5e595
Prefer `golang.org/x/sys/unix` where appropriate
...
Favor the `unix` package on *NIX platforms vs the now frozen `syscall` package.
2016-05-07 11:01:45 -07:00
1314227863
Explicitly enumaret the build targets in _unix
...
`!windows` was being used as the synonym for `darwin dragonfly freebsd linux netbsd openbsd solaris`. While I don't imagine `android` will be a prime target for Nomad in the near term, favor explicit build targets.
List of build targets generated by Go 1.7's dist command: `go tool dist list | sort | cut -d '/' -f 1 | sort | uniq`
2016-05-07 10:42:01 -07:00
cfd76aaf15
Rename from posix to unix to parallel x/sys/unix
...
Use the `_unix` file suffix to denote *NIX-like semantics in order to parallel the designation given by the package `golang.org/x/sys/unix`.
2016-05-07 10:33:43 -07:00
3a6ee08a32
Added some docs
2016-05-05 11:52:22 -07:00
9a8ad773b3
Added logs to indicate when checks timeout
2016-05-05 10:01:38 -07:00
e25a2d2f4f
Docker labels configuration should be of type "array" in schema
2016-04-25 23:58:31 +02:00
ae0a54eb70
Timeout docker connections after 1 minute
2016-04-22 11:11:38 -07:00
3ce32f1559
Fix splitting on equals to return maximum of two strings
2016-04-21 17:08:47 -07:00
c66370bf40
Add debug message on Wait() error
2016-04-19 15:54:21 -07:00
ca94d25cb4
Freeze the cgroup and cleanup around Shutdown
2016-04-19 13:48:02 -07:00
736ef76cc1
Put the executor into the cgroup to avoid a fork race
2016-04-18 17:59:08 -07:00
ebdc873e47
protect writing to closed channel
2016-04-18 11:46:57 -07:00
dba8712b45
remove systemd cgroup manager
2016-04-15 14:55:30 -07:00
8256396f1e
Add IP and PORT environment variables
2016-04-15 11:01:32 -07:00
9ccacaa9e5
Remove unused field
2016-04-14 11:05:20 -07:00
78adfa8ed6
changelog + docker GC cleanup
2016-04-14 10:52:38 -07:00
c4406f2b31
Merge pull request #1071 from hashicorp/b-docker-fix-gc
...
GC Docker containers and images after the container exits
2016-04-14 10:26:37 -07:00
081852d3cd
Modified the test to wait for 3 seconds before inspecting containers
2016-04-14 06:43:37 +05:30
bab7d8c9ce
Fixing the API call of stopping container
2016-04-12 02:29:28 -07:00
e599ab795c
Added a test to ensure that the docker driver is removing containers after container exits successfully
2016-04-12 01:00:14 -04:00
02f16e0ea5
Removing container and image once the wait from docker api returns
2016-04-12 00:52:45 -04:00
11f4e647b2
Add interactive option to the Docker driver configuration schema
2016-04-10 12:20:01 +02:00
6d0191a485
Add missing comments on exported Validate function
2016-04-10 01:15:09 +02:00
13a2d62bfa
Implement configuration validation for all task drivers
2016-04-10 00:42:57 +02:00
542603dec6
Add helper to validate raw configuration data
2016-04-10 00:42:43 +02:00
044978783f
client/docker: add `interactive` option
...
Equivalent to `docker run --interactive` - keeps STDIN open.
Also adds docs for both `tty` and `interactive` docker config.
2016-04-08 12:51:07 -05:00
47e2c6bbfc
Fixing race issues in the log rotator
2016-04-06 18:58:34 -07:00
58f13db9f2
Merge branch 'master' of github.com:hashicorp/nomad
2016-04-06 13:38:51 -07:00
f552159a34
Logging errors in the file rotator
2016-04-06 12:06:49 -07:00
77fbf85518
Added the tty flag to the driverconfig
2016-04-06 09:54:45 -07:00
Wojciech Bederski