Commit Graph

988 Commits

Author SHA1 Message Date
Alex Dadgar d0731a466f Skip SIGPIPE 2016-10-10 15:12:56 -07:00
Alex Dadgar bc35eaee21 Task runner sends signals 2016-10-10 15:09:00 -07:00
Alex Dadgar 08eeef0140 Merge pull request #1796 from hashicorp/f-task-runner
Task runner integrates with TaskTemplateManager
2016-10-07 15:13:14 -07:00
Michael Schurter d8f8048d85 Merge pull request #1767 from hashicorp/f-docker-volumes-logging
Support Docker Volumes and Logging
2016-10-07 12:10:59 -07:00
Alex Dadgar 8fb07bb083 Fix handling of restart in TaskEvents 2016-10-06 15:06:54 -07:00
Alex Dadgar 8eb7fa91cf Start of integration 2016-10-06 15:05:49 -07:00
Michael Schurter 44219cc083 Put docker volume support behind conf flag
Also add tests and fix bug with logging driver configuration.
2016-10-03 15:02:50 -07:00
Alex Dadgar d2837dec44 Do not allow path to escape the alloc dir for the FS commands 2016-10-03 14:58:44 -07:00
Michael Schurter 80085ddda5 Merge pull request #1735 from hashicorp/b-bootstrap-flapping
Retry all servers on RPC call failure
2016-09-27 16:33:15 -07:00
Seth Vargo 0f73579533 Clarify server-members is server-only (#1761)
* Add a note to the CLI that only servers can run this command

* Add a callout that this is a server command

* Remove the annoying bottom margin on callouts
2016-09-27 13:51:54 -07:00
Michael Schurter a45921c402 Fix agent server set test
Test asserted endpoint appendend servers, but the new/desired behavior
is for the endpoint to set/overwrite servers.
2016-09-26 11:57:06 -07:00
Seth Vargo 4523f112fe
Update the sample jobfile syntax
- Uses spaces instead of tabs for the sample job file. Even though Nomad
  is written in Go, the HCL style guide uses two spaces for indentation,
  and this will match Terraform and Vault in terms of configuration.
- Locks to redis:3.2 instead of floating latest. Running latest in
  production is a bad idea and we shouldn't encourage it even via
  example.
- Removes the linux constraint (native docker exists for both Mac and
  Windows now)
- Aligns equal signs and stuff as per the HCL formatter

- Closes #1743
2016-09-24 14:42:25 -04:00
Seth Vargo 18c657a1b7
Convert example job file constraint to comment
This improves the "getting started" happy path experience for non-linux
users who are running the native Docker tools on their machines. There
is no need to constrain this job to linux, since driver detection for
docker will already (basically) do this.
2016-09-24 14:12:30 -04:00
Michael Schurter 2ab5264595 Retry all servers on RPC call failure
rpcproxy is refactored into serverlist which prioritizes good servers
over servers in a remote DC or who have had a failure.

Registration, heartbeating, and alloc status updating will retry faster
when new servers are discovered.

Consul discovery will be retried more quickly when no servers are
available (eg on startup or an outage).
2016-09-23 11:44:48 -07:00
Diptanu Choudhury 589356fd55 Adding a snapshot endpoint on the client (#1730) 2016-09-21 21:28:12 -07:00
Alex Dadgar 50efdb00e9 Merge pull request #1713 from hashicorp/f-alloc-runner-vault
Vault integration in client
2016-09-20 16:15:55 -07:00
Alex Dadgar ada5d8dd0c alloc-status 2016-09-14 18:27:13 -07:00
Diptanu Choudhury 1b3c5e98c8 Renaming LocalDisk to EphemeralDisk (#1710)
Renaming LocalDisk to EphemeralDisk
2016-09-14 15:43:42 -07:00
Alex Dadgar 6702a29071 Vault token threaded 2016-09-14 13:30:01 -07:00
Mathias Lafeldt ff87952cfb
Fix typo in alloc-status output 2016-09-13 17:47:11 +02:00
Robert Neumayer e57d20d825 Fix typo
Telementry -> Telemetry
2016-09-11 09:46:05 +02:00
Michal Wieczorek db685b164f Close job temp file 2016-09-05 23:40:53 +02:00
Diptanu Choudhury 7367d6adb4 Removing warn msg 2016-09-04 17:22:49 -07:00
Alex Dadgar 1ce5457ac0 Vault config flags 2016-09-01 15:41:07 -07:00
Michael Schurter cbb0b8e31e Merge pull request #1668 from hashicorp/b-fix-consul-updates
Fix old services not getting removed from consul on update
2016-08-31 17:17:09 -07:00
Michael Schurter ec96e03563 Query consul without helpers in test to be safe 2016-08-31 14:14:17 -07:00
Diptanu Choudhury c2945c3e0d Merge pull request #1670 from hashicorp/b-telemetry-config
Merging telemetry configs
2016-08-31 11:47:50 -07:00
Diptanu Choudhury 03783d2554 Added a test 2016-08-31 11:46:51 -07:00
Diptanu Choudhury a80f67d097 Merging telemetry configs 2016-08-31 11:24:01 -07:00
Michael Schurter aa8cbe777a Make comment more precise 2016-08-31 10:43:55 -07:00
Michael Schurter 7f6b5f4d2a Fix error message when querying consul fails 2016-08-31 10:42:51 -07:00
Michael Schurter db1cf6385e Assert syncer state is consistent with consul's state 2016-08-31 09:19:54 -07:00
Michael Schurter f6bf81270d Remove extra consul service tracking entirely
Instead just remove all associated services on shutdown.
2016-08-30 17:10:15 -07:00
Michael Schurter 27912a95d6 Fix old services not getting removed from consul on update
Fixes #1661
2016-08-30 16:36:42 -07:00
Diptanu Choudhury 1269900973 Merge pull request #1654 from hashicorp/f-sticky-spec
Server side changes for sticky volumes
2016-08-29 14:00:32 -07:00
Mathias Lafeldt 074ff512b2
Make node-status -short work without node stats 2016-08-29 17:45:37 +02:00
Mathias Lafeldt 51dfbf9dbf
Make alloc-status -short work without allocation stats 2016-08-29 17:45:23 +02:00
Alex Dadgar 4e8576516f Increase the timeout to be greater than the RPC hold threshold 2016-08-26 11:13:20 -07:00
Diptanu Choudhury ec5afdae3d Fixed some more tests 2016-08-25 23:05:21 -05:00
Alex Dadgar 6f7d776ba6 Merge pull request #1613 from nak3/plan255
command.plan: tiny: Fix expect error code message from 1 to 255
2016-08-24 15:33:40 -07:00
Diptanu Choudhury b80147d183 Merge pull request #1645 from capone212/failing_cehcks_fix
issue #1636:  start CheckRunner if check exists in consul already
2016-08-24 16:27:05 -05:00
capone ce4d236a40 Fixed CR defects 2016-08-24 01:33:44 +03:00
Alex Dadgar 1da8566322 Merge pull request #1580 from hashicorp/f-disk-usage-monitoring
Monitor and enforce shared allocation directory disk usage
2016-08-23 09:49:53 -07:00
capone 10cc50ad29 First attemt to fix issue #1636 2016-08-23 19:09:20 +03:00
Diptanu Choudhury 94571eab5d Attempting to fix alloc status test 2016-08-22 15:07:49 -05:00
Alex Dadgar 6e54412e47 format error 2016-08-19 16:16:15 -07:00
Cameron Davison d87c66c054
add Created At to nomad alloc-status 2016-08-18 21:25:32 -05:00
Alex Dadgar 4bfdd40948 test fixes 2016-08-18 10:30:47 -07:00
Ivo Verberk 2a17895a83 Disk resource monitoring and enforcement 2016-08-18 07:59:03 +02:00
Alex Dadgar 0b9a07b19b add import 2016-08-17 16:49:05 -07:00
Kenjiro Nakayama cb94b1ae50 command.plan: tiny: Fix expect error code message from 1 to 255 2016-08-18 08:26:23 +09:00
Alex Dadgar 5966c74df7 Run command 2016-08-17 16:25:38 -07:00
Alex Dadgar 4135b4ece7 Address field name feedback 2016-08-17 16:23:29 -07:00
Alex Dadgar 7d899b6c60 Pass Vault config to client 2016-08-17 16:23:29 -07:00
Alex Dadgar eac2675faf Add enabled field 2016-08-17 16:23:29 -07:00
Alex Dadgar c913e4396f Add Vault config to server 2016-08-17 16:23:29 -07:00
Alex Dadgar 0ca4a9fa4f Change token/role names 2016-08-17 16:23:29 -07:00
Alex Dadgar adb3ce847f change config variable names to match vault 2016-08-17 16:23:29 -07:00
Alex Dadgar 93b5fab63b Parse Vault Config 2016-08-17 16:23:29 -07:00
Kenjiro Nakayama ad3b0e5ec2 Fix error messages 2016-08-17 18:33:07 +09:00
Kenjiro Nakayama 960cdf6979 Fix error message in Test{Plan,Run,Validate}Command_From_URL 2016-08-17 15:39:18 +09:00
Kenjiro Nakayama 30f274b17e Add StructJob test with jobfile from HTTP Server 2016-08-17 11:06:08 +09:00
Kenjiro Nakayama c25baab028 Rename Helper to JobGetter 2016-08-17 11:06:08 +09:00
Kenjiro Nakayama c77fbcc67b Add help and documentation 2016-08-17 11:06:08 +09:00
Kenjiro Nakayama 7fb866ae4c Use go-getter to get jobfile by URL 2016-08-17 11:06:08 +09:00
Kenjiro Nakayama 410e0f7fe3 Add URL location support to validate command 2016-08-17 11:06:08 +09:00
Kenjiro Nakayama b16afbc366 Support run/plan jobfile via URL location 2016-08-17 11:06:08 +09:00
Alex Dadgar f45941a11a fix data format test 2016-08-16 17:53:49 -07:00
Diptanu Choudhury 578171e7cb Merge pull request #1601 from hashicorp/b-fix-node-alloc-test
get a free port from the kernel
2016-08-16 17:09:03 -07:00
Diptanu Choudhury ce8a43b848 Fixed a test 2016-08-16 16:36:15 -07:00
Diptanu Choudhury f72ad34540 get a free port from the kernel 2016-08-16 16:05:37 -07:00
Diptanu Choudhury 4683aa3dc6 Cleaning up some code 2016-08-16 15:22:26 -07:00
Marin 69bc3a8fc8 Add support for initial check status 2016-08-16 12:05:15 -07:00
Alex Dadgar d108344eea Merge pull request #1540 from novilabs/add-creation-time-to-job-status
Add creation time to job status
2016-08-15 21:04:14 -07:00
Cameron Davison 9d812516e8
s/Created/Created At/ 2016-08-15 21:40:34 -05:00
Alex Dadgar dd6c08a827 Merge pull request #1584 from novilabs/stream-framer-order
duplicate check for deep equals of frame order
2016-08-15 10:30:42 -07:00
Cameron Davison 0104d6fe08
use last job eval if multiple exist, when looking for registration 2016-08-13 22:37:35 -05:00
Cameron Davison 92ac9bb84c
duplicate check for deep equals of frame order 2016-08-13 22:26:53 -05:00
Diptanu Choudhury eff622036e Merge pull request #1562 from dbresson/support-query-strings-in-checks
support query strings in checks
2016-08-12 13:06:02 -07:00
Alex Dadgar ed23dff23c Merge pull request #1571 from hashicorp/t-logs-tests
Fixing logs tests on travis
2016-08-11 19:24:46 -07:00
Alex Dadgar ffa69feb56 fs uses timed unblocker like logs command 2016-08-11 19:07:13 -07:00
Alex Dadgar 768055b4cc lock heartbeat 2016-08-11 18:37:08 -07:00
Alex Dadgar 4c77d9688f up timeouts 2016-08-11 18:30:46 -07:00
Alex Dadgar 2d5fa80ce7 Add travis multiplier 2016-08-11 18:16:10 -07:00
Diptanu Choudhury 39c9b00b6c Merge pull request #1566 from mlafeldt/fix-config-reload
Fix reload of retry_join server addresses on SIGHUP
2016-08-11 17:57:11 -07:00
Alex Dadgar 64f7eff612 Plan on system scheduler doesn't count nodes who don't meet constraints 2016-08-11 15:26:25 -07:00
David Bresson 7d0fb58f03 Add a test for query string support 2016-08-11 12:22:46 -07:00
David Bresson c651cbbfd6 Add error handling to check registration 2016-08-11 11:49:48 -07:00
David Bresson f47a543a4d Add support for query strings in check paths 2016-08-11 11:27:29 -07:00
Mathias Lafeldt 4143a9059a
Fix reload of retry_join server addresses on SIGHUP
The current code does not update the actual config, but only the local
reference to it.
2016-08-11 16:03:21 +02:00
Kenjiro Nakayama c3b871e90d Return error when client failed to collect host stats 2016-08-11 09:38:28 +09:00
Diptanu Choudhury 9a75052d2c Merge pull request #1518 from pubnub/feature/chroot-map-rebase
Add config field to specify chroot mapping for exec driver
2016-08-10 17:00:03 -07:00
Diptanu Choudhury 37d0c2c01c Merge pull request #1538 from nak3/output-host-disk-utilization2
node-status outputs volumename instead of 0B utilization when non-physical volume is used
2016-08-10 15:09:23 -07:00
Alex Dadgar c203885352 consul syncer uses multi-error 2016-08-09 12:24:50 -07:00
Kenjiro Nakayama c9e696d750 Update after another review 2016-08-09 22:50:18 +09:00
Kenjiro Nakayama 32d20c8453 Add test to check both -json and -t are not specified 2016-08-09 21:06:20 +09:00
Kenjiro Nakayama b5b6297cd3 Support JSON and template data output list when no args specified 2016-08-09 21:06:20 +09:00
Kenjiro Nakayama 770f37881f Update help and error message 2016-08-09 21:06:20 +09:00
Kenjiro Nakayama 64340a6e1b Stop using format option and support json and t option 2016-08-09 21:06:20 +09:00
Kenjiro Nakayama 5d4b3e6cef fix go panic 2016-08-09 21:06:20 +09:00
Kenjiro Nakayama 41cf333c51 Support JSON and template format with nomad CLI 2016-08-09 21:06:20 +09:00
Cameron Davison e0d757b7b0
move formatUnixNanoTime into a utility function 2016-08-08 21:24:38 -05:00
Cameron Davison 5ce7b308bb
remove time flag, and update docs with new column 2016-08-08 21:15:45 -05:00
Jay Oster dcb34412da Fix ConfigMerge test with chroot config 2016-08-08 18:59:18 -07:00
Kenjiro Nakayama 0fc15287f9 node-status outputs volumename instead of 0B utilization with non-physical volume 2016-08-09 08:51:19 +09:00
Kenjiro Nakayama 7dfc75ac9c tiny: Add MHz to node-status output 2016-08-08 13:12:01 +09:00
Cameron Davison 15c343bbe4
add time flag to add created column to allocation 2016-08-07 19:44:56 -05:00
Cameron Davison cceced4972
code cleanup of inconsistent naming, spacing, and duplicate code 2016-08-07 19:37:52 -05:00
Jay Oster 2ae059b41d Address review comments
- Simplify map length check in Linux Executor
- Added a `chroot_env` test for config parser
- Moved `ChrootEnv` field from ExecutorCommand to ExecutorContext
- Added a test for `chroot_env` functionality
2016-08-04 15:33:06 -07:00
Diptanu Choudhury 5ff750db96 Merge pull request #1501 from hashicorp/f-stats-opt-in
Allow operators to opt into publishing node and alloc metrics
2016-08-04 13:33:56 -07:00
Diptanu Choudhury 13b919434b Merge pull request #1520 from hashicorp/f-sort-tg-names-summaries
Sorting the job summaries while displaying
2016-08-04 13:32:29 -07:00
Diptanu Choudhury 083643b840 Removing the custom sorting logic 2016-08-04 13:17:21 -07:00
Diptanu Choudhury 4761ce9eaf Sorting the task group names and not the output of the format list 2016-08-04 11:54:18 -07:00
Diptanu Choudhury 4cbfd699b5 Merge pull request #1517 from hashicorp/f-reconcile-summaries
Endpoint for reconciling job summaries
2016-08-04 11:31:33 -07:00
Diptanu Choudhury 88d383c47f Updated tests and comments 2016-08-04 11:29:36 -07:00
Diptanu Choudhury 5d3a2ac1e5 Sorting the job summaries while displaying 2016-08-04 10:42:53 -07:00
Jay Oster 7df692226a Add config field to specify chroot mapping for exec driver
- Same format as used by the internal chroot mapping
- Map: source_path -> dest_path
- Example HCL:

client {
  chroot_env {
    "/etc" = "/etc"
    "/lib" = "/lib"
    "/opt/projects/foo/bin" = "/usr/bin"
  }
}
2016-08-03 17:17:17 -07:00
Diptanu Choudhury 74caed0c7a Added an endpoint for users to reconcile job summaries 2016-08-03 16:12:47 -07:00
Alex Dadgar 7b64adfcdd Merge pull request #1502 from hashicorp/f-plan-exit-code
Plan exit code map to whether allocations would change + bug fix
2016-08-03 11:10:21 -07:00
Alex Dadgar 91db768430 Fix tests 2016-08-03 11:09:50 -07:00
Alex Dadgar e474ea7cce plan returns appropriate exit code 2016-08-01 20:07:49 -07:00
Diptanu Choudhury 41b540fbc8 Allow operators to opt into publishing node and alloc metrics 2016-08-01 19:52:20 -07:00
Kenjiro Nakayama 5edffb6025 Add validation of -n and -c options 2016-08-01 21:51:13 +09:00
Alex Dadgar ef47612606 api.fs uses the api.Client rather than making raw requests 2016-07-28 14:27:17 -07:00
Kenjiro Nakayama 224ebc0129 Add LevelFilter test 2016-07-27 13:42:24 +09:00
Diptanu Choudhury cfd35f5ad4 Merge pull request #1455 from hashicorp/f-job-summary
Job Summary - Part 2
2016-07-26 16:08:37 -07:00
Alex Dadgar 6087e8e47a Merge pull request #1466 from hashicorp/d-logs
Document logs command and API
2016-07-26 09:41:58 -07:00
Kenjiro Nakayama faf33152e0 Add TestFSCommand_Fails to fs command 2016-07-26 22:45:09 +09:00
Diptanu Choudhury cc37ec33cf Renamed Job.GetJobSummary to Job.Summary 2016-07-25 17:31:40 -07:00
Diptanu Choudhury 6193529040 Fixed more tests 2016-07-25 17:31:40 -07:00
Diptanu Choudhury 50842b88c7 Fixed some bugs 2016-07-25 17:26:38 -07:00
Diptanu Choudhury 52ff7935a3 Displaying the job summary in nomad status command 2016-07-25 17:26:38 -07:00
Diptanu Choudhury a5bb0ca6fc Moved the job endpoint around 2016-07-25 17:26:38 -07:00
Diptanu Choudhury 2ff2acbfc0 Added the job summary related endpoints 2016-07-25 17:26:38 -07:00
Alex Dadgar aa0c347450 remove unused file 2016-07-25 16:24:28 -07:00
Alex Dadgar 5a5d8f4ae3 Merge pull request #1465 from 42wim/ipv6-1318
Fix IPv6 advertise addresses
2016-07-25 16:14:15 -07:00
Wim c96f3ccb28 Use net.JoinHostPort 2016-07-25 23:34:08 +02:00
Diptanu Choudhury 471416ab20 Removing un-wanted dependencies 2016-07-25 14:17:52 -07:00
Wim a04907ad91 Fix IPv6 advertise addresses 2016-07-25 22:52:18 +02:00
Alex Dadgar fcb21177dd logs command docs 2016-07-25 13:08:39 -07:00
Alex Dadgar b8817e4877 better flush and connection closed handling 2016-07-25 11:16:54 -07:00
Alex Dadgar 43d78b6d23 control-c works 2016-07-25 11:16:54 -07:00
Alex Dadgar aee152ee15 small fixes 2016-07-25 11:16:54 -07:00
Alex Dadgar 6e15bdbe36 Add logs command test 2016-07-25 11:16:54 -07:00
Alex Dadgar 1f600252e7 Handle skipping indexes 2016-07-25 11:16:54 -07:00
Alex Dadgar 120e9d14ee log tests 2016-07-25 11:16:54 -07:00
Alex Dadgar 85cc520365 Support non-following logs 2016-07-25 11:16:54 -07:00
Alex Dadgar 3b85fdd09c Look up the tasks automatically 2016-07-25 11:16:54 -07:00
Alex Dadgar 8b819a343a fix indents 2016-07-25 11:16:54 -07:00
Alex Dadgar c808f2eefa remove file events and last offset 2016-07-25 11:16:01 -07:00