open-nomad/website/content/docs/commands/job/dispatch.mdx

Ignoring revisions in .git-blame-ignore-revs. Click here to bypass and see the normal blame view.

168 lines
6.2 KiB
Plaintext
Raw Normal View History

2017-01-25 21:48:33 +00:00
---
2020-02-06 23:45:31 +00:00
layout: docs
page_title: 'Commands: job dispatch'
description: |
2017-01-25 21:48:33 +00:00
The dispatch command is used to create an instance of a parameterized job.
---
# Command: job dispatch
The `job dispatch` command is used to create new instances of a [parameterized
2017-01-26 03:14:58 +00:00
job]. The parameterized job captures a job's configuration and runtime
2017-01-25 21:48:33 +00:00
requirements in a generic way and `dispatch` is used to provide the input for
2017-01-26 19:31:47 +00:00
the job to run against. A parameterized job is similar to a function definition,
and dispatch is used to invoke the function.
2017-01-25 21:48:33 +00:00
2017-01-26 03:14:58 +00:00
Each time a job is dispatched, a unique job ID is generated. This allows a
caller to track the status of the job, much like a future or promise in some
programming languages.
2017-01-25 21:48:33 +00:00
## Usage
```plaintext
2017-01-25 21:48:33 +00:00
nomad job dispatch [options] <parameterized job> [input source]
```
Dispatch creates an instance of a parameterized job. A data payload to the
dispatched instance can be provided via stdin by using "-" for the input source
2017-09-27 18:14:37 +00:00
or by specifying a path to a file. Metadata can be supplied by using the meta
2017-01-25 21:48:33 +00:00
flag one or more times.
The payload has a **size limit of 16384 bytes (16KiB)**.
2017-01-26 19:31:47 +00:00
An optional idempotency token can be specified to prevent dispatching more than
one instance of the same job. The token can have any value and will be matched
with existing jobs. If an instance with the same token already exists, the job
will not be dispatched.
2017-03-29 18:49:09 +00:00
Upon successful creation, the dispatched job ID will be printed and the
2017-01-25 21:48:33 +00:00
triggered evaluation will be monitored. This can be disabled by supplying the
detach flag.
On successful job submission and scheduling, exit code 0 will be returned. If
there are job placement issues encountered (unsatisfiable constraints, resource
exhaustion, etc), then the exit code will be 2. Any other errors, including
client connection issues or internal errors, are indicated by exit code 1.
When ACLs are enabled, this command requires a token with the `dispatch-job`
capability for the job's namespace. The `list-jobs` capability is required to
run the command with a job prefix instead of the exact job ID. The `read-job`
capability is required to monitor the resulting evaluation when `-detach` is
not used.
2022-09-28 12:30:22 +00:00
See the [multiregion] documentation for additional considerations when
dispatching parameterized jobs.
2017-01-25 21:48:33 +00:00
## General Options
2020-02-06 23:45:31 +00:00
@include 'general_options.mdx'
2017-01-25 21:48:33 +00:00
## Dispatch Options
2017-01-25 21:48:33 +00:00
- `-meta`: Meta takes a key/value pair separated by "=". The metadata key will
2017-01-26 19:31:47 +00:00
be merged into the job's metadata. The job may define a default value for the
2017-09-27 18:14:37 +00:00
key which is overridden when dispatching. The flag can be provided more than
2017-01-26 19:31:47 +00:00
once to inject multiple metadata key/value pairs. Arbitrary keys are not
allowed. The parameterized job must allow the key to be merged.
2017-01-25 21:48:33 +00:00
- `-detach`: Return immediately instead of monitoring. A new evaluation ID
2017-01-25 21:48:33 +00:00
will be output, which can be used to examine the evaluation using the
[eval status] command
2017-01-25 21:48:33 +00:00
- `-idempotency-token`: Optional identifier used to prevent more than one
instance of the job from being dispatched.
- `-id-prefix-template`: Optional prefix template for dispatched job IDs.
- `-verbose`: Show full information.
2017-01-25 21:48:33 +00:00
## Examples
Dispatch against a parameterized job with the ID "video-encode" and
passing in a configuration payload via stdin:
2020-05-18 20:53:06 +00:00
```shell-session
$ cat << EOF | nomad job dispatch video-encode -
2017-01-25 21:48:33 +00:00
{
"s3-input": "https://video-bucket.s3-us-west-1.amazonaws.com/cb31dabb1",
"s3-output": "https://video-bucket.s3-us-west-1.amazonaws.com/a149adbe3",
2017-01-25 21:48:33 +00:00
"input-codec": "mp4",
"output-codec": "webm",
"quality": "1080p"
}
EOF
Dispatched Job ID = video-encode/dispatch-1485379325-cb38d00d
Evaluation ID = 31199841
==> Monitoring evaluation "31199841"
Evaluation triggered by job "example/dispatch-1485379325-cb38d00d"
Allocation "8254b85f" created: node "82ff9c50", group "cache"
Evaluation status changed: "pending" -> "complete"
==> Evaluation "31199841" finished with status "complete"
```
Dispatch against a parameterized job with the ID "video-encode" and
passing in a configuration payload via a file:
2020-05-18 20:53:06 +00:00
```shell-session
$ nomad job dispatch video-encode video-config.json
2017-01-25 21:48:33 +00:00
Dispatched Job ID = video-encode/dispatch-1485379325-cb38d00d
Evaluation ID = 31199841
==> Monitoring evaluation "31199841"
Evaluation triggered by job "example/dispatch-1485379325-cb38d00d"
Allocation "8254b85f" created: node "82ff9c50", group "cache"
Evaluation status changed: "pending" -> "complete"
==> Evaluation "31199841" finished with status "complete"
```
Dispatch against a parameterized job with the ID "video-encode" using the detach
flag:
2020-05-18 20:53:06 +00:00
```shell-session
$ nomad job dispatch -detach video-encode video-config.json
2017-01-25 21:48:33 +00:00
Dispatched Job ID = example/dispatch-1485380684-c37b3dba
Evaluation ID = d9034c4e
```
2017-01-26 03:14:58 +00:00
Dispatch with an idempotency token for the first time:
```shell-session
$ nomad job dispatch -idempotency-token=prod video-encode video-config.json
Dispatched Job ID = video-encode/dispatch-1485379325-cb38d00d
Evaluation ID = 31199841
==> Monitoring evaluation "31199841"
Evaluation triggered by job "example/dispatch-1485379325-cb38d00d"
Allocation "8254b85f" created: node "82ff9c50", group "cache"
Evaluation status changed: "pending" -> "complete"
==> Evaluation "31199841" finished with status "complete"
```
Dispatch with the same idempotency token:
```shell-session
$ nomad job dispatch -idempotency-token=prod video-encode video-config.json
Job "video-encode/dispatch-1485379325-cb38d00d" already dispatched with idempotency token "prod".
```
Dispatch with an id prefix:
```shell-session
$ nomad job dispatch -id-prefix-template=config1 video-encode video-config1.json
Jb
Dispatched Job ID = video-encode/dispatch-config1-1485379325-cb38d00d
Evaluation ID = 31199841
==> Monitoring evaluation "31199841"
Evaluation triggered by job "example/dispatch-config1-1485379325-cb38d00d"
Allocation "8254b85f" created: node "82ff9c50", group "cache"
Evaluation status changed: "pending" -> "complete"
==> Evaluation "31199841" finished with status "complete"
```
[eval status]: /nomad/docs/commands/eval/status
[parameterized job]: /nomad/docs/job-specification/parameterized 'Nomad parameterized Job Specification'
[multiregion]: /nomad/docs/job-specification/multiregion#parameterized-dispatch