2018-12-10 17:54:23 +00:00
---
2020-02-06 23:45:31 +00:00
layout: docs
2023-01-30 14:48:43 +00:00
page_title: spread Block - Job Specification
2020-02-06 23:45:31 +00:00
description: >-
2023-01-30 14:48:43 +00:00
The "spread" block is used to spread placements across a certain node
2020-02-06 23:45:31 +00:00
attributes such as datacenter.
2019-12-11 14:59:26 +00:00
Spread may be specified at the job or group levels for ultimate flexibility.
2020-02-06 23:45:31 +00:00
2023-01-30 14:48:43 +00:00
More than one spread block may be specified with relative weights between
2020-02-06 23:45:31 +00:00
each.
2018-12-10 17:54:23 +00:00
---
2023-01-30 14:48:43 +00:00
# `spread` Block
2018-12-10 17:54:23 +00:00
2020-02-06 23:45:31 +00:00
<Placement
groups={[
['job', 'spread'],
2020-09-30 13:48:40 +00:00
['job', 'group', 'spread'],
2020-02-06 23:45:31 +00:00
]}
/>
2018-12-10 17:54:23 +00:00
2023-01-30 14:48:43 +00:00
The `spread` block allows operators to increase the failure tolerance of their
2019-01-28 22:59:55 +00:00
applications by specifying a node attribute that allocations should be spread
over. This allows operators to spread allocations over attributes such as
datacenter, availability zone, or even rack in a physical datacenter. By
default, when using spread the scheduler will attempt to place allocations
equally among the available values of the given target.
2018-12-10 17:54:23 +00:00
2019-01-24 20:58:26 +00:00
```hcl
job "docs" {
# Spread allocations over all datacenter
spread {
attribute = "${node.datacenter}"
}
group "example" {
# Spread allocations over each rack based on desired percentage
spread {
2019-03-26 20:01:56 +00:00
attribute = "${meta.rack}"
target "r1" {
2019-01-24 20:58:26 +00:00
percent = 60
}
2019-03-26 20:01:56 +00:00
target "r2" {
2019-01-24 20:58:26 +00:00
percent = 40
}
}
}
}
```
2019-01-10 21:46:03 +00:00
Nodes are scored according to how closely they match the desired target percentage defined in the
2023-01-30 14:48:43 +00:00
spread block. Spread scores are combined with other scoring factors such as bin packing.
2018-12-10 17:54:23 +00:00
A job or task group can have more than one spread criteria, with weights to express relative preference.
2021-12-21 15:10:01 +00:00
Spread criteria are treated as a soft preference by the Nomad
scheduler. If no nodes match a given spread criteria, placement is
still successful. To avoid scoring every node for every placement,
allocations may not be perfectly spread. Spread works best on
attributes with similar number of nodes: identically configured racks
or similarly configured datacenters.
2019-01-10 21:46:03 +00:00
Spread may be expressed on [attributes][interpolation] or [client metadata][client-meta].
2019-12-11 14:59:26 +00:00
Additionally, spread may be specified at the [job][job] and [group][group] levels for ultimate flexibility. Job level spread criteria are inherited by all task groups in the job.
2019-01-10 21:46:03 +00:00
2018-12-10 17:54:23 +00:00
## `spread` Parameters
- `attribute` `(string: "")` - Specifies the name or reference of the attribute
to use. This can be any of the [Nomad interpolated
2023-01-25 17:31:14 +00:00
values](/nomad/docs/runtime/interpolation#interpreted_node_vars).
2018-12-10 17:54:23 +00:00
2020-02-06 23:45:31 +00:00
- `target` <code>([target](#target-parameters): <required>)</code> - Specifies one or more target
2023-01-30 14:48:43 +00:00
percentages for each value of the `attribute` in the spread block. If this is omitted,
2020-02-06 23:45:31 +00:00
Nomad will spread allocations evenly across all values of the attribute.
2018-12-10 17:54:23 +00:00
2023-01-30 14:48:43 +00:00
- `weight` `(integer:0)` - Specifies a weight for the spread block. The weight is used
2019-01-10 21:46:03 +00:00
during scoring and must be an integer between 0 to 100. Weights can be used
2023-01-30 14:48:43 +00:00
when there is more than one spread or affinity block to express relative preference across them.
2018-12-10 17:54:23 +00:00
## `target` Parameters
2023-01-30 14:48:43 +00:00
- `value` `(string:"")` - Specifies a target value of the attribute from a `spread` block.
2018-12-10 17:54:23 +00:00
- `percent` `(integer:0)` - Specifies the percentage associated with the target value.
## `spread` Examples
2023-01-30 14:48:43 +00:00
The following examples show different ways to use the `spread` block.
2018-12-10 17:54:23 +00:00
### Even Spread Across Data Center
2023-01-30 14:48:43 +00:00
This example shows a spread block across the node's `datacenter` attribute. If we have
2019-01-10 21:46:03 +00:00
two datacenters `us-east1` and `us-west1`, and a task group of `count = 10`,
Nomad will attempt to place 5 allocations in each datacenter.
2018-12-10 17:54:23 +00:00
```hcl
spread {
attribute = "${node.datacenter}"
weight = 100
}
```
### Spread With Target Percentages
2023-01-30 14:48:43 +00:00
This example shows a spread block that specifies one target percentage. If we
2019-03-26 20:01:56 +00:00
have three datacenters `us-east1`, `us-east2`, and `us-west1`, and a task group
2022-08-05 20:45:30 +00:00
of `count = 10`, Nomad will attempt to place 5 of the allocations in "us-east1",
2019-03-26 20:01:56 +00:00
and will spread the remaining among the other two datacenters.
2019-01-10 21:46:03 +00:00
```hcl
spread {
attribute = "${node.datacenter}"
weight = 100
target "us-east1" {
percent = 50
}
}
```
2023-01-30 14:48:43 +00:00
This example shows a spread block that specifies target percentages for two
2019-01-10 21:46:03 +00:00
different datacenters. If we have two datacenters `us-east1` and `us-west1`,
and a task group of `count = 10`, Nomad will attempt to place 6 allocations
in `us-east1` and 4 in `us-west1`.
2018-12-10 17:54:23 +00:00
```hcl
spread {
attribute = "${node.datacenter}"
weight = 100
2019-01-10 21:46:03 +00:00
2018-12-10 17:54:23 +00:00
target "us-east1" {
percent = 60
}
2019-01-10 21:46:03 +00:00
2018-12-10 17:54:23 +00:00
target "us-west1" {
percent = 40
}
}
```
### Spread Across Multiple Attributes
2023-01-30 14:48:43 +00:00
This example shows spread blocks with multiple attributes. Consider a Nomad cluster
2019-01-10 21:46:03 +00:00
where there are two datacenters `us-east1` and `us-west1`, and each datacenter has nodes
2023-01-30 14:48:43 +00:00
with `${meta.rack}` being `r1` or `r2`. With the following spread block used on a job with `count=12`, Nomad
2019-01-10 21:46:03 +00:00
will attempt to place 6 allocations in each datacenter. Within a datacenter, Nomad will
attempt to place 3 allocations in nodes on rack `r1`, and 3 allocations in nodes on rack `r2`.
2018-12-10 17:54:23 +00:00
```hcl
spread {
attribute = "${node.datacenter}"
weight = 50
}
spread {
attribute = "${meta.rack}"
weight = 50
}
```
2023-01-25 17:31:14 +00:00
[job]: /nomad/docs/job-specification/job 'Nomad job Job Specification'
[group]: /nomad/docs/job-specification/group 'Nomad group Job Specification'
[client-meta]: /nomad/docs/configuration/client#meta 'Nomad meta Job Specification'
[task]: /nomad/docs/job-specification/task 'Nomad task Job Specification'
[interpolation]: /nomad/docs/runtime/interpolation 'Nomad interpolation'
[node-variables]: /nomad/docs/runtime/interpolation#node-variables- 'Nomad interpolation-Node variables'
[constraint]: /nomad/docs/job-specification/constraint 'Nomad Constraint job Specification'