d6ef3432c5
terraform: update installed versions of HashiCorp tools. ( #13635 )
2022-07-07 16:12:19 +02:00
a6ddee8743
demo/terraform: fix nvidia drivers installation
2022-05-31 20:17:55 -04:00
703a7954f4
[terraform/aws] Fix NVidia GPG key error ( #12985 )
...
* Fix NVidia GPG key error - NVidia rotated their repo keys, see https://forums.developer.nvidia.com/t/notice-cuda-linux-repository-key-rotation/212771
2022-05-16 06:49:01 -04:00
4078e6ea0e
scripts: fix interpreter for bash ( #12549 )
...
Many of our scripts have a non-portable interpreter line for bash and
use bash-specific variables like `BASH_SOURCE`. Update the interpreter
line to be portable between various Linuxes and macOS without
complaint from posix shell users.
2022-04-12 10:08:21 -04:00
906528c197
Format Terraform files ( #11099 )
...
Also format terraform scripts with hclfmt, equivalent to terraform fmt.
I opted not to use terraform fmt, because I didn't want to introduce dev dependency on the terraform CLI.
Also, I've optimized the find command to ignore spurious directories (e.g. .git, node_modules) that seem to be populated with too many files! make hclfmt takes 0.3s on my mac down from 7 seconds!
2021-09-01 15:15:06 -04:00
d2cd605995
dist: place systemd unit options correctly
...
This PR places StartLimitIntervalSec and StartLimitBurst in the
Unit section of systemd unit files, rather than the Service section.
https://www.freedesktop.org/software/systemd/man/systemd.unit.html
Fixes #10065
2021-02-22 19:23:00 -06:00
5f3a71d0b9
docs: update scripts to 0.12.4
2020-09-09 15:22:37 -07:00
a01ab4f1a8
Updating versions and removing deprecated items ( #8750 )
...
* Removed deprecated Spark pieces.
* Bumped HashiCorp stack versions to current as of commit date
* Bumped versions of HashiCorp stack tools
* Bumped versions, added VAULT_ADDR in GCP, removed refs to Spark in shared README
2020-09-02 10:14:47 -07:00
8ff9b566f1
Cleanup, enable the Vault UI, and bind to all IPv4 addresses in the config
...
This make the config cleaner, and allows Vault to actually be accessible through a load balancer.
2020-07-16 15:26:22 -04:00
ee3d0e0889
If $CLOUD is "gce" for auto-join, use different metadata curl command
2020-07-16 15:21:57 -04:00
a13b1a4ff6
Create terraform/shared/config/consul_gce.service
2020-07-16 15:20:34 -04:00
228899c32f
e2e: test demo job for connect
2019-09-04 12:40:08 -07:00
c407db6ade
bumped hadoop version
2019-08-12 16:40:04 -04:00
22ebf2bbc1
TF config enable services ( #5947 )
...
* enable vault, consul, and nomad services to make them persistent after reboot
* update AMI
2019-07-11 22:36:58 +02:00
bfc907827c
docs: update s3 urls to use virtual bucket style
...
In response to https://forums.aws.amazon.com/ann.jspa?annID=6776
2019-05-06 10:39:51 -04:00
921dfa32a7
Update setup.sh
2019-04-11 09:31:47 -04:00
c135bad029
terraform: work on terraform setup
...
* support for 0.9.0
* ELB for servers
* better output
* customizable security groups
* nvidia-docker support
* different server/client instance types
2019-04-11 13:00:20 +00:00
30db07cccb
docs: sync systemd unit files; update deploy guide
...
The systemd configs spread across our repo were fairly out of sync. This
should get them on our best practices.
The deployment guide also had some strange things like running Nomad as
a non-root user. It would be fine for servers but completely breaks
clients. For simplicity I simply removed the non-root user references.
2019-03-19 15:18:12 -07:00
2eab3db0dc
AWS env update ( #5423 )
...
* update versions of all products and add consul-template
* update client and server user_data scripts
* modify README.md and terraform.tfvars
* fix typo in consul-template system unit file
* update AMI id
2019-03-15 15:55:34 -04:00
0b9f32c6d2
AWS sandbox environment upgrade ( #4873 )
...
* upgrade Nomad from 0.8.4 to 0.8.6
* update deprecated nomad and vault commands
* update AMI ID
* add ingress rule for default fabio port and fabio UI
* upgrade Consul and Vault versions
* update AMI ID in README.md and terraform.tfvars
2018-11-13 23:21:01 -05:00
40767c2b12
Corrected vault address and port in client/server hcl
2018-09-14 16:18:03 +00:00
b1fc227b5c
bump Vault, Consul, Nomad versions; update AWS AMI
2018-06-26 22:13:47 +00:00
40fff0cbfa
bump Nomad to 0.8.1, Hadoop to 2.7.6
2018-04-18 22:33:58 +00:00
276b4f5619
Update to Nomad 0.8, Consul 1.0.7 and Vault 0.10
2018-04-15 23:00:55 +00:00
58d2b8b7be
tf: update services and add tools
...
Also use the latest method for installing Docker via:
https://docs.docker.com/install/linux/docker-ce/debian/
2018-04-04 15:05:49 -07:00
4db0f9a4a4
Bump Hadoop version in run-time config scripts; update AMI
2018-03-20 19:55:09 +00:00
55f1448336
Enable raw_exec and Docker privileged mode
2018-03-20 17:48:14 +00:00
e318226d42
Bump Hadoop version
2018-03-20 17:47:24 +00:00
f42487531a
Support dynamic replacement of the Nomad binary at run-time
2018-03-20 17:46:32 +00:00
70a0e81af5
Use latest versions of Consul, Vault and Nomad
2018-01-08 22:44:02 +00:00
b2b9dc10dc
update provisioning scripts to support both AWS and Azure
2017-11-15 19:39:36 +00:00
ffa44f6651
update config files to support systemd and Azure; reorganize Packer file hierarchy; update Vagrantfile to use latest tool versions
2017-11-15 19:31:46 +00:00
e0b8465ae3
Update build and runtime config scripts to support multiple clouds
2017-11-01 21:15:58 +00:00
7cd3eeb611
Use per cloud upstart config files
2017-11-01 21:13:58 +00:00
3253e12738
update Consul config files to use updated retry-join syntax
2017-11-01 21:09:07 +00:00
7f87b0ea20
bind Nomad to all interfaces; enable Consul UI
2017-08-04 18:00:05 +00:00
5bcf32282f
Update scripts and AMI to reflect Nomad 0.6
2017-07-26 22:34:34 +00:00
9fd45265f2
Replace references to personal S3 bucket
2017-07-07 22:29:21 -07:00
4a17d570ae
remove GOMAXPROCS
2017-07-07 09:48:19 -07:00
3e0d507792
remove custom chroot_env
2017-07-07 09:09:22 -07:00
fddf190f5f
cleanup build/provision shell scripts
2017-06-25 11:54:56 -07:00
da8811a097
various script and config file tweaks
2017-06-25 10:09:54 -07:00
4752dcd117
refactor build and provisioning scripts to support DNS integration, HDFS
2017-06-24 16:25:46 -07:00
fe5797bfaa
install latest versions of products
2017-06-15 15:47:46 -07:00
3de63d132c
Initial commit for Terraform/AWS support
2017-05-15 11:56:41 -07:00
James Rasell