Commit graph

45 commits

Author SHA1 Message Date
James Rasell d6ef3432c5
terraform: update installed versions of HashiCorp tools. (#13635) 2022-07-07 16:12:19 +02:00
Jason Paul Deland a6ddee8743
demo/terraform: fix nvidia drivers installation 2022-05-31 20:17:55 -04:00
Ivo 703a7954f4
[terraform/aws] Fix NVidia GPG key error (#12985)
* Fix NVidia GPG key error - NVidia rotated their repo keys, see https://forums.developer.nvidia.com/t/notice-cuda-linux-repository-key-rotation/212771
2022-05-16 06:49:01 -04:00
Tim Gross 4078e6ea0e
scripts: fix interpreter for bash (#12549)
Many of our scripts have a non-portable interpreter line for bash and
use bash-specific variables like `BASH_SOURCE`. Update the interpreter
line to be portable between various Linuxes and macOS without
complaint from posix shell users.
2022-04-12 10:08:21 -04:00
Mahmood Ali 906528c197
Format Terraform files (#11099)
Also format terraform scripts with hclfmt, equivalent to terraform fmt.

I opted not to use terraform fmt, because I didn't want to introduce dev dependency on the terraform CLI.

Also, I've optimized the find command to ignore spurious directories (e.g. .git, node_modules) that seem to be populated with too many files! make hclfmt takes 0.3s on my mac down from 7 seconds!
2021-09-01 15:15:06 -04:00
Seth Hoenig d2cd605995 dist: place systemd unit options correctly
This PR places StartLimitIntervalSec and StartLimitBurst in the
Unit section of systemd unit files, rather than the Service section.

https://www.freedesktop.org/software/systemd/man/systemd.unit.html

Fixes #10065
2021-02-22 19:23:00 -06:00
Michael Schurter 5f3a71d0b9 docs: update scripts to 0.12.4 2020-09-09 15:22:37 -07:00
Gale Fagan a01ab4f1a8
Updating versions and removing deprecated items (#8750)
* Removed deprecated Spark pieces.

* Bumped HashiCorp stack versions to current as of commit date

* Bumped versions of HashiCorp stack tools

* Bumped versions, added VAULT_ADDR in GCP, removed refs to Spark in shared README
2020-09-02 10:14:47 -07:00
Kent 'picat' Gruber 8ff9b566f1 Cleanup, enable the Vault UI, and bind to all IPv4 addresses in the config
This make the config cleaner, and allows Vault to actually be accessible through a load balancer.
2020-07-16 15:26:22 -04:00
Kent 'picat' Gruber ee3d0e0889 If $CLOUD is "gce" for auto-join, use different metadata curl command 2020-07-16 15:21:57 -04:00
Kent 'picat' Gruber a13b1a4ff6 Create terraform/shared/config/consul_gce.service 2020-07-16 15:20:34 -04:00
Michael Schurter 228899c32f e2e: test demo job for connect 2019-09-04 12:40:08 -07:00
Ryan Lewkowicz c407db6ade bumped hadoop version 2019-08-12 16:40:04 -04:00
Omar Khawaja 22ebf2bbc1
TF config enable services (#5947)
* enable vault, consul, and nomad services to make them persistent after reboot

* update AMI
2019-07-11 22:36:58 +02:00
Mahmood Ali bfc907827c docs: update s3 urls to use virtual bucket style
In response to https://forums.aws.amazon.com/ann.jspa?annID=6776
2019-05-06 10:39:51 -04:00
Chris Baker 921dfa32a7
Update setup.sh 2019-04-11 09:31:47 -04:00
Chris Baker c135bad029 terraform: work on terraform setup
* support for 0.9.0
* ELB for servers
* better output
* customizable security groups
* nvidia-docker support
* different server/client instance types
2019-04-11 13:00:20 +00:00
Michael Schurter 30db07cccb docs: sync systemd unit files; update deploy guide
The systemd configs spread across our repo were fairly out of sync. This
should get them on our best practices.

The deployment guide also had some strange things like running Nomad as
a non-root user. It would be fine for servers but completely breaks
clients. For simplicity I simply removed the non-root user references.
2019-03-19 15:18:12 -07:00
Omar Khawaja 2eab3db0dc
AWS env update (#5423)
* update versions of all products and add consul-template

* update client and server user_data scripts

* modify README.md and terraform.tfvars

* fix typo in consul-template system unit file

* update AMI id
2019-03-15 15:55:34 -04:00
Omar Khawaja 0b9f32c6d2
AWS sandbox environment upgrade (#4873)
* upgrade Nomad from 0.8.4 to 0.8.6

* update deprecated nomad and vault commands

* update AMI ID

* add ingress rule for default fabio port and fabio UI

* upgrade Consul and Vault versions

* update AMI ID in README.md and terraform.tfvars
2018-11-13 23:21:01 -05:00
Thomas Hackett 40767c2b12 Corrected vault address and port in client/server hcl 2018-09-14 16:18:03 +00:00
Rob Genova b1fc227b5c bump Vault, Consul, Nomad versions; update AWS AMI 2018-06-26 22:13:47 +00:00
Rob Genova 40fff0cbfa bump Nomad to 0.8.1, Hadoop to 2.7.6 2018-04-18 22:33:58 +00:00
Rob Genova 276b4f5619 Update to Nomad 0.8, Consul 1.0.7 and Vault 0.10 2018-04-15 23:00:55 +00:00
Michael Schurter 58d2b8b7be tf: update services and add tools
Also use the latest method for installing Docker via:
https://docs.docker.com/install/linux/docker-ce/debian/
2018-04-04 15:05:49 -07:00
Rob Genova 4db0f9a4a4 Bump Hadoop version in run-time config scripts; update AMI 2018-03-20 19:55:09 +00:00
Rob Genova 55f1448336 Enable raw_exec and Docker privileged mode 2018-03-20 17:48:14 +00:00
Rob Genova e318226d42 Bump Hadoop version 2018-03-20 17:47:24 +00:00
Rob Genova f42487531a Support dynamic replacement of the Nomad binary at run-time 2018-03-20 17:46:32 +00:00
Rob Genova 70a0e81af5 Use latest versions of Consul, Vault and Nomad 2018-01-08 22:44:02 +00:00
Rob Genova b2b9dc10dc update provisioning scripts to support both AWS and Azure 2017-11-15 19:39:36 +00:00
Rob Genova ffa44f6651 update config files to support systemd and Azure; reorganize Packer file hierarchy; update Vagrantfile to use latest tool versions 2017-11-15 19:31:46 +00:00
Rob Genova e0b8465ae3 Update build and runtime config scripts to support multiple clouds 2017-11-01 21:15:58 +00:00
Rob Genova 7cd3eeb611 Use per cloud upstart config files 2017-11-01 21:13:58 +00:00
Rob Genova 3253e12738 update Consul config files to use updated retry-join syntax 2017-11-01 21:09:07 +00:00
Rob Genova 7f87b0ea20 bind Nomad to all interfaces; enable Consul UI 2017-08-04 18:00:05 +00:00
Rob Genova 5bcf32282f Update scripts and AMI to reflect Nomad 0.6 2017-07-26 22:34:34 +00:00
Rob Genova 9fd45265f2 Replace references to personal S3 bucket 2017-07-07 22:29:21 -07:00
Rob Genova 4a17d570ae remove GOMAXPROCS 2017-07-07 09:48:19 -07:00
Rob Genova 3e0d507792 remove custom chroot_env 2017-07-07 09:09:22 -07:00
Rob Genova fddf190f5f cleanup build/provision shell scripts 2017-06-25 11:54:56 -07:00
Rob Genova da8811a097 various script and config file tweaks 2017-06-25 10:09:54 -07:00
Rob Genova 4752dcd117 refactor build and provisioning scripts to support DNS integration, HDFS 2017-06-24 16:25:46 -07:00
Rob Genova fe5797bfaa install latest versions of products 2017-06-15 15:47:46 -07:00
Rob Genova 3de63d132c Initial commit for Terraform/AWS support 2017-05-15 11:56:41 -07:00